Data Ingestion SRE, Data Platform

Technology

Data Ingestion SRE, Data Platform -USDS

Location

:

Sydney

Employment Type

:

Regular

Job Code

:

A91491A

Responsibilities

Site Reliability Engineering (SRE) combines software and systems engineering to build and run large-scale, massively distributed services and infrastructures. As a site reliability engineer in the data platform area, you will have the opportunity to manage the services and infrastructures in one of the largest dataplaforms in the world that directly supports the TikTok app. You'll need to ensure the data, services and infrastructures are reliable, fault-tolerant, efficiently scalable and cost-effective.

In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 3 days a week, or as directed by their manager/department. We regularly review our hybrid work model, and the specific requirements may change at any time.

Responsibilities:

• End-to-End Service Lifecycle Management: Participate in and continuously improve the full lifecycle of services, from initial design and development to deployment, ongoing operation, and iterative optimization.
• Ensure Reliability and Scalability: Maintain highly reliable, fault-tolerant, and scalable systems that are both cost-effective and efficient, ensuring data, services, and infrastructure meet business needs.
• Performance Troubleshooting: Diagnose and resolve performance issues, including slow queries, resource contention, and bottlenecks across distributed storage engines and services.
• Cluster Scaling and Data Growth: Plan and implement strategies for scaling clusters effectively to accommodate increasing data volume while optimizing performance and cost-efficiency.
• Documentation and Incident Response: Develop and maintain clear runbooks, Standard Operating Procedures (SOPs), and lead sustainable, blameless incident response practices with post-incident analysis to drive continuous improvement.
• Big Data System Design: Architect and implement robust, scalable, and extensible big data systems that support the core business and products, ensuring seamless data flow and system integration.
• On-Call Rotation: Participate in on-call rotations for production incidents, ensuring critical issues are addressed swiftly, with availability to troubleshoot and resolve problems outside of regular business hours as needed.
• Incident Ownership and Analysis: Take ownership of incidents during on-call hours, coordinate escalations as necessary, and conduct thorough post-incident analyses to identify root causes and implement preventive measures.

Qualifications

Minimum Qualifications

• Bachelor's degree in Computer Science, a related technical field involving software or systems engineering, or equivalent practical experience.
• Experience writing code in Java, Scala, Go, Python, or a similar language. Strong scripting skills (e.g., Bash and Shell) for automation tasks.
• Experience with algorithms, data structures, complexity analysis, and software design: Solid understanding of how to build scalable and efficient systems.
• Basic SQL (MySQL, PostgreSQL, or similar): Strong understanding of traditional relational databases like MySQL or PostgreSQL. Ability to write queries, perform joins, use aggregate functions, and optimize basic SQL queries.
• Systems and Infrastructure: Knowledge of Linux/Unix systems, as most infrastructure is based on Linux. Familiarity with system internals, networking, and resource management (memory, CPU, storage).
• Hands-on experience with observability tools such as Prometheus, Grafana, & OpenTSDB: For monitoring, logging, and real-time performance tracking.
• CI/CD Tools: Familiarity with Continuous Integration/Continuous Deployment pipelines and tools (e.g., Jenkins, GitLab CI).

Preferred Qualifications:

• Hands-on experience with distributed processing frameworks like Apache Spark and Apache Flink: Expertise in using these frameworks for large-scale data processing and stream processing.
• Familiarity with Apache Kafka and Apache Hive integrations: Experience with these tools in the context of data pipelines and stream processing.
• HiveSQL Knowledge: Solid understanding of HiveSQL (Hive Query Language - HQL), including the ability to write, optimize, and debug queries on large datasets stored in Hadoop-based systems (like Hive, HDFS, or similar).
• HiveSQL with Kafka Stream Integration: Knowledge and experience in integrating HiveSQL with Kafka Streams or Kafka Connect for real-time data processing
• Experience running production-grade services at scale: Understanding of cloud-native technologies, networking, and storage management to support high-availability and large-scale environments.
• Experience developing tools and APIs: To reduce manual intervention in systems administration and improve automation and operational efficiency.
• Expertise in designing, analyzing, and troubleshooting large-scale systems: Experience with Hadoop, Spark, Hive, Presto, Kafka, Flink, or comparable solutions is a strong plus.

Job Information

About USDS

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security ("USDS") is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the TikTok platform and U.S. user data, so millions of Americans can continue turning to TikTok to learn something new, earn a living, express themselves creatively, or be entertained. The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more.

​

​

Data Security Statement

​

This role requires the ability to work with and support systems designed to protect sensitive data and information. As such, this role will be subject to strict national security-related screening.

​

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

​

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

​

​

Diversity & Inclusion

​

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

​

Acknowledgment of Country

In the spirit of reconciliation, TikTok acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.