Data Engineer, Data Platform
1 week ago
Technology
Data Engineer, Data Platform - USDS
Location
:
Sydney
Employment Type
:
Regular
Job Code
:
A31128A
Responsibilities
As a data engineer in the data platform team area, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world that directly supports the TikTok app. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 3 days a week, or as directed by their manager/department. We regularly review our hybrid work model, and the specific requirements may change at any time.
Responsibilities:
- Design, implement and maintain reliable, scalable, robust and extensible big data systems that support core products and business
- Design, build, and maintain data pipelines utilizing optimal ETL patterns, frameworks, query techniques, sourcing from structured and unstructured data sources to ensure data is easily accessible and can be used effectively by other members of the organization.
- Extract data from various sources such as APIs, HIVE tables and other structured and unstructured data sources to process and store large volumes of data ensuring data accuracy, consistency, and security.
- Implement and monitor quality control measures to ensure data accuracy, completeness, and consistency.
- Create and maintain technical documentation, such as data dictionaries, data flow diagrams, and system documentation, to ensure efficient and effective data management and analysis.
- Optimize pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts.
- Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights in a meaningful way
- Ability to analyze and visualize data to provide business stakeholders with impactful, actionable insights
- Establish solid design and best engineering practice for engineers as well as non-technical people
Qualifications
Minimum Qualifications
- Bachelors degree in Statistics, Computer Science or a related technical field involving software or systems engineering, or equivalent practical experience
- 1+ years of experience working with data analytics and data engineering, including experience with data cleaning and preprocessing, data ingestion and ETL(Extraction, Transformation & Loading), data analysis and dashboard development.
- 1+ years experience building dashboards in Tableau, Power BI or any similar visualization tool.
Preferred Qualifications
- Proficiency in distributed data processing using Big Data technologies like Spark/Scala, Python, Hadoop/HDFS/AWS/S3 and Kafka
- Proficiency in data modeling, data design, SQL and databases.
- 3+ years of Experience with Big Data technologies (Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc)
- Strong background in algorithms and data structures
- Experience working with PII and GDPR data
- Ability to communicate effectively, both written and verbal, with technical and non-technical partners
- Ability to deliver consistent high quality results while working in a fast paced environment
- Passionate, curious, and seeking to tackle every day problems with innovation
Job Information
About USDS
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security ("USDS") is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the TikTok platform and U.S. user data, so millions of Americans can continue turning to TikTok to learn something new, earn a living, express themselves creatively, or be entertained. The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more.
Data Security Statement
This role requires the ability to work with and support systems designed to protect sensitive data and information. As such, this role will be subject to strict national security-related screening.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Acknowledgment of Country
In the spirit of reconciliation, TikTok acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.
-
Data Engineer
1 week ago
Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...
-
Data Engineer
6 days ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineer
7 days ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineer
7 days ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineer Consultant
4 weeks ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full timeJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...
-
Data Engineer Consultant
2 weeks ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full timeJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...
-
Data Engineer, Data Platform
6 days ago
Sydney, New South Wales, Australia Tiktok Full timeAs a data engineer in the data platform team area, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world that directly supports the TikTok app.You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem.Your work will have a direct and huge impact on the...
-
Data Platforms Engineer
4 days ago
Sydney, New South Wales, Australia beBeeEngineering Full time $170,000 - $220,000Job OverviewAs a seasoned engineering leader, you will spearhead the development and management of data platforms to drive business success. Your team's work will focus on delivering streamlined, efficient, and secure systems.Main Responsibilities:Lead a team creating, managing, and optimizing data platforms for business growth.Drive thought leadership,...
-
Data Platform Engineer
2 weeks ago
Sydney, New South Wales, Australia Buscojobs Full timeData Platform Engineer Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team.This pivotal role demands a seasoned professional with robust...
-
Data Platform Engineer
1 week ago
Sydney, New South Wales, Australia beBeeSoftware Full time $180,000 - $220,000About the RoleThis is a software engineering position within our organization. The role involves designing and developing next-generation data platforms and pipeline solutions.The ideal candidate will have experience in Java, Spring Boot, and RESTful API development. Additionally, they should be familiar with distributed data processing using Python, SQL,...