Data Engineer, Data Platform

6 days ago

Sydney, New South Wales, Australia Tiktok Full time

As a data engineer in the data platform team area, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world that directly supports the TikTok app.
You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem.
Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 3 days a week, or as directed by their manager/department.
We regularly review our hybrid work model, and the specific requirements may change at any time.
Responsibilities:
- Design, implement and maintain reliable, scalable, robust and extensible big data systems that support core products and business
- Design, build, and maintain data pipelines utilizing optimal ETL patterns, frameworks, query techniques, sourcing from structured and unstructured data sources to ensure data is easily accessible and can be used effectively by other members of the organization.
- Extract data from various sources such as APIs, HIVE tables and other structured and unstructured data sources to process and store large volumes of data ensuring data accuracy, consistency, and security.
- Implement and monitor quality control measures to ensure data accuracy, completeness, and consistency.
- Create and maintain technical documentation, such as data dictionaries, data flow diagrams, and system documentation, to ensure efficient and effective data management and analysis.
- Optimize pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts.
- Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights in a meaningful way
- Ability to analyze and visualize data to provide business stakeholders with impactful, actionable insights
- Establish solid design and best engineering practice for engineers as well as non-technical people Minimum Qualifications
- Bachelors degree in Statistics, Computer Science or a related technical field involving software or systems engineering, or equivalent practical experience
- 1+ years of experience working with data analytics and data engineering, including experience with data cleaning and preprocessing, data ingestion and ETL(Extraction, Transformation & Loading), data analysis and dashboard development.
- 1+ years experience building dashboards in Tableau, Power BI or any similar visualization tool.
Preferred Qualifications
- Proficiency in distributed data processing using Big Data technologies like Spark/Scala, Python, Hadoop/HDFS/AWS/S3 and Kafka
- Proficiency in data modeling, data design, SQL and databases.
- 3+ years of Experience with Big Data technologies (Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc)
- Strong background in algorithms and data structures
- Experience working with PII and GDPR data
- Ability to communicate effectively, both written and verbal, with technical and non-technical partners
- Ability to deliver consistent high quality results while working in a fast paced environment
- Passionate, curious, and seeking to tackle every day problems with innovation

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    5 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineer Consultant

    4 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineer Consultant

    4 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Platforms Engineer

    3 days ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $170,000 - $220,000

    Job OverviewAs a seasoned engineering leader, you will spearhead the development and management of data platforms to drive business success. Your team's work will focus on delivering streamlined, efficient, and secure systems.Main Responsibilities:Lead a team creating, managing, and optimizing data platforms for business growth.Drive thought leadership,...

  • Data Engineer, Data Platform

    7 days ago

    Sydney, New South Wales, Australia TikTok Full time US$104,000 - US$130,878 per year

    TechnologyData Engineer, Data Platform - USDSLocation:SydneyEmployment Type:RegularJob Code:A31128AResponsibilitiesAs a data engineer in the data platform team area, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world that directly supports the TikTok app. You'll have the opportunity to gain hands-on...

  • Data Platform Engineer

    1 week ago

    Sydney, New South Wales, Australia Buscojobs Full time

    Data Platform Engineer Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team.This pivotal role demands a seasoned professional with robust...