Data Engineering Expert
2 weeks ago
Job Title:
Data Engineering Expert
Job Description
We are seeking a highly skilled Data Engineering Expert to join our team. The ideal candidate will have extensive experience in designing scalable data pipelines and building modern, high-performance data platforms.
Main Responsibilities:
- Designing and implementing efficient data pipelines using Python and PySpark for batch and streaming workloads
- Managing Delta Lake layers (Bronze, Silver, Gold) in Databricks
- Setting up and maintaining Databricks workflows, jobs, notebooks, and DLT pipelines
- Optimizing performance using Databricks tools and following best practices for clean, modular code
- Collaborating with data scientists and engineers to ensure seamless data flow across teams
Required Skills and Qualifications
The successful candidate will possess the following skills and qualifications:
- Strong coding skills in Python and PySpark
- Experience with Databricks and Delta Lake
- Familiarity with AWS services, especially S3, Glue, Lambda, and Redshift
- Proficiency in Terraform or CloudFormation
- Ability to automate tasks using Boto3
- Prior experience building efficient, secure, and scalable pipelines
Benefits
This role offers a competitive salary, comprehensive benefits package, and opportunities for professional growth and development.
-
Data Engineer Consultant
3 weeks ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full timeJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...
-
Data Engineer
2 weeks ago
Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...
-
Data Engineer
1 week ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineer
2 weeks ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineer
2 weeks ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineering Expert
1 week ago
Sydney, New South Wales, Australia beBeeDataEngineering Full time $180,000 - $240,000Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team.This is a senior-level position that requires expertise in designing, building, and delivering large-scale data ingestion, integration, and pipeline solutions.The ideal candidate will have experience working with big data platforms, including Hadoop,...
-
Data Engineering Expert
2 weeks ago
Sydney, New South Wales, Australia beBeeEngineering Full time $120,000 - $180,000Senior Data EngineerWe're seeking an experienced Data Engineering Expert to drive the development and implementation of large-scale data architectures and systems using AWS cloud-based services. As a key member of our engineering team, you'll have the opportunity to work on strategic data initiatives that drive business value.Design, develop, and maintain...
-
Data Engineering Expert
2 weeks ago
Sydney, New South Wales, Australia beBeeDataEngineering Full time $90,000 - $115,000Job OpportunityWe are seeking a highly skilled Data Engineering Expert to join our team.The selected candidate will work closely with the data infrastructure team to design, develop, and maintain scalable data pipelines and architectures.Key responsibilities include transforming business requirements into working solutions, fostering collaboration among team...
-
Data Engineering Expert
1 week ago
Sydney, New South Wales, Australia beBeeDataEngineering Full time $100,000 - $110,000Job Title: Data Engineering ExpertWe are seeking a skilled Data Engineer to design, build, and optimize data integration solutions in a Teradata environment.Key Responsibilities:Develop ETL/ELT jobs for data warehousing and dimensional modeling.Enhance data models and marts within a large-scale enterprise data warehouse.Support data provisioning for...
-
Data Engineering Expert
1 week ago
Sydney, New South Wales, Australia beBeeEngineering Full time $170,000 - $210,000About the RoleWe are seeking a Data Engineering Expert to provide technical leadership and delivery accountability for our Data Infrastructure and data warehousing capability. As a key member of our team, you will be responsible for delivering cost-effective, quality, innovative technology solutions and services that support best practice data...
