Senior Data Platform Specialist

2 weeks ago


Sydney, New South Wales, Australia beBeeDataPlatform Full time $170,000 - $200,000

Find a high-performance data platform specialist who can design scalable pipelines and build modern platforms using Python, PySpark, Databricks, Delta Lake, Terraform, Boto3, AWS S3, Glue, Lambda, Redshift.

Key Responsibilities
  • Build/improve data pipelines for batch and streaming workloads
  • Design/manage Delta Lake layers (Bronze, Silver, Gold) - Databricks
  • Set up/maintain Databricks workflows, jobs, notebooks, DLT pipelines
  • Optimize performance using Databricks tools, best practices
  • Work with AWS S3 to manage raw/processed data securely
  • Use Terraform, Databricks Asset Bundles
  • Automate AWS workflows using Boto3 (S3, Glue, Lambda)
  • Collaborate with data scientists/engineers to keep data flowing across teams
  • Apply quality checks for data validation, monitoring
Requirements
  • Strong coding skills in Python, PySpark
  • Experience with Databricks, Delta Lake
  • Experience in AWS services, especially S3, Glue, Lambda, Redshift
  • Experience using Terraform or CloudFormation
  • Comfortable automating AWS tasks with Boto3
  • Prior experience building efficient, secure, scalable pipelines
  • Ability to work in cross-functional, remote teams
  • Databricks certification desired
  • Experience working in consultancies/fast-paced delivery environments


  • Sydney, New South Wales, Australia GHD Full time

    Join to apply for the Data Management Platform Specialist role at GHD2 days ago Be among the first 25 applicantsJoin to apply for the Data Management Platform Specialist role at GHDGet AI-powered advice on this job and more exclusive features.Job DescriptionAt GHD, we don't just believe in the power of commitment, we live and breathe it every day.That's why...


  • Sydney, New South Wales, Australia beBeeData Full time $139,146 - $164,602

    Job OverviewWe are seeking a strategic leader to oversee the delivery of a modern, scalable enterprise-wide data platform. The ideal candidate will combine technical expertise with business acumen to drive improvements in our data analytics platform architecture and tooling.Main ResponsibilitiesLead the implementation of a data governance framework, ensuring...


  • Sydney, New South Wales, Australia NOVON Full time

    OverviewAWS Data Platform Specialist role at NOVONAre you an AWS Data Platform Engineer focused on data-driven or migration projects that help organisations build, develop and deploy data-driven decisions?Key ResponsibilitiesMigration Planning and Execution: Develop and implement a detailed migration plan from Cloudera to AWS native data services, with a...


  • Sydney, New South Wales, Australia NOVON Full time

    OverviewAWS Data Platform Specialist role at NOVONAre you an AWS Data Platform Engineer focused on data-driven or migration projects that help organisations build, develop and deploy data-driven decisions?Key ResponsibilitiesMigration Planning and Execution: Develop and implement a detailed migration plan from Cloudera to AWS native data services, with a...


  • Sydney, New South Wales, Australia beBeeDataPlatform Full time $292,500 - $427,500

    Job DescriptionWe are seeking a skilled Data Platform Specialist to join our team. This individual will play a crucial role in enabling projects to scale by collaborating with stakeholders to elicit, document and validate business and technical requirements for data platform initiatives.The successful candidate will work closely with data engineers and...


  • Sydney, New South Wales, Australia Bebeepower Full time

    Job Title:Senior Power Platform Specialist">The role of a senior specialist in the Microsoft Power Platform is to provide strategic guidance and technical expertise to clients, enabling them to create tailored solutions for their business needs.">Design and develop bespoke solutions using PowerApps, Power BI, and other tools within the Power...


  • Sydney, New South Wales, Australia Novon Full time

    OverviewAWS Data Platform Specialistrole atNOVONAre you an AWS Data Platform Engineer focused on data-driven or migration projects that help organisations build, develop and deploy data-driven decisions?Key ResponsibilitiesMigration Planning and Execution: Develop and implement a detailed migration plan from Cloudera to AWS native data services, with a...


  • Sydney, New South Wales, Australia beBeePlatform Full time $100,000 - $140,000

    Job Title: Data Platform Support SpecialistAbout the Role:We are seeking a skilled Data Platform Support Specialist to join our team. This role will involve providing top-notch customer service and technical support for our data platform solutions.Key Responsibilities:Provide expert-level support via phone, email, and chat to customers using our data...


  • Sydney, New South Wales, Australia beBeeCloud Full time $180,000 - $220,000

    Cloud Transformation Specialist About the Role:We are seeking a seasoned Cloud Integration Expert to lead key data transformation initiatives.Key Responsibilities:Design and deliver large-scale data transformation projects.Oversee configuration, deployment, and performance of cloud-based data solutions.Ensure infrastructure is secure, scalable, and highly...


  • Sydney, New South Wales, Australia beBeePower Full time $100,000 - $120,000

    Job Title:Senior Power Platform Specialist">The role of a senior specialist in the Microsoft Power Platform is to provide strategic guidance and technical expertise to clients, enabling them to create tailored solutions for their business needs.">Design and develop bespoke solutions using PowerApps, Power BI, and other tools within the Power...