Lead Data Engineer

3 weeks ago

Sydney, New South Wales, Australia Pyramid Global Technologies Full time

Lead Data Engineer Role at Pyramid Global Technologies

We are seeking a Lead Data Engineer to join our team in Sydney, requiring 10+ years of experience in Software Engineering, Cloud Computing, Databricks, and Big Data.

Main Responsibilities:

  • Data Engineering and Data Warehousing: Design, implement, and maintain scalable data architectures using cloud-based technologies.
  • Solution Design and Data Analysis: Collaborate with cross-functional teams to design and develop data-driven solutions, leveraging statistical models and machine learning algorithms.
  • Data Visualization and Data Modeling: Develop interactive dashboards and reports using visualization tools like Power BI, and create robust data models to support business decision-making.

Key Skills:

  • Programming Languages: Proficiency in Python, Scala, and SQL.
  • Cloud Technologies: Experience with Azure and Databricks.
  • Big Data Technologies: Familiarity with Cloudera (HDFS, Spark, Hive, Kafka) and Apache Airflow.
  • DevOps Tools: Knowledge of Azure DevOps (Git, Repos, Pipelines), Git, Terraform, and Docker.
  • Reporting Tools: Experience with SQL Server Reporting Services and Power BI.
  • Certifications: Certified DevOps Engineer Expert, Azure Cloud, and Azure Data Lake.

  • Data Platform Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Rich Data Co Full time

    About RDCRich Data Co (RDC) delivers the future of credit today. We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to make accurate decisions in a clear and explainable way. Global leading financial institutions use our AI...

  • Data & ML Engineering Manager

    3 weeks ago

    Sydney, New South Wales, Australia Data & Ai Talent Australia Full time

    4 days ago Be among the first 25 applicantsWe've been exclusively engaged by a trailblazing Australian tech company that's rapidly scaling across the APAC region. Backed by strong funding and a proven product-market fit, they're doubling down on data, machine learning, and AI to supercharge their next phase of growth—and they're looking for the right...

  • Data & ML Engineering Manager

    3 weeks ago

    Sydney, New South Wales, Australia Data & Ai Talent Australia Full time

    4 days ago Be among the first 25 applicantsWe've been exclusively engaged by a trailblazing Australian tech company that's rapidly scaling across the APAC region. Backed by strong funding and a proven product-market fit, they're doubling down on data, machine learning, and AI to supercharge their next phase of growth—and they're looking for the right...

  • Data Engineering Lead

    6 hours ago

    Sydney, New South Wales, Australia beBee Careers Full time

    Data Engineering LeadWe are looking for a highly skilled Data Engineering Lead to oversee the design and delivery of large-scale data engineering initiatives.The ideal candidate will have proven experience in leading data engineering teams and will be well-versed in modern data tools and technologies, including dbt, Airflow, and Spark.This role offers a...

  • Data Engineering Lead

    3 weeks ago

    Sydney, New South Wales, Australia Talent Insights Group Full time

    Senior Data Consultant at Talent InsightsLocation: Sydney (Hybrid Work)Position Type: Full-Time, PermanentAn exciting opportunity has arisen for a hands-on, proactive Data Engineering Lead to join a leading Insurance company based in Sydney.In this role, you will be responsible for leading a team of 2-4 data engineers, working as part of a global team on...

  • Data Engineering Lead

    3 weeks ago

    Sydney, New South Wales, Australia Correlate Resources Full time

    Our client is a market leading business with a high profile and reputable brand within the Australian market. With a well-established analytics division focused on optimising both customer and operational initiatives they boast an energising, supportive and collaborative culture, and are looking for great people who want to be a part of their journey. With...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia tekFinder Full time

    Direct message the job poster from tekFinderWe work with innovative technology companies in Australia, helping them build great software engineering teams.Lead Data Engineer - ETL, Spark SQL, AWS - up to $215k package + bonusWe are recruiting a Lead Data Engineer to spearhead the transformation of a regulatory platform.The role is within the regulated...

  • Lead Data Engineer

    2 days ago

    Sydney, New South Wales, Australia beBee Careers Full time

    Job Description">This is a key role within our Data and Analytics division, responsible for leading the development of our data platform.The successful candidate will be a highly skilled data engineer with experience in designing and developing data engineering assets, expanding data platform capabilities, implementing process improvements, and peer...

  • Lead Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Lead Data EngineerSydney, AustraliaAbout the Role:At ClearCompany, you will lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency for a leading financial services institution.Key Responsibilities:Lead the development and transformation of the regulatory reporting platform.Collaborate...

  • Lead Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Lead Data EngineerSydney, Australia$230,000 (including Super) + BonusAbout the Role:Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities:Lead the development and transformation of the...