Databricks Data Engineer

2 weeks ago

Sydney, New South Wales, Australia Mane Consulting Full time $90,000 - $120,000 per year
  • 6-12 month Contract
  • $750 - $850 per day

Unlock your potential with a prestigious opportunity alongside an award-winning, data-driven industry leader A tremendous opportunity awaits a Data Engineer to collaborate a highly respected team. In this role, you will spearhead day-to-day data and analytics support for the diverse cross-functional with Product owners, Data Architect's, and stakeholders. Seize this chance to harness your expertise and drive impactful decisions within a thriving, forward-looking organization at the forefront of innovation. A great 6 month contract opportunity with extensions for a MID LEVEL Data Engineer.

What you'll be doing:

  • Working with business and technical stakeholders to understand requirements relating to data and analytics initiatives with a focus on delivering business outcomes
  • Designing, developing, testing, documenting, and maintaining data models, reports, and dashboards that meet business needs and requirements
  • Designing, developing, testing, documenting, and maintaining data pipelines across a range of technologies that extract, load, combine and transform data from a range of internal and external sources
  • Translate business requirements into logical and physical data models, ensuring alignment with reporting and BI needs.
  • Understand and implement data governance requirements that support data and analytics solutions including security, data quality, data classification, trustworthiness, and re-usability
  • Design and implement star and snowflake schemas to support scalable, performant analytics across business domains.
  • Collaborating with technical and non-technical stakeholders through a range of forums including but not limited to team members within cross functional delivery teams, data and analytics practice group, and the data and analytics platform team

Ideally you will have;

  • Extensive expertise in data engineering and data analysis
  • Proficient in T-SQL, SQL Server, Databricks, PySpark, Power BI, and other related data tools and platforms
  • Experience with Lambda and Kappa architecture stacks
  • Hands-on experience building Data Streaming solutions using technologies like Apache Kafka, Azure Event Hub, Confluent, and Apache Flink
  • Skilled in constructing and optimizing data pipelines, data models, reports, and dashboards
  • Previous hands-on work with a broad range of Azure services related to Data and Analytics, including Azure Data Factory, Azure Databricks, Delta Lake, and Azure Synapse Analytics
  • Experience in star/snowflake schema design
  • Understanding of slowly changing dimensions (SCD Types 1, 2, etc.)
  • Ability to translate business logic into fact/dimension tables
  • Proficient in handling large and complex datasets
  • Ability to mentor engineers, guide technical decisions, and contribute to the overall strategy.

Mane Consulting specialise in Data & Analytics. For more information on this role or others like this in the market apply below or contact Mark.cornwel-smith

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Databricks Architect

    2 days ago

    Sydney, New South Wales, Australia UCentric Full time $120,000 - $200,000 per year

    Databricks ArchitectLocation: Flexible / Hybrid (Sydney preferred)Client: Global Technology ConsultancyOur clientOur client is a rapidly growing global technology consultancy specialising in cloud, data, and digital transformation. They partner with leading enterprises to deliver high-impact, scalable data solutions that drive business outcomes. With a...

  • Sr. Resident Solutions Architect, ML

    7 days ago

    Sydney, New South Wales, Australia Databricks Full time $120,000 - $200,000 per year

    CSQ426R250While candidates in Sydney are encouraged for this role, candidates in Melbourne, Brisbane and Perth will be considered.As a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term customer engagements on their ML & AI challenges using the Databricks Data...

  • Data engineer

    2 days ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time $104,000 - $130,878 per year

    Job SummaryWe are seeking an experienced Architect with 8 to 12 years of experience to join our team. The ideal candidate will have expertise in Databricks Workspace Admin Python Databricks SQL Databricks Workflows and PySpark. This role involves designing and implementing data solutions in a hybrid work model ensuring seamless integration and performance...

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Data Engineering Manager

    1 week ago

    Sydney, New South Wales, Australia Talent Insights Group Full time $180,000 - $200,000 per year

    Data Engineering Lead – Databricks & dbtSydney / Hybrid$180-200k base plus superTalent Insights is partnered with a company who are seeking aData Engineering Leadto take ownership of its modern data stack and lead a talented team of engineers in building scalable, high-performing data solutions. The ideal candidate thrives in architecting data platforms,...

  • Data Engineer

    3 days ago

    Sydney, New South Wales, Australia Silverlink Infotech Pty Ltd Full time $80,000 - $120,000 per year

    GreetingsWe have an urgent opening for "Multiple Data Engineer role " in Sydney , Australia. Please let me know your interest. Also you can refer us if anyone is interested contact to  Seek at / or : Role 1 –"Data Engineer"Location – Sydney, AustraliaDuration : ContractMust Have Skills:Hands On with advanced SQL, Python...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia CareCone Group Full time $100,000 - $150,000 per year

    Role: Data Engineer (Azure Databricks)Location: SydneyPermanent (Fulltime)Responsibilities:Design, develop, and maintain scalable data pipelines using Apache PySpark and SQL.Collaborate with cross functional teams to support data migration projects and ensure data quality.Utilize Azure Databricks and Teradata/Cloudera for data processing and...

  • Data Engineer

    3 days ago

    Sydney, New South Wales, Australia CareCone Group Full time $80,000 - $120,000 per year

    Role : Data Engineer - DatabricksPermanent PositionLocation : Sydney AustraliaJob Description :Design, develop, and maintain scalable and robust data pipelines on Databricks.Proficiency with DatabricksStrong SQL skills and experience with relational databases.Knowledge of data warehousing concepts and ETL processes.Collaborate with data scientists and...