Senior Data Engineer

5 days ago

Brisbane, Queensland, Australia Lime Recruitment Full time

Job Title: Senior Data Engineer

Job Type: Contract

Duration: 6 months with possible extension

Location: Brisbane CBD and remote work

About the Role:

We are seeking a highly skilled Senior Data Engineer to join our team at Lime Recruitment. As a Senior Data Engineer, you will play a key role in designing, building, and deploying our next-generation data lake.

Key Responsibilities:

  • Data Lake Design and Deployment: Help design and build the next generation of our data lake, utilizing the latest available technologies to flexibly manage and scale data.
  • Pipeline Pattern Development: Prove concept and value for pipeline patterns on data types and sources that are new to our ingestion.
  • Data Pipeline Troubleshooting: Troubleshoot data pipeline operational failures and ensure the smooth operation of our data pipelines.
  • Platform Monitoring and Self-Healing: Help design and implement platform monitoring, robustness, and self-healing as an integral part of the platform design.

Requirements:

  • Database Experience: Experience with databases, including cloud databases, relational databases, and NoSQL databases (e.g. Databricks, Redshift, Postgres, SQL Server, MongoDB).
  • Data Pipeline Experience: Experience building and creating data pipelines (preferably Databricks Delta Live Tables or similar) using both Python and SQL.
  • Data Streaming Experience: Experience with data streaming products such as Kafka, Kinesis, etc.
  • Cloud Platform Experience: Experience with cloud platform deployment (AWS preferred).
  • Git Experience: Experience with Git (or appropriate source control).
  • Communication Skills: The ability to effectively communicate with the customer, including Product, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
  • Data DevOps Experience: Experience with data DevOps/data-as-code design and implementation.

What We Offer:

As a Queensland-owned agency, we offer personalized service and are a Tier 1 supplier to Queensland Government. We are committed to securing the best opportunities for our candidates and providing a supportive and inclusive work environment.

  • Senior Software Engineer

    6 days ago

    Brisbane, Queensland, Australia PARK Senior Villas Chandler Full time

    About the CompanyPARK Senior Villas Chandler is a leading provider of innovative IoT solutions for the agriculture sector. Our company is dedicated to transforming the way farmers and agricultural businesses operate, and we're seeking a talented Senior Software Engineer to join our team.About the RoleThis is an exciting opportunity to work with a dynamic,...

  • Senior Data Solutions Engineer

    6 days ago

    Brisbane, Queensland, Australia Aspirante Full time

    Position OverviewAspirante is in search of a skilled Senior Data Solutions Engineer to undertake a contract role focused on advanced data transformation projects. You will be an integral part of the Data Platform Team, working in close collaboration with key stakeholders, including the Chief Data Strategist and various subject matter experts, to spearhead...

  • Senior Data Solutions Engineer

    6 days ago

    Brisbane, Queensland, Australia Aspirante Full time

    Position OverviewAspirante is in search of a skilled Senior Data Solutions Engineer to undertake a pivotal role in driving advanced data transformation projects. As a member of the Data Platform Team, you will engage closely with essential stakeholders, including the Chief Data Strategist and various subject matter experts, to spearhead significant data...

  • Senior Civil Design Engineer

    24 hours ago

    Brisbane, Queensland, Australia Sage Lake Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Civil Design Engineer to join our team at Sage Lake Senior Living. As a key member of our design team, you will be responsible for collaborating with Design Project Managers to effectively design and deliver components within your discipline for assigned projects.Key ResponsibilitiesDevelop and implement...

  • Senior Data Architect

    6 days ago

    Brisbane, Queensland, Australia Commonwealth Bank Full time

    About the RoleWe are seeking an experienced Senior Data Architect to join our Data Engineering team at Commonwealth Bank. As a key member of our team, you will be responsible for designing and developing industry-leading data products that drive business outcomes.Key ResponsibilitiesDesign and develop data models and architectures that meet business...

  • Senior Data Engineer

    2 days ago

    Brisbane, Queensland, Australia Flight Centre Travel Group Full time

    About Your OpportunityWe are a leading online travel agency and a member of the Flight Centre Travel Group, a company that manages multiple eCommerce brands. Our mission is to provide innovative solutions that elevate the travel experience. We are seeking a Senior Data Engineer to join our data team and contribute to our evolving data initiatives.Key...

  • Senior Civil Design Engineer

    4 days ago

    Brisbane, Queensland, Australia Sage Lake Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Civil Design Engineer to join our team at Sage Lake Senior Living. As a key member of our design team, you will be responsible for collaborating with our Design Project Managers to effectively design and deliver components within your discipline for assigned projects.Key ResponsibilitiesDevelop and...

  • Senior Civil Design Engineer

    6 days ago

    Brisbane, Queensland, Australia Sage Lake Senior Living Full time

    About Sage Lake Senior LivingSage Lake Senior Living is a leading provider of innovative, integrated senior living solutions. We partner with our clients to deliver exceptional care and services to seniors, ensuring their needs are met with compassion and expertise.The RoleWe are seeking a highly skilled Civil Design Engineer to join our team as a Project...

  • Senior Software Engineer

    22 hours ago

    Brisbane, Queensland, Australia PARK Senior Villas Chandler Full time

    About the CompanyPARK Senior Villas Chandler is a fast-growing IoT company transforming the agriculture sector globally.About the RoleThis is an exciting opportunity to join a dynamic, multi-disciplinary team working on an advanced cloud IoT platform and supporting its operations.You will play a key role in various projects and initiatives, where your...

  • Senior Software Development Lead

    6 days ago

    Brisbane, Queensland, Australia PARK Senior Villas Chandler Full time

    About the CompanyPARK Senior Villas Chandler is a rapidly expanding Internet of Things (IoT) company that is revolutionizing the agriculture sector globally. Due to its current growth, the company is seeking a Senior Software Engineer to support the Chief Technology Officer (CTO) and other developers in building out its products and platforms, utilizing C#...

  • Senior Data Architect

    6 days ago

    Brisbane, Queensland, Australia HKT Full time

    About HKTHKT is a leading telecommunications service provider in Hong Kong, committed to delivering innovative and reliable solutions to its customers.Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at HKT. As a key player in designing, building, and optimizing our data infrastructure, you will play a crucial role in...

  • Senior Data Architect

    3 days ago

    Brisbane, Queensland, Australia HKT Full time

    About HKTHKT is a leading telecommunications service provider in Hong Kong, committed to delivering innovative and reliable solutions to our customers.Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at HKT. As a key player in designing, building, and optimizing our data infrastructure, you will play a crucial role in...

  • Senior Software Engineer

    5 days ago

    Brisbane, Queensland, Australia Spice AI Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Spice AI. As a key member of our engineering team, you will play a critical role in designing and implementing big data, distributed, blockchain, and machine learning systems using modern tech stacks in Golang and Python.Key ResponsibilitiesDesign and implement...

  • Senior Systems Engineer

    6 days ago

    Brisbane, Queensland, Australia Mipac Full time

    About the RoleWe are seeking a highly skilled Senior Systems Engineer to join our team at Mipac. As a Senior AVEVA PI Specialist, you will play a key role in working with our clients to improve and optimize their operations by making data-driven decisions.Key ResponsibilitiesLead integration projects in Australia and overseas to enhance clients' performance...

  • Senior Civil Design Engineer

    3 days ago

    Brisbane, Queensland, Australia Sage Lake Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Civil Design Engineer to join our team at Sage Lake Senior Living. As a key member of our design team, you will be responsible for collaborating with our Design Project Managers to effectively design and deliver components within your discipline for assigned projects.Key ResponsibilitiesDevelop and...

  • Senior Data Architect

    2 days ago

    Brisbane, Queensland, Australia Lime Recruitment Full time

    Lime Recruitment is currently seeking a highly skilled Senior Data Engineer to join our team on a 6-month contract with possible extension. This role is based in the Brisbane CBD and offers the flexibility to work from home.**Key Responsibilities:**Design, build, and deploy the next generation of our data lake, leveraging the latest technologies to manage...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia DFP Recruitment Full time

    Job DescriptionDFP Recruitment is seeking a highly skilled EL1 Data Engineer to join a large Brisbane-based Federal Government Agency in their Data and Analytics Branch.Key Responsibilities:Update data development documentation and develop data platformsProvide technical guidance to developers and review/approve data designs and data modelsLead the project...

  • Senior Data Solutions Engineer

    6 days ago

    Brisbane, Queensland, Australia Aspirante Full time

    Position OverviewAspirante is in search of a seasoned Enterprise Data Engineer to undertake a pivotal role in advancing specialized data transformation projects. As a vital member of the Data Platform Team, you will engage closely with key stakeholders, including the Chief Data Strategist and subject matter experts, to spearhead essential data...

  • Senior Data Platform Engineer

    3 days ago

    Brisbane, Queensland, Australia Paxus - Technology + Digital Talent Full time

    About the RolePaxus - Technology + Digital Talent is seeking a highly skilled Data Engineer to join our team and lead the development of a cutting-edge Data Platform for a large Queensland government department.Key ResponsibilitiesDesign, develop, and implement a fully operationalized, enterprise-grade Data Platform using Informatica, Azure, and...

  • Senior Software Engineer

    22 hours ago

    Brisbane, Queensland, Australia Spice AI Full time

    About the RoleWe're seeking a highly skilled Senior Software Engineer to join our team at Spice AI. As a key member of our engineering team, you will play a critical role in designing and implementing big data, distributed, blockchain, and machine learning systems using modern tech stacks in Golang and Python.Key ResponsibilitiesDesign and implement...