Data Engineer

7 days ago

Sydney, New South Wales, Australia ClearCompany Full time

Data Engineer

Sydney

$175,000 Inc Super + Bonus

As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment.

Key Responsibilities:

  • Utilize your expertise in data warehousing and information management to contribute to the development of our future-ready Data Platform.
  • Design and implement data models to support business requirements.
  • Leverage your Linux/Unix skills and prior experience with AWS to build robust and scalable data solutions.
  • Develop and optimize complex SQL queries and data manipulation processes.
  • Utilize Big Data querying tools such as Hive, Spark, and Presto to extract insights from large datasets.
  • Implement API-based integrations and orchestrate data pipelines using tools like Apache Oozie, Airflow, or Argo Workflows.
  • Apply your knowledge of technical solutions, design patterns, and code to develop medium/complex applications deployed in clustered computing environments.

Desired Skills and Experience:

  • Proficiency in programming languages such as Scala, Java, or Python, particularly in the context of Big Data technologies like Spark.
  • Redshift.
  • Experience working with Docker, Kubernetes, and familiarity with containerized environments.
  • Exposure to security concepts and best practices related to data engineering.
  • Knowledge of machine learning concepts and tools such as Spark ML or R.
  • Experience with major Hadoop distributions such as Cloudera, MapR, or Hortonworks HDP.
  • Familiarity with build tools like Maven, Gradle, and Ant.

If you feel you possess the relevant skills to the above, apply now with most updated CV


#J-18808-Ljbffr

  • Senior Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia NTT DATA Full time

    Job Description NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network...

  • AWS Data Analyst

    1 week ago

    Sydney, New South Wales, Australia The Data Foundry Full time

    Job DescriptionYour impact As an AWS Data Analyst, you will play a key role in working with customers to understand their business requirements, map these to their data capabilities, liaise with our internal Data Engineers to design and build elegant solutions, then partner with our customers to deploy those solutions in a way that allows them to turn data...

  • Azure Devops Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Engineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights Join Microsoft's largest Australian Partner HRD Employer of Choice and Great Place to Work Brisbane, Sydney or Melbourne Based - Hybrid Working As an Azure Dev Ops Engineer you will work across multiple organisations, managing the latest...

  • Ms Engineer

    7 days ago

    Sydney, New South Wales, Australia Ntt Data Full time

    NTT DATA NTT DATA helps clients transform through consulting, industry solutions, business process services, IT modernization and managed services. View company page Want to be a part of our team?The Security Managed Services Engineer (L4) is responsible for ensuring a managed service is provided to all clients, to ensure that their Security infrastructure...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia HiTech Group Full time

    Leading Federal Government Department Initial 12 month contract + 12 month extension Rewarding daily rates $$$ A dynamic Federal Government Department is looking to engage an experienced Data Engineer to be apart of the department's internal key data centric projects. You will be responsible demonstrating strong data engineering and analytics skills with...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia HiTech Group Full time

    Exciting opportunity within a Federal Government Department Initial 12 month contract with EXTENSION options Rewarding hourly rates $$$ One of Australia's principal Federal Government departments is looking to engage a skilled Data Engineer & Data Modeller to assist in collaborating with key business areas in the development and implementation of consumable...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Experis ManpowerGroup Sp. z o.o. Full time

    Our government client are looking for several data engineers to join their team on a contract basis.Please note only Australian Citizens will be considered as security clearance is required.Role Responsibilities and DutiesDesign, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.Develop scalable architecture practices...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Atlassian Full time

    We are looking for a Data Engineer to join our UIP - Frontend Observability team.The Frontend Observability team is part of the UI Platform organisation.Our team's mission is to help teams build fast experiences and make sure they stay fast. We build tools for measuring, monitoring and catching regressions in frontend performance.UI Platform delivers...

  • Data Engineering

    7 days ago

    Sydney, New South Wales, Australia Randstad Full time

    About the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...

  • data engineer

    7 days ago

    Sydney, New South Wales, Australia Opus Recruitment Solutions Full time

    ApplyData Engineer Sydney, Australia Permanent$ $130000 per annum Are you a skilled Data Engineer looking for your next challenge? I am currently seeking a Senior Data Engineer with expertise in Azure, Azure Data Factory, Databricks, Synapse, Power BI, and strong experience in SQL to join my clients dynamic team.Responsibilities:Designing, building, and...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Practiv Limited Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Practiv Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Opus Recruitment Solutions Ltd Full time

    Apply Data EngineerSydney, AustraliaPermanent$ $130000 per annumAre you a skilled Data Engineer looking for your next challenge? I am currently seeking a Senior Data Engineer with expertise in Azure, Azure Data Factory, Databricks, Synapse, Power BI, and strong experience in SQL to join my clients dynamic team.Responsibilities:Designing, building, and...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Talenza Full time

    Data Engineer Sydney $170,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment. Key...

  • Data Engineers

    1 week ago

    Sydney, New South Wales, Australia CYOS Solutions Full time

    Application closing date: Friday, 14 June 2024 11:59pm, Canberra time Estimated start date: Monday, 01 July 2024 Location of work: NSWWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability.Interstate candidates will also be considered.However, there...

  • Data Engineers

    1 week ago

    Sydney, New South Wales, Australia CYOS Solutions Full time

    Application closing date: Friday, 14 June 2024 11:59pm, Canberra timeEstimated start date: Monday, 01 July 2024Location of work:NSWWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability.Interstate candidates will also be considered.However, there will...

  • Data Engineers

    3 weeks ago

    Sydney, New South Wales, Australia CYOS Solutions Full time

    Application closing date: Friday, 14 June 2024 • 11:59pm, Canberra timeEstimated start date: Monday, 01 July 2024Location of work: NSWWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However, there...

  • Data Engineers

    7 days ago

    Sydney, New South Wales, Australia CYOS Solutions Full time

    Application closing date: Friday, 14 June 2024 • 11:59pm, Canberra timeEstimated start date: Monday, 01 July 2024Location of work: NSWWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However, there...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Kindred Group plc Full time

    The roleWe are looking for a motivated Data Engineer to join our team and support the Data Engineering pipeline design and implementation experience within a commercial environment.As a listed and regulated company, Kindred Group pays great attention to player safety and sustainability. Our purpose is to transform gambling by being a trusted source of...

  • Data engineer

    7 days ago

    Sydney, New South Wales, Australia CareCone Australia Full time

    Role: Data Engineer / Senior Data Engineer (Databricks) Location: Sydney Permanent (Full-time) Note:We are hiring for 3 Data Engineering role where Python, AWS/ Azure, Databricks & dbt is mandatory. Job DescriptionDemonstrated Experience (4 to 5yrs) in IT domain with experience in Python, AWS/ Azure, Databricks. Familiarity working with large systems...