Data Engineer for Big Data Platforms

7 days ago

Sydney, New South Wales, Australia Whizdom Recruitment Full time

Job Overview:

We are seeking an experienced Data Engineer to join our team at Whizdom Recruitment. As a key member of our big data platform, you will be responsible for building and supporting a robust and scalable data infrastructure.

About the Role:

The ideal candidate will have a strong background in data engineering, with experience in designing and implementing large-scale data systems. You will work closely with cross-functional teams to identify business requirements and design data solutions that meet those needs.

Key Responsibilities:

  • Design and implement data pipelines and architectures for big data platforms
  • Collaborate with stakeholders to understand business requirements and design data solutions
  • Develop and maintain high-quality, scalable, and secure data infrastructure
  • Mentor junior engineers and contribute to knowledge-sharing initiatives
  • Stay up-to-date with industry trends and emerging technologies

Requirements:

To be successful in this role, you will need:

  • Minimum 10+ years of experience as a data engineer or equivalent in IT consulting or other technology business units
  • Significant experience in designing and implementing big data platforms and data warehouses
  • Strong understanding of data modeling concepts, such as referential integrity and entity-relationship diagrams
  • Proficiency in programming languages such as Python, Java, or Scala
  • Experience with cloud-based platforms such as AWS, Azure, or GCP
  • Excellent communication and collaboration skills

Bonus Requirements:

A solid understanding of containerization, virtualization, infrastructure, and networking would be beneficial. Experience delivering projects based on Cloud Platform such as Azure, AWS, GCP and IBM and other modern data platforms is also a plus.

Benefits:

As a valued member of our team, you can expect:

  • A competitive salary: $120,000 - $180,000 per annum (dependent on experience)
  • A comprehensive benefits package, including medical, dental, and vision coverage
  • Opportunities for professional growth and development
  • A collaborative and dynamic work environment
  • A flexible and adaptable attitude

Note:

While not mandatory, project management skills, such as Project Planning, Budgeting, Performance Management, Scheduling, Staffing, PM Methods, Performance Management, Scope Management, Contractual Deliverables, Change Control and Risk Management, will be looked upon favorably.

  • Data-Driven Engineer for Big Data Platforms

    3 weeks ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About the RoleWe are seeking an experienced MLOPS Support Engineer to join our team of talented engineers.As a key member of our team, you will be responsible for providing data-driven platform solutions and supporting the development of our big data platforms.Your expertise in ETL tools, production support, and containerization will enable you to execute...

  • Senior Data Engineer: Big Data Platform Expert

    5 days ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    We are seeking an experienced Senior Data Engineer to join our team in the Chief Data Office. This is a critical role that will drive the development and implementation of cutting-edge data operations solutions using ETL tools and big data platforms.As a Senior Data Engineer, you will work closely with internal teams and stakeholders to design, build, and...

  • Data Property Solutions Engineer

    5 days ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Solutions Data Engineer to join our team at Data-Property Data Solns Shared. As a Senior member of our organization, you will play a critical role in shaping the future of property data solutions.About UsWe shine a light on all things property, aiming to simplify the property journey for all involved. Our business is motivated...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on the property market, simplifying the journey for all involved. Our expertise and exclusive data drive change. At Domain Group, our data department leads the way in driving value across the organisation.The RoleAs a Senior Data Engineer, you'll play a key role in building data pipelines that power Australia's property market....

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Experis Full time

    Senior Data Engineer - Big DataExperis is representing a prestigious financial services organisation in recruiting a Senior Data Engineer - Big Data to lead the design, development, and delivery of future-ready data solutions. As a technical expert, you will work closely with cross-functional teams to provide cutting-edge data solutions while mentoring...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Whizdom Recruitment Full time

    Job Title: Data Engineer - Big Data SolutionsCompany Overview: Whizdom Recruitment is a leading recruitment agency specialising in IT and data science professionals. We're currently looking for a highly skilled Data Engineer to join our team.Salary: $120,000 - $150,000 per annum, depending on experienceJob Description: As a Data Engineer, you will be...

  • Data Platform Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About this opportunityWe are seeking an experienced MLOPS Support Engineer to join our team and contribute to the development of high-quality data-driven platform solutions. In this role, you will be part of a team of engineers who are passionate about using the latest technologies to solve complex data-centric problems.Your key responsibilities- Provide...

  • Data Engineer

    5 days ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Drive Business Value with Data Engineering at Domain GroupWe are seeking a skilled Data Engineer to join our Data Decision Science team in Sydney. As a key member of our data department, you will play a critical role in building scalable data pipelines that power Australia's property market.About the RoleThis is an exciting opportunity to work with...

  • Data Analyst for Big Data Platform

    1 week ago

    Sydney, New South Wales, Australia Randstad Full time

    About the Company and OpportunityRandstad, a specialist recruitment agency, is partnering with a leading Australian bank headquartered in Sydney to find a talented Data Support Analyst for their big data platform.This exciting opportunity has arisen due to the bank's immense growth in their portfolio, and we are looking for an exceptional candidate to...

  • Data Engineer with Big Data Operations Expertise

    2 days ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    Unlock the Power of Data with UsAt the Commonwealth Bank of Australia, we're committed to delivering exceptional customer experiences through cutting-edge data-driven solutions.We're seeking an experienced Senior Data Engineer to join our team and contribute to the development of innovative ETL tools and big data platforms. As a key member of our data...

  • Data Architect and Solutions Designer for Big Data Platforms

    7 days ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About the RoleWe are seeking an experienced Data Architect and Solutions Designer to join our team in Sydney, Australia. As a key member of our data engineering team, you will be responsible for designing and developing industry-leading data products using big data platforms.

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team, responsible for designing, building, and delivering enterprise-wide data ingestion, data integration, and data pipeline solutions using common programming languages such as Scala, Java, or Python in a Big Data and Data Warehouse platform.Key ResponsibilitiesDesign and...

  • Big Data Solutions Architect

    7 days ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About Commonwealth Bank of AustraliaWe are one of Australia's most advanced big data operations teams, responsible for CommBank's key analytics capabilities and world-leading capabilities for analytics, information management and decisioning.Our team works across the Group Data Warehouse, Teradata/mainframe, Big Data Platform, Pega Decisioning, SAS, R,...

  • Lead Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    About This RoleCognizant is a leading provider of information technology, consulting, and business process services, dedicated to helping the world's leading companies build stronger businesses. As a Lead Data Engineer - Big Data Architect, you will play a key role in designing and developing scalable data infrastructure to support the needs of internal and...

  • Big Data Engineer for Large-Scale Data Solutions

    1 week ago

    Sydney, New South Wales, Australia Luxoft Full time

    Job SummaryLuxoft is seeking a highly skilled Big Data Engineer to design, develop, and maintain large-scale data solutions using PySpark. As a key member of our team, you will work closely with data scientists, data analysts, and software engineers to drive robust, data-driven insights for business decisions.About the RoleWe are looking for an experienced...

  • Senior Data Architect for Property Insights

    2 days ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Company Overview">We shine a light on all things property at Domain Group, a business that aims to simplify the property journey for all involved. Our expertise and exclusive data drive value across the organisation.About the Role">This Senior Data Architect will play a key role in building scalable ETL pipelines using AWS and Snowflake, and designing data...

  • Senior Big Data Architect

    2 weeks ago

    Sydney, New South Wales, Australia Attribute Group Full time

    Job OverviewWe are seeking an experienced Data Engineer to join our team at Attribute Group. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems using Cloudera Data Platform (CDP) and Spark-based ingestion pipelines.About the RoleThis is an excellent opportunity for a...

  • Data Engineer for Property Insights

    6 days ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our Single View Property (SVP) team at Domain. This role is perfect for someone who thrives in a dynamic environment and has a passion for working with data to drive business outcomes.

  • Big Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time

    Job DetailsWe are seeking a highly skilled AWS Hadoop Data Engineer to design, build, and optimize data pipelines and processing frameworks on the AWS cloud platform.About the RoleAs a Data Engineer, you will be responsible for architecting and implementing data processing workflows using tools such as Apache Airflow or AWS Step...

  • Senior Software Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Dicker Data Full time

    Job Description:As a senior software engineer in data analysis, you will be responsible for developing and maintaining large-scale data processing systems. Your primary focus will be on designing and implementing data pipelines using Python, ensuring data quality and integrity. You will work closely with cross-functional teams to deliver high-quality...