Data Engineer

4 weeks ago

NSW Sydney City amp Inner West, Australia LeadersIT Services Pty Ltd Full time

We are seeking a Data Engineer to design, optimise, and maintain enterprise-grade data pipelines, automation frameworks, and governance processes. The successful candidate will play a key role in enabling marketing data-driven customer engagement by building scalable data solutions, improving data quality, and ensuring compliance across multiple brands. This role requires strong technical expertise, business acumen, and the ability to collaborate with both technical and non-technical stakeholders.

Key Responsibilities:

Marketing Data Engineering & Customer Engagement

Embed within marketing and business teams to align data engineering solutions with campaign and personalisation strategies.
Establish and promote engineering practices, documentation standards, and governance frameworks to drive consistency and knowledge sharing.
Migrate manual marketing processes into automated workflows (e.g., Alteryx Server), reducing manual effort and improving reliability.
Design and implement job control and error management frameworks to ensure consistent, auditable, and recoverable data flows.
Optimise ETL and marketing data pipelines, improving execution speed and enabling faster campaign delivery and targeting.
Build and maintain Data Quality Dashboards (Power BI, SQL) to track consent, completeness, and compliance metrics, enhancing stakeholder trust.
Support predictive modelling and segmentation operationalisation to drive personalised customer journeys.

Enterprise Data Warehouse (EDW) & BAU Operations

Monitor and troubleshoot daily ETL/ELT jobs (IBM DataStage, Control-M) to ensure timely and accurate data delivery.
Provide BAU support across platforms (DTSVCWarehouse, Alteryx, Collibra), maintaining enterprise data integrity and compliance with downstream requirements.

Cloud Platforms, Infrastructure & Governance

Deploy and maintain data services (e.g., Pentaho on AWS EC2), ensuring performance, security, and scalability.
Monitor and maintain platform health (Icinga), manage incidents (Sev1/Sev2), and perform system upgrades to ensure uptime and stability.
Support cloud transformation initiatives with hands-on experience in AWS and developing expertise in GCP.
Lead Information Security Management System (ISMS) processes, preparing audit documentation, supplier reports, and ensuring ISO compliance.

Technical Skills
Programming & Scripting: SQL (SQL Server, PostgreSQL, MySQL), Python (Pandas, NumPy), Bash
Data Engineering & Orchestration: BigQuery, dbt, Databricks, Pentaho, Alteryx, Git, CI/CD (basic), Airflow (conceptual)
Analytics & Visualisation: Power BI, Tableau, Star Schema, Snowflake Schema
Platforms & Tools: Adobe Experience Platform (AEP), CDPs, Jira, Ansible, Ubuntu Linux, VMware, Control-M, Collibra
Cloud Expertise: AWS (Certified Cloud Practitioner), exposure to GCP

  • Data Engineer

    3 weeks ago

    NSW - Sydney - City & Inner West, Australia NEXUS DIVISION PTY LTD Full time

    Pay: A$100,000.00 - A$140,000.00 per year Job description: Job Title: Data Engineer (ANZSCO: 261111) Location: Sydney Melbourne and Brisbane (Hybrid Options Available) Employment Type: Full-Time or Contract Pay: AU $100 000 – $140 000 per year (or equivalent contract rate) About the Role Nexus Division is seeking an accomplished Senior Data Engineer...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Senior Data Engineer

    7 days ago

    Inner West, Australia NSW Government Full time $120,000 - $180,000 per year

    Two ongoing, full-time rolesLocated in Eveleigh with flexible working arrangements availableSalary: Clerk Grade 11/12 with base salary ranging from $149,739 to $173,174 per annum, plus employer's contribution to superannuation and annual leave loadingThe NSW Department of Education's Information Technology Directorate (ITD) is transforming. There is an...

  • Data engineer- Sydney

    4 weeks ago

    NSW - Sydney - City & Inner West, Australia Centelon Pty Ltd Full time

    Job Description Hands on experience in Batch (must) and Streaming (preferable) processing on Cloudera data platform tool-stack: Must have: Hadoop, Spark, HIVE, Oozie and Python/Pyspark as the programming language Preferable: Scala, Hbase, Java, Shell scripting Min 3 years of hands-on project experience on Big Data platform – preferable...

  • Data Engineer Consultant

    5 days ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Productivity & Data Analyst

    1 week ago

    NSW - Sydney - City & Inner West, Australia GAINS5 TECH SOLUTIONS PTY LTD Full time

    Responsibilities: • Carry out assigned duties under general direction of Company Director. Responsibilities may vary according to directions and needs of the business or client side reporting manager. • Assist colleagues and Company clients in selling, planning and delivering digital transformation, reporting & data analytics, continuous improvement &...

  • ▷ [High Salary] Software Engineer

    3 weeks ago

    NSW - Sydney - City & Inner West, Australia AUSTRALIA PEO PTY LIMITED Full time

    About Sourcetable Sourcetable is a US-based technology company developing a next-generation spreadsheet application designed to unify data workflows. By combining the familiarity of traditional spreadsheets with powerful integrations and automation, Sourcetable enables teams to centralize data, streamline reporting, and collaborate more effectively. The...

  • Software Engineer

    3 weeks ago

    NSW - Sydney - City & Inner West, Australia GOSOL AUSTRALIA PTY LIMITED Full time

    Duties and Responsibilities: • Develop software solutions by studying information needs; conferring with users; studying systems flow, data usage and work processes; investigating problem areas; following the software development lifecycle • Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development...

  • Data Engineer

    2 weeks ago

    Sydney NSW, Australia INGRITY Full time $100,000 - $150,000 per year

    Location: SydneyEmployment Type: ContractExperience Level: 2–3 yearsAbout the Role:We are seeking a motivated Data Engineer with 2–3 years of experience to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will work closely with BI developers, and business teams to ensure high-quality, reliable data for analytics...

  • GCP Data Engineer

    2 days ago

    Sydney NSW, Australia Cognizant Technology Solutions Full time $100,000 - $150,000 per year

    Position Summary:Looking for GCP Data Engineer to join their dynamic data and analytics team in Sydney. The successful candidate will play a pivotal role in designing, developing, and optimizing scalable data solutions on Google Cloud Platform (GCP) to support business intelligence, analytics, and digital transformation initiatives.Mandatory Skills:6+ years...