Data Devops Lead

About us

We are a leading provider of innovative solutions, backed by Auto & General Insurance Company. Our portfolio includes trusted brands such as iSelect, Compare the Market and Budget Direct.

iSelect is passionate about making Australians' lives easier by saving them time, money and effort. With over 20 years' experience, we offer a one-stop-shop for comparison and purchasing across insurance, utilities and personal finance products.

At iSelect, we're committed to simplifying the process of making sound financial decisions. This guiding principle informs our direction, prioritisation and decision-making processes.

The Lead - Data DevOps plays a pivotal role in designing, implementing and maintaining highly available, scalable and secure data pipelines and platforms. This position ensures efficient CI/CD processes, infrastructure automation and monitoring to support the organisation's data ecosystem.

This role requires a strong background in DataOps, DevOps, cloud data platforms and infrastructure automation. The successful candidate will work closely with Data Engineering, Security, IT Operations and Analytics teams to streamline data workflows, enhance system reliability and optimise cloud-based data environments.

The key focus areas include infrastructure as code (IaC), CI/CD for data pipelines, monitoring & observability, cost optimisation and cloud security.

Data Platform & Pipeline Automation:

• Design, implement and maintain CI/CD pipelines for data engineering workflows.
• Automate data pipeline deployments, monitoring and scaling to ensure reliability and performance.
• Develop and enforce IaC practices using tools like Terraform, AWS CloudFormation or Azure Bicep.
• Work with Data Engineers and IT teams to optimise ETL/ELT processes and cloud data platforms.

Cloud Infrastructure & Security:

• Oversee data infrastructure in cloud environments (AWS, Azure, GCP) ensuring high availability and security.
• Implement role-based access control (RBAC), encryption and network security best practices within data environments.
• Collaborate with Security and Compliance teams to ensure regulatory compliance.
• Optimise cloud storage, compute and networking costs while maintaining performance.

Monitoring, Observability & Incident Response:

• Implement monitoring solutions for real-time alerting, anomaly detection and performance optimisation.
• Utilise logging and observability tools like Prometheus, Grafana, Datadog, Splunk or CloudWatch.
• Establish incident response processes including automated rollback strategies and disaster recovery plans.
• Work with Site Reliability Engineering (SRE) teams to ensure high system availability and minimal downtime.

Data Ops & DevOps Best Practices:

• Advocate for DataOps methodologies to improve collaboration between Data Engineering, IT and Analytics teams.
• Implement version control, automated testing and release management for data pipelines.
• Continuously improve CI/CD workflows to enhance deployment frequency and reduce failures.
• Enforce best practices for data governance, lineage tracking and auditability.

Collaboration & Stakeholder Engagement:

• Work closely with Data Engineers, Analytics, Security and IT Operations to streamline data infrastructure.
• Act as the subject matter expert (SME) on Data DevOps providing training and mentorship to team members.
• Engage with business leaders and data users to align infrastructure improvements with business goals.

To be successful in this role, you will require:

• Bachelor's or Master's degree in Computer Science, Data Engineering, Cloud Computing or a related field/relevant experience.
• 3-5+ years of experience in DevOps, Data Engineering or Cloud Infrastructure roles.
• Hands-on experience with CI/CD tools (e.g., GitHub Actions, Jenkins, Azure DevOps).
• Proficiency in containerization and orchestration (Docker, Kubernetes, ECS, EKS, AKS) as plus.
• Experience implementing IaC using Terraform.
• Expertise in cloud data platforms (AWS, Azure, GCP) with services like AWS Lambda, S3, RDS, Redshift, Glue, EMR, Databricks, BigQuery etc.
• Strong understanding of cloud networking, security policies and identity management (IAM, VPC, KMS, Secrets Manager etc.).
• Experience setting up monitoring and alerting using tools like Prometheus, Grafana, CloudWatch, Datadog etc.
• Ability to troubleshoot performance issues and optimise system reliability.
• Strong experience in Python, Bash or PowerShell for automation and scripting.
• Ability to write automation scripts for infrastructure provisioning, deployments and data pipeline management.
• Ability to lead a small team and mentor junior engineers promoting DevOps best practices across teams.
• Strong communication skills to work with both technical and non-technical stakeholders.

A career opportunity awaits you at our company

We offer a competitive salary, generous uncapped commission scheme, opportunities for growth and development, a fun and dynamic work environment, three 'recharge' days per year, free coffee and an impressive Employee Benefits Program.

If you're someone who fosters teamwork, has resilience and aspires to continue learning and developing your skills to drive commercial outcomes, you'll thrive in this role.