Senior Pipeline Architect

1 month ago

Sydney, New South Wales, Australia Industrial Light & Magic Full time

Industrial Light & Magic is seeking a highly skilled Senior Pipeline Architect to join its Core Pipeline team. This role will play a key part in architecting, developing, and maintaining the environment for application developers.

About the Role

The successful candidate will have a passion for technology, systems design, and solving complex problems. They will be responsible for designing, deploying, and maintaining distributed services to improve developer productivity and experience. The ideal candidate will have a mix of skills including Python, Linux, network protocols, relational databases, Kubernetes, infrastructure as code, CI/CD pipelines, monitoring tools, and SRE practices.

About Us

We are a globally distributed team that develops tools and workflows that act as the foundational infrastructure for ILM's creative departments. Our platform provides the services, tools, and applications that underpin the VFX pipeline. We work closely with CG Production to create innovative tooling for media management, publishing, and asset management.

What You'll Be Doing
  • Work closely with development teams to ensure applications are designed for scalability, reliability, and performance.
  • Design, deploy, and maintain distributed, multi-region, highly scalable, and reliable services.
  • Build and maintain effective monitoring, logging, and alerting systems.
  • Implement Site Reliability Engineering (SRE) best practices.
Requirements
  • Expert knowledge of Python and the Linux environment.
  • Experience working with network and application protocols like NFS, TCP, gRPC, HTTP, etc.
  • Experience with several relational or NoSQL technologies such as MySQL, PostgreSQL, MongoDB, Redis, Cassandra, ElasticSearch.
  • Experience building and managing Kubernetes clusters in production.
  • Experience with infrastructure as code such as Terraform, Ansible.
  • Experience with CI/CD pipelines.
  • Experience with monitoring and logging tools such as ELK stack, Prometheus, Grafana, and Datadog.
  • Knowledge of or expertise with SRE practices.
  • Experience designing and implementing distributed systems in multi-region and hybrid environments.
Salary Information

The estimated salary range for this position is between $140,000 - $200,000 per annum, depending on experience.

About Industrial Light & Magic

We are a leader in visual effects and animation, working on some of the biggest films and TV shows in the industry. Our company culture is built around innovation, creativity, and collaboration.

  • Senior Data Pipeline Architect

    4 weeks ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time

    We are seeking a highly skilled Senior Data Pipeline Architect to join our team at Zone IT Solutions in Australia. Estimated Salary: AU$140,000 - AU$180,000 per annum Job Description:Azure-based Data Engineer with expertise in designing and building scalable data pipelines using tools like Apache Airflow or AWS Step Functions. Proficiency in programming...

  • Senior Data Architect for Marketing Analytics

    3 weeks ago

    Sydney, New South Wales, Australia Senior Full time

    Job OverviewWe are seeking a highly skilled Senior Data Architect to join our team. This is a senior-level position responsible for designing and building scalable cloud-based systems and applications for our marketing analytics clients.The ideal candidate will have at least 4+ years of experience delivering data engineering solutions on Google Cloud...

  • Chief Data Architect for Marketing Analytics

    4 weeks ago

    Sydney, New South Wales, Australia Senior Full time

    As a Chief Data Architect for Marketing Analytics, you will have the opportunity to design and build innovative data solutions on Google Cloud Platform (GCP) for our clients in the marketing technology space.We are seeking a skilled professional with at least 4+ years of experience delivering data engineering solutions on GCP. You will work closely with our...

  • Senior Data Architect

    4 weeks ago

    Sydney, New South Wales, Australia Simple Machines Full time

    Job Title: Senior Data ArchitectEstimated Salary: $180,000 - $250,000 per annumAbout the Role:We are seeking a highly skilled Senior Data Architect to lead our data engineering team at Simple Machines. As a key member of our team, you will be responsible for designing and implementing real-time data pipelines and data mesh architectures to enhance client...

  • Senior Big Data Architect

    3 weeks ago

    Sydney, New South Wales, Australia Attribute Group Full time

    Attribute GroupJob Title: Senior Big Data ArchitectSalary Range: $130,000 - $140,000 per annum + SuperWe are seeking a seasoned Senior Big Data Architect with expertise in Cloudera Data Platform (CDP) and Spark-based ingestion pipelines. This role is ideal for a professional with a strong background in building and optimizing data pipelines and a track...

  • Senior Frontend Architect

    3 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About the role Senior Frontend Architect at Pyramid Global Technologies -/ Highly Experienced Senior Frontend Architect We are looking for an experienced and skilled Senior Frontend Architect to join our team.The ideal candidate will have a minimum of 8 years of experience in modern web application development, with a strong focus on front-end technologies...

  • Senior Cloud Data Architect

    4 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About the role of Senior Cloud Data Architect at Pyramid Global TechnologiesOverviewWe are seeking an experienced Senior Cloud Data Architect to join our team in this key role. This position is responsible for designing and implementing large-scale data architectures on Google Cloud Platform (GCP) that meet the needs of our business stakeholders.Job...

  • Senior Cloud Solutions Architect

    4 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About us at Pyramid Global TechnologiesWe are looking for a Senior Cloud Solutions Architect to join our team.The salary range for this position is $120,000 - $180,000 per year, depending on experience.Job Description:As a Senior Cloud Solutions Architect, you will be responsible for designing and deploying cloud-based solutions that meet the needs of our...

  • Senior Java Architect

    3 weeks ago

    Sydney, New South Wales, Australia Virtusa Full time

    Job OverviewVirtusa is seeking an experienced Senior Java Architect to join our team. As a key member of our technology team, you will be responsible for designing and developing applications with Java EE and microservices.Key ResponsibilitiesDesign and develop scalable and distributed applications using Java EE and microservices.Work with diverse...

  • Senior Cloud Data Architect

    1 month ago

    Sydney, New South Wales, Australia NCS Australia Full time

    We are seeking an exceptional Senior Cloud Data Architect to join our team at NCS Australia. This role offers the opportunity to work on cutting-edge data engineering, AI/ML Ops, and Generative AI solutions using Google Cloud Platform (GCP).About the RoleThis is a key position in our Google Cloud Practice, where you will be responsible for designing,...

  • Senior Pipeline Specialist

    3 weeks ago

    Sydney, New South Wales, Australia CoMade Full time

    Job OverviewWe are seeking a highly skilled Senior Pipeline Specialist to join CoMade.

  • Data Pipeline Architect

    3 weeks ago

    Sydney, New South Wales, Australia Hydrogen Group Full time

    Hydrogen Group is a leading financial organisation that continues to grow through multiple projects.The RoleWe are looking for an experienced Data Engineer to join our team working on cutting-edge ETL design and Big Data projects with a focus on cloud-based solutions. The ideal candidate will have experience designing and developing scalable data pipelines...

  • Senior Data Architect

    2 months ago

    Sydney, New South Wales, Australia Nokia Group Full time

    Job SummaryNokia Group is seeking a highly experienced Senior Data Architect/Data Engineering Lead to join our Transformation Office. This role is critical in defining and designing the frameworks that will support automation and transformation initiatives within Managed Services (MS) operations.Key Responsibilities:Architectural Design: Define and design...

  • Senior Data Architect Lead

    3 weeks ago

    Sydney, New South Wales, Australia Whizdom Recruitment Full time

    At Whizdom Recruitment, we are seeking an experienced Senior Data Architect Lead to join our team. This is a fantastic opportunity for you to leverage your technical expertise in designing and implementing data architectures that drive business value.About the RoleThe Senior Data Architect Lead will play a critical role in developing and maintaining data...

  • Senior Cloud Data Architect

    3 weeks ago

    Sydney, New South Wales, Australia Rackspace Full time

    Job OverviewWe are seeking an experienced Senior Cloud Data Architect to join our team in Sydney. As a key member of our data practice, you will play a critical role in designing and implementing modern data solutions for our clients.About the RoleThis is a senior-level position that requires a deep understanding of cloud-based data architectures, analytics,...

  • Sydney Senior Architect Leadership Opportunity

    4 hours ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Sydney Senior Architect Leadership OpportunityClearCompany is seeking a talented and ambitious Senior Architect to lead and develop our Sydney operations. This exciting opportunity allows you to drive excellence and innovation in architecture, leveraging your expertise to propel the business forward.About the Role:We are looking for someone with a minimum of...

  • Senior Cloud Architect

    2 months ago

    Sydney, New South Wales, Australia Cognizant Full time

    About the RoleCognizant is seeking a highly skilled Senior Cloud Architect to join our team. As a Senior Cloud Architect, you will be responsible for designing and implementing secure, scalable, and innovative cloud solutions across cloud environments, AI, Infrastructure as Code (IaC), application modernization, Big Data architectures, and DevOps...

  • Senior Java Microservices Architect

    4 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About Pyramid Global TechnologiesWe are seeking a highly skilled Senior Java Microservices Architect to join our team.Estimated salary: $140,000 - $180,000 per year.Job Description:As a Senior Java Microservices Architect, you will design and develop scalable, secure, and efficient microservices-based systems using Java and AWS services.Key...

  • Senior Cloud Architect

    1 month ago

    Sydney, New South Wales, Australia WiseTech Global Full time

    We are seeking a visionary Principal Architect to lead cutting-edge projects and drive technological advancements in our global IT landscape.As a pivotal member of a dynamic team of engineers, you will take charge of designing and managing all internal and customer-facing infrastructure and technology systems.Your deep technical expertise across multiple...

  • Senior Data Architect

    1 month ago

    Sydney, New South Wales, Australia Whizdom Recruitment Full time

    Unlock Your Potential as a Senior Data Architect with Whizdom RecruitmentAbout the OpportunityWe are seeking an experienced Senior Data Architect to join our team in Sydney. This is a fantastic opportunity to work on high-profile projects, utilizing your expertise in cloud and big data solutions.Job Summary:The successful candidate will be responsible for...