Big Data Engineer

6 days ago

Sydney, Australia Clarrow Full time

Clarrow are currently assisting a big four bank in sourcing a Big Data Engineer with a specialisation in Airflow. Our client has kick start a Data Transformation and the long term plan for the program of work, is to build the bank the most innovative Platform possible.

**Your New Role**:
As a Data Engineer, you will joining a high performing Data Engineering team, developing cutting-edge apps. This specific team are pioneering the industry standard and they are searching for, high performing, likeminded and innovative engineers to achieve the very best results.

If you are an engineer who has a strong AWS, Airflow and python background, this will be the perfect role for you. Whether you are a mid-level or Senior or Advance Senior we would love to hear from you, as there are multiple levelled roles in this team, however the key experience you MUST HAVE is Airflow.

**Key Selection Criteria**:

- Strong experience with Airflow (Data Pipelines)
- Data warehousing with Information management
- Data modelling experience
- AWS - any or all of EC2, S3, EBS, ELB, RDS, Dynamo DB, EMR
- Linux/Unix skills
- SQL - complex queries and DDL
- Hive, Spark, Presto
- Apache Oozie, LUIGI or Airflow
- Understanding of a DevOps environment
- Good Level of programming (Scala or Java or Python) in conjunction with Big data technologies like Spark

**Desirable**:

- Experience working in environments with Docker, Kubernetes, Openshift
- Understanding or knowledge of machine learning (E.g. Spark ML or R)
- Streaming skills - using Kafka, Spark streaming or other technologies
- Build tools like Maven, Gradle, Ant

**Benefits**:

- Highly competitive salary & contract rates
- Flexible work arrangements
- 10 days additional to annual leave
- 16 weeks paid parental leave for primary caregivers
- 6 months service for parental leave eligibility
- Gyms Discounts
- Private health insurance
- Learning and development programs
- Permanent relocation benefits
- Salary sacrifice on a range of benefits
- Staff rates on home loans
- Financial education sessions
- Retail discounts
- Discounted rates on insurance

  • Big Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Deloitte Full time $120,000 - $180,000 per year

    :Job Requisition ID:36903World class training and development.Truly flexible work.Hands-on mentoring on emerging technologies.What will your typical day look like?Deloitte AI & Data is changing the way that businesses leverage cloud-native technology to solve the toughest Data, Machine Learning and AI challenges faced by our customers Join us as we continue...

  • Big data

    1 week ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time $80,000 - $240,000 per year

    Job Description for Big Data Lead Engineer:Location : SydneyTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...

  • Big Data Lead Engineer

    6 days ago

    Sydney, New South Wales, Australia CareCone Group Full time $150,000 - $200,000 per year

    Role: Big Data Lead EngineerLocation: SydneyJob Description:Technical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...

  • Big Data Lead Engineer

    4 days ago

    Sydney, New South Wales, Australia CareCone Group Full time $150,000 - $200,000 per year

    Title: Big Data Lead EngineerLocation: SydneyPermanent Role.Job Description:Technical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts...

  • Big Data Developer

    4 weeks ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...

  • Big Data Developer

    4 weeks ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...

  • Big Data Lead Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time

    OverviewWe are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologies.ResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...

  • Big Data Lead Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time

    OverviewWe are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologies.ResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...

  • Big Data Lead Engineer

    4 days ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time $180,000 - $250,000 per year

    We are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologiesTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...

  • Big Data Developer

    3 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...