Big Data Engineer

1 week ago

Sydney, Australia Clarrow Full time

Clarrow are currently assisting a big four bank in sourcing a Big Data Engineer with a specialisation in Airflow. Our client has kick start a Data Transformation and the long term plan for the program of work, is to build the bank the most innovative Platform possible.

**Your New Role**:
As a Data Engineer, you will joining a high performing Data Engineering team, developing cutting-edge apps. This specific team are pioneering the industry standard and they are searching for, high performing, likeminded and innovative engineers to achieve the very best results.

If you are an engineer who has a strong AWS, Airflow and python background, this will be the perfect role for you. Whether you are a mid-level or Senior or Advance Senior we would love to hear from you, as there are multiple levelled roles in this team, however the key experience you MUST HAVE is Airflow.

**Key Selection Criteria**:

- Strong experience with Airflow (Data Pipelines)
- Data warehousing with Information management
- Data modelling experience
- AWS - any or all of EC2, S3, EBS, ELB, RDS, Dynamo DB, EMR
- Linux/Unix skills
- SQL - complex queries and DDL
- Hive, Spark, Presto
- Apache Oozie, LUIGI or Airflow
- Understanding of a DevOps environment
- Good Level of programming (Scala or Java or Python) in conjunction with Big data technologies like Spark

**Desirable**:

- Experience working in environments with Docker, Kubernetes, Openshift
- Understanding or knowledge of machine learning (E.g. Spark ML or R)
- Streaming skills - using Kafka, Spark streaming or other technologies
- Build tools like Maven, Gradle, Ant

**Benefits**:

- Highly competitive salary & contract rates
- Flexible work arrangements
- 10 days additional to annual leave
- 16 weeks paid parental leave for primary caregivers
- 6 months service for parental leave eligibility
- Gyms Discounts
- Private health insurance
- Learning and development programs
- Permanent relocation benefits
- Salary sacrifice on a range of benefits
- Staff rates on home loans
- Financial education sessions
- Retail discounts
- Discounted rates on insurance

  • Big Data Developer

    2 days ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...

  • Big Data Developer

    2 days ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...

  • Big Data Developer

    10 hours ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    8 hours ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    7 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    Join to apply for the Big Data Developer role at Cognizant1 day ago Be among the first 25 applicantsJoin to apply for the Big Data Developer role at CognizantPosition SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust,...

  • Big Data Lead Engineer

    3 days ago

    Sydney, New South Wales, Australia Tata Consultancy Services Full time

    OverviewJob Title: Big Data Lead EngineerAbout the jobJoin Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us...

  • Big Data Lead Engineer

    3 days ago

    Sydney, New South Wales, Australia Tata Consultancy Services Full time

    OverviewJob Title: Big Data Lead EngineerAbout the jobJoin Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us...

  • Big Data Specialist

    1 day ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $102,899 - $121,317

    Cloud Data EngineerWe are seeking a highly skilled and experienced Cloud Data Engineer to join our vibrant Engineering team in Sydney.The ideal candidate will have experience with cloud-based data platforms and commercial experience in programming languages such as Python, Java, or Scala. Additionally, proficiency in Spark SQL, ETL frameworks, Big Data...

  • Big Data Architect

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time

    Big Data Architecture ExpertWe are seeking a talented professional to join our fast-paced AI team as a Big Data Architecture Expert. As part of this role, you will be responsible for designing and developing large-scale data architectures that support machine learning and artificial intelligence model training, validation, testing, and production.Key...

  • Azure Big Data

    4 days ago

    Sydney, Australia Cognizant Full time

    Do you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer. - Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks - Knowledge of CICD - Git / Bitbucket, Jenkins / Bamboo - Have experience in executing Hive/Impala SQLs - Sound knowledge on Spark Query tuning and performance...