Big Data Expert

1 week ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time US$60,000 - US$75,000
Senior Data Engineering Role

We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and building end-to-end Big Data Pipelines using Apache Spark, Hive, Py-Spark, and HBase.

This is an excellent opportunity to work with various teams to implement and design walkthroughs. The ideal candidate will have expertise in setting up and managing continuous integration and continuous deployment pipelines in Bitbucket and Jenkins.

You should also be familiar with control-M scheduling tool and possess skills in monitoring tools and analyzing root cause using Spark Logs.

Key Responsibilities:

  • Design and build end-to-end Big Data Pipelines using Apache Spark, Hive, Py-Spark, and HBase
  • Collaborate with various teams to implement and design walkthroughs
  • Set up and manage continuous integration and continuous deployment pipelines in Bitbucket and Jenkins
  • Familiarity with control-M scheduling tool
  • Skills in monitoring tools and analyzing root cause using Spark Logs

Required Skills:

  • Apache Spark, MapReduce, Sqoop, Py-spark, Spark SQL
  • Hive, MySQL, Oracle
  • Python and HBase
  • Expertise in setting up and managing continuous integration and continuous deployment pipelines in Bitbucket and Jenkins
  • Familiarity with control-M scheduling tool
  • Skills in monitoring tools and analyzing root cause using Spark Logs

Experience:

  • 4+ years of experience in data engineering
  • Proven experience in delivering projects successfully through effective planning, prioritizing, team building, task scheduling and tracking scheduled tasks

Industry:

  • Banking (BFSI)

  • Expert Big Data Developer Position

    1 week ago

    Sydney, New South Wales, Australia beBeeData Full time $75,000 - $85,000

    Job TitleBig Data Developer: Design and Deliver Scalable SolutionsJob DescriptionOur organization seeks a highly skilled Big Data Developer to design, develop, and maintain robust, scalable, and high-performance big data solutions using modern big data tools and technologies.Mandatory Skills and QualificationsDesign, develop, and maintain scalable and secure...

  • Big Data Expert

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataSpecialist Full time $75,000 - $85,000

    Job Opportunity:We are looking for a highly skilled and experienced big data specialist to join our team.The ideal candidate will have strong expertise in designing, developing, and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies.You will be responsible for developing data pipelines,...

  • Big Data Developer

    4 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    OverviewPosition Summary: We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines,...

  • Big Data Developer

    4 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    OverviewPosition Summary: We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines,...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$75,000 - US$85,000 per year

    Position Summary:We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    1 week ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    3 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Join to apply for the Big Data Developer role at Cognizant1 day ago Be among the first 25 applicantsJoin to apply for the Big Data Developer role at CognizantPosition SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust,...

  • Big Data Expert

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time

    Job Description:We are seeking a highly skilled and experienced data professional to join our team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance data solutions using modern tools and technologies.You will be responsible for developing data pipelines, transforming large volumes of data, and...