Senior Big Data Systems Developer

5 days ago

Sydney, New South Wales, Australia beBeeData Full time $75,000 - $85,000
Job Title

Big Data Developer Specialist


Key Responsibilities
  • Design and develop scalable, secure big data processing systems using Apache Spark, Hadoop, Hive, Kafka etc.
  • Build and optimize data pipelines and architectures for data ingestion, processing and storage from diverse sources.
  • Collaborate with cross-functional teams to deliver efficient data solutions.
  • Implement data quality, consistency and security by leveraging appropriate validation, logging, monitoring and governance standards.
  • Develop ETL/ELT workflows and data transformation logic using custom code in Python, Scala, Java and job scheduling tools like Control-M.

Required Skills and Qualifications
  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology or related fields.
  • 4+ years of experience in Big Data technologies.
  • Expertise in template-oriented data validation/cleansing frameworks.
  • Strong programming skills in Python, Scala, Shell Scripting and Java.
  • Extensive experience in data transformation and building ETL pipelines using PySpark.
  • Strong knowledge in performance improvements of existing big data Streaming or Batch Pipeline.
  • Proficiency in big data tools and frameworks such as Apache Spark, Hadoop, Kafka, and Hive.
  • Deep understanding of Azure cloud platform and NoSQL databases (HBase, Cosmos DB).

Benefits
  • Opportunity to work with a highly skilled team.
  • Professional growth and development opportunities.
  • Competitive compensation package.
  • Flexible working hours.

Other Requirements
  • Ability to build predictive models and machine learning algorithms.
  • Experience in data visualization techniques.
  • Strong communication and collaboration skills.
  • Ability to adapt to changing priorities and deadlines.

  • Big Data Developer

    3 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Join to apply for the Big Data Developer role at Cognizant1 day ago Be among the first 25 applicantsJoin to apply for the Big Data Developer role at CognizantPosition SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust,...

  • Big Data Developer

    3 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    OverviewPosition Summary: We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines,...

  • Big Data Developer

    3 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    OverviewPosition Summary: We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines,...

  • Big Data Developer

    1 week ago

    Sydney, New South Wales, Australia Bullit Management Services Limited Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$75,000 - US$85,000 per year

    Position Summary:We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    6 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...