Big Data Expertise

6 days ago

Sydney, New South Wales, Australia beBeeDataArchitect Full time $150,000 - $210,000
Senior Big Data Architect

We are seeking a highly skilled Senior Big Data Architect with strong expertise in data integration and transformation solutions.

Key Responsibilities:
  • Design, build, and maintain scalable big data pipelines using Databricks, PySpark, Spark SQL.
  • Work with Azure Synapse to develop data integration and transformation solutions on spark and sql pools.
  • Write optimized and well-structured Spark and SQL queries for complex data sets.
  • Implement data quality and validation checks to ensure reliable data processing.
  • Collaborate with data architects and analysts to align on data mesh architecture principles.
  • Support the deployment and monitoring of big data pipelines in production environments.
  • Engage in performance tuning and optimization of big data processing jobs.
Requirements:
  • 4-8 years of experience working with Azure Synapse, Databricks, PySpark, Spark SQL.
  • Solid understanding of distributed data processing.
  • Working knowledge of data mesh architecture and concepts.
  • Proficiency in developing and optimizing ETL/ELT pipelines in a cloud-based environment.
  • Familiarity with version control and CI/CD pipelines.
  • Strong analytical and problem-solving skills.

About Our Company:

We focus our energy on interesting and impactful work. We're always learning, innovating and setting the standard; making a positive difference to our clients and our society.

  • Big Data Engineer

    4 days ago

    Sydney, New South Wales, Australia beBeeBigDataEngineer Full time $75,000 - $85,000

    Seeking a skilled Big Data Engineer with expertise in designing, developing and maintaining scalable big data solutions.Job DescriptionWe are looking for an experienced professional to lead the development of robust and efficient big data systems using modern tools and technologies.Key Responsibilities:Design and implement large-scale data processing...

  • Big Data Expert

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataSpecialist Full time $75,000 - $85,000

    Job Opportunity:We are looking for a highly skilled and experienced big data specialist to join our team.The ideal candidate will have strong expertise in designing, developing, and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies.You will be responsible for developing data pipelines,...

  • Big Data Specialist

    4 days ago

    Sydney, New South Wales, Australia beBeeBigData Full time $75,000 - $85,000

    Job OpportunityWe are seeking a highly skilled and experienced big data professional to join our engineering team.Key Responsibilities:Building and maintaining robust, scalable, and high-performance big data solutions.Developing and implementing modern big data tools and technologies.Required Skills:Strong expertise in big data tools and...

  • Big Data Developer

    5 days ago

    Sydney, New South Wales, Australia AI Hustler Full time $104,000 - $130,878 per year

    We are seeking a skilled and experiencedBig Data Engineerto join our growing data team. You will be instrumental in building, maintaining, and optimizing the data pipelines and infrastructure that power our analytics and machine learning initiatives. This is an exciting opportunity to work with complex datasets and cutting-edge technologies in a dynamic and...

  • Big Data Strategist

    1 week ago

    Sydney, New South Wales, Australia beBeeDataLeader Full time $160,000 - $240,000

    About the RoleWe are seeking a visionary leader to spearhead our big data initiatives and drive business growth through informed decision-making.Key Responsibilities:Craft and implement comprehensive data strategies utilizing Hadoop, Databricks, Data Lakehouse, and Teradata.Promote collaboration among technical and non-technical stakeholders to communicate...

  • Big Data Expert

    7 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time US$60,000 - US$75,000

    Senior Data Engineering RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and building end-to-end Big Data Pipelines using Apache Spark, Hive, Py-Spark, and HBase.This is an excellent opportunity to work with various teams to implement and design...

  • Big Data Expert

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time

    Job Description:We are seeking a highly skilled and experienced data professional to join our team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance data solutions using modern tools and technologies.You will be responsible for developing data pipelines, transforming large volumes of data, and...

  • Big Data Solutions Architect

    1 week ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $140,000

    Job Summary:We're seeking a skilled Big Data Developer to build and maintain robust big data solutions using modern tools and technologies. Key Responsibilities:Design, develop, and implement efficient big data architectures.Analyze complex data sets to identify trends and insights.Collaborate with cross-functional teams to integrate data solutions.Beyond...

  • Big Data Architectural Engineer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $110,000 - $140,000

    Job Title:Big Data Architectural EngineerAt a leading professional services firm, your expertise can shape better outcomes for communities and businesses. Our advanced data team is expanding, seeking an accomplished Big Data Architectural Engineer to join our vast community of innovators.Key Responsibilities:Develop the strategic design and execution of...

  • Big Data Developer

    1 week ago

    Sydney, New South Wales, Australia Bullit Management Services Limited Full time

    Job Description for Big Data Lead Engineer:Location: SydneyResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback...