Mastering Large-Scale Data Processing

1 day ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time $160,000 - $200,000

Data Engineering is a critical discipline in the realm of information technology. As organizations continue to grapple with the challenges of big data, the role of a Data Engineer has become increasingly vital.

A Data Engineer designs, builds, and maintains the infrastructure that enables organizations to collect, process, and analyze large datasets. This includes developing and implementing data pipelines, ensuring data quality, and optimizing data processing workflows.

For this project, we are seeking a seasoned Data Engineer with expertise in designing and implementing large-scale data pipelines. The ideal candidate will have hands-on experience with cloud-based platforms, such as AWS Glue, and proficiency in scripting languages like Python and Bash.

In addition to technical skills, excellent communication and collaboration skills are essential for success in this role. The successful candidate will work closely with cross-functional teams to deliver project outcomes in a fast-paced Agile environment.

Key Responsibilities:

  • Design and implement robust and scalable data pipelines
  • Migrate existing custom data frameworks to new platforms
  • Work with multiple data clusters and implement big data processing solutions

Requirements:

  • 5-7+ years of enterprise experience as a Data Engineer
  • Hands-on experience with AWS cloud platforms and services
  • Strong scripting skills in Python and/or Bash
  • Experience in DevOps, Agile, Scrum, or Continuous Delivery environments

About Us:

We value diversity and inclusion in the workplace and encourage applications from all qualified individuals. If you are a motivated and experienced Data Engineer looking to contribute to a significant digital transformation initiative, please submit your application.

  • Master Data Management Expert

    1 day ago

    Sydney, New South Wales, Australia beBeeDataStrategist Full time $120,000 - $180,000

    As a seasoned data strategist, you will be responsible for designing and implementing Master Data Management (MDM) solutions using advanced data quality and governance frameworks.Key ResponsibilitiesLead the design and implementation of MDM solutions, including data quality and governance strategies.Collaborate with business and technical teams to define...

  • Large Scale Program Director

    4 hours ago

    Sydney, New South Wales, Australia beBeeProgramLeader Full time $66,000 - $393,000

    Unlocking Collective Potential\ \The company is on a mission to unleash the potential of every team member. They offer flexible work arrangements, allowing individuals to support family, personal goals and life outside work.\ \About the Role\ \As a central orchestrator, you will own milestone, budget and risk management for large-scale programs. You will...

  • Safety Professional for Large-Scale Data Centres

    3 days ago

    Sydney, New South Wales, Australia beBeeWHS Full time

    About the RoleWe are seeking a highly skilled WHS Coordinator to join our Data Centre team in Kemps Creek or Huntingwood.The successful candidate will work alongside and support a highly experienced Safety Manager who enjoys mentoring and developing those around him.A W Edwards is a leading builder with a long history of building iconic buildings in NSW,...

  • Project Manager

    17 hours ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $100,000 - $190,000

    Project Manager for Large-Scale InfrastructureWe are seeking a seasoned Project Manager to coordinate and manage various project elements, ensuring efficient progress and adherence to timelines.About the RoleThis is a challenging opportunity for an experienced professional to thrive in a fast-paced environment, collaborating with multidisciplinary teams to...

  • Master Data Management

    3 weeks ago

    Sydney, New South Wales, Australia Wipro Full time

    Position Name: Master Data Management (MDM) Specialist Primary Skills: Master Data Management Concepts Data Integration and Modeling ETL Tools Job Description: Leads high-level technical solutioning process, evaluates current technical feasibility options, suggests technical roadmap, manages dependencies, gives high-level estimation, identifies...

  • Master Data Management

    3 weeks ago

    Sydney, New South Wales, Australia Wipro Full time

    Position Name: Master Data Management (MDM) SpecialistPrimary Skills:Master Data Management ConceptsData Integration and ModelingETL ToolsJob Description:Leads high-level technical solutioning process, evaluates current technical feasibility options, suggests technical roadmap, manages dependencies, gives high-level estimation, identifies implementation...

  • Master Data Strategist

    4 days ago

    Sydney, New South Wales, Australia beBeeData Full time $22,000 - $169,151

    Job Description:We are seeking a seasoned Master Data Strategist with extensive experience in managing customer, address, and reference domains. The ideal candidate will have hands-on experience with data integration, profiling, and quality assurance.Key Responsibilities:Data Governance: Implement and maintain master data across customer, address, and...

  • Scrum Master

    2 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    Job Description for Scrum Master in Sydney Ideally, you will be an Agile Practitioner with a proven track record and experience in agile coaching and scaled delivery for large scale enterprise/Banking Financial Services sectors.Key Responsibilities: Hands-on experience from either a Scrum Master or true Agile coaching background.Passionate about teaching,...

  • Scrum master

    3 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    Job Description for Scrum Master in SydneyIdeally, you will be an Agile Practitioner with a proven track record and experience in agile coaching and scaled delivery for large scale enterprise/Banking Financial Services sectors.Key Responsibilities:Hands-on experience from either a Scrum Master or true Agile coaching background.Passionate about teaching, with...

  • Master Data Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $120,000

    As a master data specialist, you will play a key role in designing and configuring product information management solutions involving data modeling, migration, integration, workflows, business rules etc based on functional and non-functional requirements.The Role and YouYou will be responsible for supporting existing master management solution with necessary...