Data Pipeline Specialist

7 days ago

Sydney, New South Wales, Australia beBeeDevopser Full time $150,000 - $170,000
Job Description

As a DevOps Engineer, you will play a vital role in our trading technology team. You will be responsible for performing daily monitoring and market pre-open system checks utilizing automation, developing new tools and utilities to help build data pipelines and studies, and becoming a subject matter expert in our in-house systems and data pipelines across market data and static/reference data.

Key Responsibilities:

  • Performing daily monitoring and market pre-open system checks utilizing automation.
  • Developing new tools and utilities to help build data pipelines and studies.
  • Becoming a subject matter expert in our in-house systems and data pipelines across market data and static/reference data.
  • Build and use automation tools/scripting to automate tasks ensuring overall system performance, reliability, and accuracy.
  • Providing a link between developers, traders, and various in-house technology teams, ensuring smooth information flow relating to system issues/changes, market data and market connectivity.
  • Writing and maintaining technical and user documentation for new/existing systems and procedures.
Required Skills and Qualifications

We are looking for candidates with the following skills and qualifications:

  • Experience in application support, deployment, and monitoring.
  • Experience in data pipelines and processing.
  • Experience in Linux.
  • Experience in git, gitlab, CI/CD.
  • Experience in Jenkins, Airflow.
  • Degree with a major in Computer Science, Mathematics, or a related technical discipline.
  • Proficient in Python.
  • Ability to communicate effectively with a range of technical and non-technical staff across the organisation.
  • Ability to work under demanding deadlines with changing priorities in a trading room environment.
  • Understanding of financial markets, including financial instruments, and market data concepts across equities and derivatives.
Benefits

As a DevOps Engineer at our company, you will have the opportunity to:

  • Work in a dynamic and fast-paced trading environment.
  • Collaborate with a talented team of developers, traders, and quant researchers.
  • Develop your skills and expertise in DevOps engineering.
  • Contribute to the development of our trading technology infrastructure.
Others

Our company is committed to providing a positive and inclusive work environment for all employees. We believe in equal opportunities and welcome applications from candidates from all backgrounds.

  • Data Pipeline Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeePipeline Full time $140,000 - $180,000

    Job Opportunity: Data Pipeline SpecialistWe are seeking a highly skilled Data Pipeline Specialist to join our team. The successful candidate will be responsible for designing, implementing, and maintaining robust data pipelines that integrate data from diverse sources.The ideal candidate will have strong proficiency in SQL and Python for data manipulation,...

  • Expert Data Pipeline Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $150,000

    Job Summary:We are seeking an experienced Data Pipeline Specialist to play a vital role in ensuring the quality and integrity of our data pipelines.The ideal candidate will have 5+ years of expertise in SQL, Control-M, Unix, and data warehousing.Responsibilities Include:Design and ExecutionDesign, develop, and execute test plans and test cases for ETL...

  • Data Pipeline Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time

    About the RoleDrive's Data Operations team is seeking an ETL Engineer to help us achieve our vision of shaping the future of automotive in Australia. As a key member of this team, you will be responsible for designing, implementing, and maintaining efficient data pipelines that drive business value.The ideal candidate will have 5+ years of experience with...

  • Data Pipeline Specialist

    14 hours ago

    Sydney, New South Wales, Australia beBeeETLEngineer Full time $120,000 - $140,000

    About this RoleWe are seeking an experienced ETL engineer to shape the future of automotive in Australia by providing authoritative reviews, detailed comparisons, and innovative commerce solutions.Your Key ResponsibilitiesDesign, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.Work with...

  • Data Pipeline Specialist

    5 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $270,000

    Job Title: Data Engineer AssociateWe are looking for a highly skilled and motivated Data Engineer Associate to join our team. As a key member of our data engineering group, you will play a crucial role in designing, developing, and maintaining our modern data pipelines. You will be working closely with experienced engineers to develop solutions that improve...

  • Data Pipeline Architect

    21 hours ago

    Sydney, New South Wales, Australia beBeeIntegration Full time $150,000 - $200,000

    Job Title: Data Integration SpecialistWe are on a mission to be a force for good, through our people, products and purpose.We seek individuals who are passionate, able to work at pace, comfortable with ambiguity, and committed to making a positive difference.Key Responsibilities:Design, build and optimize pipelines using AWS Glue, dbt, Airflow or similar...

  • Data Pipeline Strategist

    17 hours ago

    Sydney, New South Wales, Australia beBeeData Full time $90,000 - $120,000

    Job OverviewData Analyst RoleThe Data Insights Specialist plays a vital role within the organization, supporting business projects by sourcing and maintaining data pipelines.Main Responsibilities:Design and maintain data pipelines by sourcing data across departments.Develop analytical data assets for self-service insights within the team.Analyze internal and...

  • Data Pipeline Specialist

    23 hours ago

    Sydney, New South Wales, Australia Bebeetechnology Full time

    Job Description:Susquehanna is a global privately held financial trading firm with a unique approach to making business decisions every day.Their trading technology team performs support, deployment and automation tasks related to the management of data pipelines throughout the Asia Pacific region.Daily monitoring and market pre-open system checks are...

  • Data Pipeline Specialist

    1 day ago

    Sydney, New South Wales, Australia Bebeedata Full time

    Technical Support EngineerSig-Susquehanna is a global financial trading firm that utilizes collective wisdom and relentless problem-solving to drive business decisions.Your Role:As part of our trading technology team, you will be responsible for performing support, deployment, and automation tasks related to data pipelines in the Asia Pacific region. You...

  • Data Pipeline Specialist

    1 day ago

    Sydney, New South Wales, Australia Bebeeautomation Full time

    Job Title: Devops EngineerAbout the Job:Susquehanna is a global privately held financial trading firm. Our founders are entrepreneurs with a drive to deeply understand the world around us and use that understanding to make the best business decisions every day.As part of our trading technology team, you will perform support, deployment, and automate tasks...