Engineering Data Pipelines Specialist

2 days ago

Wollongong, New South Wales, Australia beBeeDataEngineer Full time $150,000 - $180,000
Job Description

We are looking for a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for architecting, designing, developing, testing, and implementing scalable, robust, and efficient real-time data pipelines using Kafka.

You will also develop and manage ETL/ELT processes and workflows using Python to ensure optimal data quality and efficiency. Additionally, you will craft and execute SQL queries, stored procedures, and views within Snowflake data lake/warehouse.

The role will involve driving the design, development, and maintenance of our AWS architecture. You will foster a data-driven culture and advocate for robust, scalable, and reliable data infrastructure.

Key responsibilities include:

  • Assisting in designing and managing our evolving data infrastructure environment.
  • Leveraging deep understanding of data principles to guide the business on large-scale projects.
  • Designing, developing, and implementing integration and monitoring solutions adhering to best practices.

The ideal candidate will have a strong background in data engineering, with experience in using Kafka, Terraform, Buildkite, and AWS or similar services. Strong Python coding skills and experience in building and maintaining data pipelines are essential.

Required Skills and Qualifications

The following skills and qualifications are required for this role:

  • Bachelor's Degree in Computer Science, Mathematics, or equivalent.
  • 5 years plus, experience in a data centric role.
  • Proven experience in using Kafka, Terraform, Buildkite, and AWS or similar services.
  • Strong Python coding skills.
  • Experience in building and maintaining data pipelines.

Benefits

We offer a range of benefits to support your career and well-being:

  • Competitive pay and more cash in your pocket (less tax) with not-for-profit salary packaging.
  • Flexible working conditions.
  • Birthday leave - relax and take a day off on us.
  • Professional and career development opportunities.
How to Apply

If you feel this is the right role for you, we'd love to hear from you. Simply click the 'Apply now' button, fill in your details and submit. Once you apply, we'll be in touch to discuss your application.

  • Data Engineer

    3 weeks ago

    Wollongong, New South Wales, Australia IRT Australia Full time

    Press Tab to Move to Skip to Content LinkSelect how often (in days) to receive an alert:Founded in 1969, IRT's mission was to provide better options in housing and care for older people. Now 50 years later, our purpose remains the same.We improve the lives of more than 9100 people every day in NSW, the ACT and Qld. We're one of Australia's largest...

  • Data Engineer

    3 weeks ago

    Wollongong, New South Wales, Australia Scalapay Full time

    At Scalapay, we're shaping a culture with high standards, independent and critical thought, innovation, ownership, and continuous learning. We operate in a fast-moving, tech-driven environment, and we're looking for people who thrive in change, think boldly, and take initiative.If you're ready to put your potential to the test in a hiring process designed to...

  • Data Engineer

    1 day ago

    Wollongong, New South Wales, Australia Scalapay Full time $90,000 - $120,000 per year

    At Scalapay, we're shaping a culture with high standards, independent and critical thought, innovation, ownership, and continuous learning. We operate in a fast-moving, tech-driven environment, and we're looking for people who thrive in change, think boldly, and take initiative.If you're ready to put your potential to the test in a hiring process designed to...

  • Data Infrastructure Specialist

    2 weeks ago

    Wollongong, New South Wales, Australia beBeeDataInfrastructure Full time $105,000 - $135,000

    Job Title: Data Infrastructure Specialist">We are seeking a skilled Data Infrastructure Specialist to join our team. As part of our data-centric business environment, this role is crucial in designing, developing, and implementing scalable, robust, and efficient real-time data pipelines.The successful candidate will design and manage ETL/ELT processes and...

  • Data Management Specialist

    2 weeks ago

    Wollongong, New South Wales, Australia beBeeRecords Full time $87,012 - $105,764

    Job Title: Data Management Specialist We are seeking a highly skilled and experienced Data Management Specialist to join our team. The successful candidate will be responsible for managing the day-to-day operation of our information management systems, ensuring that all data is accurately maintained and up-to-date. Requirements: A minimum Certificate IV in...

  • Data Analyst

    3 weeks ago

    Wollongong, New South Wales, Australia University of Wollongong Full time

    Full time, continuing contingent*Two positions availableLevel 6/7: $92,681 - $114,764 + 17% SuperannuationWollongong Innovation CampusThe Palliative Care Outcomes Collaboration (PCOC), part of the Australasian Health Outcomes Consortium (AHOC) within the Faculty of Science, Medicine and Health, is a national program focused on improving palliative care...

  • Mechanical Engineer

    4 weeks ago

    Wollongong, New South Wales, Australia Climax Air Conditioning Full time

    2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Mechanic Engineer - HVACClimax Air ConditioningSydney, Illawarra & South Coast NSWFull timeWe are seeking an experienced Mechanical Engineer to be part of our innovative, professional, and high performing team. Climax is on a trajectory of sustainable...

  • Online Data Entry

    3 weeks ago

    Wollongong, New South Wales, Australia Oneflare Part time $150 - $300

    Work as an Online Data Entry professional at Oneflare in Wollongong. This position can be done remotely.As an Online Data Entry specialist, your responsibilities will include:Inputting and managing data accurately across various platforms.Ensuring data integrity and confidentiality.Collaborating with team members to streamline processes.Maintaining organized...

  • Structural Engineer

    2 weeks ago

    Wollongong, New South Wales, Australia Illawarra Mercury Full time

    Supply Solutions Australia is a multi-faceted privately owned company providing scaffolding, labour and construction solutions. We partner with industry leaders based in the Illawarra and surrounding regions delivering high-quality, safe and reliable services across a range of industrial projects.We are seeking a Structural Engineer with specialist...

  • Remote Data Specialist

    2 weeks ago

    Wollongong, New South Wales, Australia beBeeData Part time $150 - $300

    Are you a detail-oriented and organized individual looking for a remote opportunity? This role involves managing and inputting data across various platforms with high accuracy. Ensuring data integrity and confidentiality is essential to maintaining the trust of our stakeholders.In this position, your responsibilities will include:Data Input and Management:...