Lead Data Solutions Developer

2 weeks ago

Sydney, New South Wales, Australia beBeeDataEngineering Full time $150,000 - $220,000
Senior Data Engineering Expert Opportunity

This is an exciting opportunity to work with a talented team of engineers and technologists who are passionate about unlocking the potential of data.

We're looking for a highly skilled Senior Data Engineer to join our dynamic team dedicated to developing and implementing cutting-edge data solutions that drive business outcomes across various environments.

As a key member of our Data Engineering team, you will be responsible for developing and implementing high-performance data pipelines employing advanced streaming technologies like Kafka, and Flink.

Key Responsibilities:
  • Developing Data Solutions: Implement and enhance data-driven solutions integrating with clients' systems using state-of-the-art tools such as Databricks, Snowflake, Google Cloud, and AWS.
  • Data Pipeline Development: Develop and optimise high-performance, batch and real-time data pipelines.
  • Database and Storage Optimisation: Optimize and manage a broad array of database technologies, from traditional relational databases (e.g., PostgreSQL, MySQL) to modern NoSQL solutions (e.g., MongoDB, Cassandra).
  • Big Data Processing & Analytics: Utilise big data frameworks such as Apache Spark and Apache Flink to address challenges associated with large-scale data processing and analysis.
  • Cloud Data Management: Implement and oversee cloud-specific data services including AWS Redshift, S3, Google BigQuery, and Google Cloud Storage.
  • Security and Compliance: Ensure all data practices comply with security policies and regulations, embedding security by design in the data infrastructure.
Requirements:
  • Core Data Engineering Tools & Technologies: Demonstrates proficiency in SQL and Spark, and familiarity with platforms such as Databricks and Snowflake.
  • Data Storage Expertise: Knowledgeable in data warehousing technologies like BigQuery, Snowflake, and Databricks.
  • Building and Managing Large-scale Data Systems: Experienced in developing and overseeing large-scale data pipelines and data-intensive applications within production environments.
  • Data Modelling Expertise: Proficient in data modelling, understanding the implications and trade-offs of various methodologies and approaches.
  • Infrastructure Configuration for Data Systems: Competent in setting up data system infrastructures, favouring infrastructure-as-code practices using tools such as Terraform and Pulumi.
  • Programming Languages: Proficient in Python and SQL, with additional experience in programming languages like Java, Scala, GoLang, and Rust considered advantageous.
  • CI/CD Implementation: Knowledgeable about continuous integration and continuous deployment practices using tools like GitHub Actions and ArgoCD.
  • Testing Tools and Frameworks: Experienced with data quality and testing frameworks such as DBT, Great Expectations, and Soda.
  • Commercial Application of Data Engineering Expertise: Demonstrated experience in applying data engineering skills across various industries and organisations in a commercial context.
  • Agile Delivery and Project Management: Skilled in agile, scrum, and kanban project delivery methods, ensuring efficient and effective solution development.

This is a fantastic opportunity to develop your expertise in data engineering, working with a talented team to deliver innovative solutions that make a real impact.

  • Lead Data Engineer/Data Management Lead

    1 week ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$120,000 - US$150,000 per year

    Job Description:We are looking for a highly skilled and experienced Lead Data Engineer with over 15 years of expertise in data engineering, architecture, and enterprise data management. The successful candidate will have hands-on experience with AWS Redshift, AWS DMS, AWS S3, Databricks, Fivetran, DBT & ETL tools(like Informatica/SSIS) along with knowledge...

  • Lead Data Architect and Solutions Developer

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $140,000 - $160,000

    Job DescriptionThe role of Senior Data Engineer is a key position within our organization, responsible for leading the solution architecture and technical delivery of data projects. This involves leveraging Microsoft Azure Data Services to design and deliver scalable solutions that meet client requirements.This individual will work closely with...

  • Data Solutions Lead

    4 days ago

    Sydney, New South Wales, Australia beBeeDataScientist Full time $90,000 - $130,000

    Job DescriptionWe are seeking an experienced professional to lead our data solutions and drive business growth through innovative data strategies.The ideal candidate will have a strong background in developing scalable data pipelines and processes, as well as designing and implementing data products to solve complex business problems.Key responsibilities...

  • Lead Data Solutions Developer

    3 days ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $160,000

    Job OverviewThis is a key position focused on designing and developing cutting-edge data platforms, creating scalable pipeline solutions, and building high-performance backend services.

  • Data Solutions Developer

    1 week ago

    Sydney, New South Wales, Australia beBeeDataAnalyticsEngineer Full time $100,000 - $150,000

    HUB24 leads the wealth industry as a provider of integrated platform, technology, and data solutions. We are innovative, ambitious, and move fast, empowering our employees to bring their ideas and creativity to work. Our culture supports our team members to have a real impact on our business and the success of our customers.Our company is listed on the...

  • Lead Data Solutions Engineer

    1 week ago

    Sydney, New South Wales, Australia beBeeDataSolutions Full time $149,739 - $173,174

    **Job Opportunity: Lead Data Solutions Engineer**">This role presents an exciting opportunity to lead the design and delivery of scalable data solutions using modern data platforms and cloud technologies.The successful candidate will oversee the development of robust data pipelines and business intelligence reporting tools, ensuring high-quality data...

  • Data Solutions Developer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataSolution Full time $105,000 - $154,999

    As a skilled professional in data analytics, you will be responsible for designing and implementing scalable data solutions that drive business growth.Key Responsibilities:Data Requirements Gathering: Collaborate with cross-functional teams to identify and refine data needsData Modeling: Design and develop scalable data models using SQL and DBT to support...

  • Strategic Data Solutions Developer

    6 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $180,000

    Job OpportunityHUB24 is a leading provider of integrated platform, technology and data solutions. We empower our employees to bring their ideas and creativity to work.Key Role DescriptionWe are seeking a highly motivated Data Analytics Engineer to support the development and delivery of scalable, automated data solutions that enable effective analytics and...

  • Solutions Architect

    1 week ago

    Sydney, New South Wales, Australia Dicker Data Full time $120,000 - $180,000 per year

    Founded in 1978, Dicker Data is Australia's leading locally owned and operated distributor of ICT hardware, software, cloud and IoT solutions for over 10,000 reseller partners across Australia and NZ.An ASX listed (ASX: DDR) company, we are recognised in the industry for our award-winning record of gender equality, diversity and inclusion and we pride...

  • Data Solutions Developer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $90,000 - $120,000

    Data Platform ExpertThis role involves delivering timely and accurate data insights to support strategic decision-making across the organization. You will work closely with cross-functional teams to design, develop, and implement data solutions using Alteryx, SQL, and Power BI.Key Responsibilities:Develop and maintain data visualizations and reports to...