Highly Skilled Data Professional

24 hours ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time $160,000 - $180,000
Job Title:

Senior Data Engineer

Job Summary:

We are seeking a skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and maintaining large-scale data systems.

Key Responsibilities:
  • Maintain and take ownership of core databases used in real-time and production-critical environments.
  • Determine and standardise best practices for database versioning and schema migration processes across applications.
  • Implement data maintenance strategies including automated purging, archiving, and index optimisation.
System Design and Governance:
  • Develop efficient and reliable data pipelines for energy market and asset telemetry data.
  • Define the structure and lifecycle of datasets across Energy Management applications to optimise performance, availability, and cost.
  • Support consolidation and simplification of disparate database access patterns into shared, maintainable libraries or services.
  • Establish team-wide standards for data ingestion, transformation, storage, and access.
Team Enablement and Leadership:
  • Partner with engineers and analysts to resolve complex operational issues, understand bottlenecks in data access, and identify opportunities for improvement.
  • Mentor junior developers and data practitioners on efficient querying, modelling, and pipeline design.
  • Guide the evaluation and integration of modern data tooling, such as orchestration, monitoring, and data warehousing systems.
Requirements:
  • 4+ years' experience in data engineering roles, including experience with relational databases in an operations-critical capacity.
  • Proven track record designing scalable data architectures across multiple applications or services.
  • Strong proficiency in SQL and Python.
  • Demonstrated experience implementing schema migration/version control at scale.
  • Track record of operating in mature data environments, with established processes for quality, governance, and continuous improvement.
  • Strong appetite for software & data quality, implementing modern tooling, and solving problems proactively.
  • Hands-on experience with CI/CD, containerisation (e.g., Docker), and deploying data systems in cloud-based environments (Azure, AWS, or equivalent).
Desirable Skills:
  • Hands-on experience with data orchestration tools (Dagster, Prefect, Azure data platform, etc.).
  • Experience in the energy sector or other real-time operations domains.
  • Familiarity with CI/CD, Kubernetes, and infrastructure-as-code approaches to data system deployment.
  • Exposure to revenue modelling, time series forecasting, or optimisation pipelines.
  • Prior experience establishing data governance frameworks in a scale-up or cross-functional environment.
Benefits:

This is a fantastic opportunity to work with a talented team, develop your skills, and contribute to the growth of our organisation.

What We Offer:
  • A competitive salary package.
  • Ongoing training and professional development opportunities.
  • A collaborative and dynamic work environment.

  • Highly Skilled Data Professional

    1 week ago

    Sydney, New South Wales, Australia beBeeDataAnalyst Full time $100,000 - $140,000

    Job TitleData Analyst With MDMAbout The RoleWe are seeking a highly skilled Data Analyst with expertise in Master Data Management (MDM). The ideal candidate will have a proven track record of working with large datasets, implementing MDM strategies, and delivering actionable insights.Key ResponsibilitiesAnalyze complex datasets to identify trends, patterns,...

  • Highly Skilled Data Professional

    5 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $100,000 - $150,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team.Design, build, and maintain scalable data pipelines using Azure Data Factory for data ingestion from diverse sources.Utilize Azure Data Lake Storage (Gen2) and Delta Lake for managing data in different stages.Implement data processing workflows using Azure Databricks to...

  • Highly Skilled Data Professional

    22 hours ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $160,000

    Expert Data Engineer Position">As a data expert at this company, you will collaborate with a team of skilled professionals to deliver comprehensive technology solutions for clients. Your responsibilities will involve designing and implementing complex data pipelines using your in-depth understanding of data concepts.You will work closely with clients to...

  • Highly Skilled Data Engineering Professional

    7 days ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $100,000 - $140,000

    About the RoleWe are seeking an experienced professional to support advisory work for a key client. The role requires a high level of autonomy and flexibility, with a strong focus on delivering robust data engineering solutions within tight timelines.Key Responsibilities:Design and implement data ingestion pipelines from on-prem SQL sourcesDevelop and write...

  • Highly Skilled Data Science Professional

    16 hours ago

    Sydney, New South Wales, Australia beBeeData Full time $140,000 - $180,000

    Job SummaryWe are seeking a highly skilled professional to lead our data science efforts. As a Senior Data Scientist, you will be responsible for deploying models and shaping the direction of data science within our organization.Key ResponsibilitiesDevelop and deploy production-grade machine learning models that drive real business outcomesCollaborate with...

  • Highly Skilled Data Professional

    7 days ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000

    Job Title: Senior Data EngineerWe are seeking a skilled Senior Data Engineer to design, build and optimize data pipelines using Azure services.Key Responsibilities:Design and develop scalable data pipelines and ETL processes in AzureStrong experience working with Python, Spark and DatabricksDevelop and maintain data models, data lakes and data...

  • Highly Skilled Data Science Professional

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time

    Job DescriptionWe are seeking a highly skilled Senior Consultant to join our team. The successful candidate will have strong data science capabilities and experience in designing, building, and deploying advanced analytical and machine learning solutions.The Senior Consultant will work closely with our data engineers, analysts, and domain experts to deliver...

  • Highly Skilled Data Architect

    6 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $150,000

    Software Engineering OpportunityWe are seeking a highly skilled Data Engineer to support and advance the data needs of our local research team.Main Responsibilities:Platform Development: Advancing the state-of-the-art of various platforms and tools.Cost Optimization: Monitoring and optimizing resource usage in partnership with the Data Platform team,...

  • Highly Skilled Data Specialist

    2 days ago

    Sydney, New South Wales, Australia beBeeDataSpecialist Full time $102,463 - $143,011

    Job OverviewWe are seeking a highly skilled Senior Data Systems Analyst to join our team. This critical role requires leadership and technical expertise in data onboarding, trading partner implementations, and data quality management.This individual will lead the onboarding of electronic data trading partners and ensure successful implementations.The analyst...

  • Highly Skilled Data Architect

    8 hours ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $150,000 - $180,000

    Job Title: Data EngineerA highly skilled and accomplished Data Engineer is sought after to drive the strategic design and execution of robust, scalable data architecture.This role will spearhead integrations of complex data ecosystems, ensuring high reliability and performance for real-time processing across leading cloud platforms.The ideal candidate will...