Senior Data Engineer

Found in: Talent AU C2 - 2 weeks ago

Brisbane City, Australia Hudson Full time
12 Month Contract + Possible Extension$124.33 per hour Inc. Super Brisbane CBD Location + 2-3 days WFH

Hudson is seeking a talented and experienced Senior Data Engineer to join a large organisation and play a pivotal role in shaping the future of data-driven decision-making for the team. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimising data systems and building them from the ground up. The Data Engineer will support the software architects, analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

KEY RESPONSIBILITIES

Data Pipeline Development:

  • Design, develop, and maintain scalable data pipelines and ETL processes to efficiently collect, process, and store large volumes of structured, semi-structured, and unstructured data.
  • Implement data integration solutions to consolidate data from various sources, ensuring data consistency and integrity.

Data Analysis and Visualization:

  • Utilize analytical tools and techniques to explore, analyze, and visualize data to uncover trends, patterns, and insights that drive business decision-making.
  • Develop dashboards and reports to communicate key metrics and findings to stakeholders in a clear and actionable manner.

Performance Optimization:

  • Identify opportunities to optimize data processing and storage systems for improved performance, scalability, and efficiency.
  • Implement monitoring and alerting mechanisms to proactively detect and address issues impacting data pipeline reliability and performance.

Data Governance and Compliance:

  • Enforce data governance policies and standards to ensure compliance with regulatory requirements and protect data privacy and security.
  • Implement data quality checks and validation processes to maintain high standards of data integrity and reliability.

Collaboration and Communication:

  • Work closely with cross-functional teams, including software engineers, data scientists, test analysts, and business stakeholders, to understand data requirements and deliver solutions that meet business objectives.
  • Communicate findings and recommendations to stakeholders through presentations, reports, and interactive visualizations.

Technical Skills and Cultural Capability:

  • Experience with data warehousing concepts, relational and non-relational databases, and big data technologies.
  • Experience with medallion data architecture, Azure data stack, and emerging technologies such as ADLS Gen 2, Azure Data Factory, Azure Synapse Analytics, Databricks, and Fabric.
  • Proficiency in data visualization tools such as Tableau, Power BI, or matplotlib.
  • Proven experience in data engineering, including designing and implementing data pipelines, ETL processes, and data integration solutions.
  • Strong proficiency in programming languages such as Python and R for data manipulation, analysis, and visualization.
  • Strong hands-on experience with SQL for database development and complex query design.
  • Knowledge of machine learning algorithms and techniques for classification, regression, clustering, and anomaly detection.
  • Familiarity with analytical tools and techniques for data exploration, statistical analysis, and predictive modeling.
  • Excellent problem-solving skills, critical thinking, and attention to detail.
  • Effective communication and collaboration skills to work with cross-functional teams and translate business requirements into technical solutions.

REF: 237167

For a confidential discussion, please reach out to harme.son@hudson.com or apply via the provided links

Reference number: BBBH237167
Profession:IT, Technology & DigitalDevelopment

Company: Hudson Australia
Date posted: 5th Apr, 2024

  • Senior Data Science/Engineering Officer

    Found in: Talent AU C2 - 2 weeks ago

    Brisbane City, Australia Hudson Full time

    12 Month Contract + Possible Extension Brisbane CBD Location + WFH 2-3 days Market Value RatesROLE OVERVIEW: As a Senior Data Science/Engineering Officer, you will play a pivotal role in the development and application of analytics products, data storage solutions, and methodologies to meet stakeholder needs. Leveraging your expertise in data blending,...

  • Integrity Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Brisbane City, Australia Oceaneering Full time

    Position Summary Purpose  The Integrity Engineer Data (IE) is to assist the Senior Integrity Engineer (SIE) – Data Management to solve a range of asset integrity management solutions with data capture programs. Delivering cost effective and value adding solutions for mechanical integrity and corrosion engineering. Responsible for the quality and...

  • Senior Secondary Electrical Engineer

    Found in: Talent AU C2 - 2 weeks ago

    Brisbane City, Australia UGL Full time

    We work on challenging and exciting projects that shape the way we evolve, adapt and transform the industries we work in. We rally together, drawing on the diverse skills across our teams and create environments where great ideas are heard.  This opportunity will see you join a reputable company with a highly experienced team who work together to develop...

  • Data Engineering Manager

    3 days ago

    Brisbane, Australia Bank of Queensland Full time

    **About the Role** An exciting opportunity to join BOQ Group (which includes Bank of Queensland, Virgin Money Australia and ME Bank) as a Data Engineering Manager has arrived! Do you want be part of a large digital transformation that is moving from legacy systems to a single cloud environment? Then look no further! By joining the digital bank of the future,...

  • Senior Data Scientist

    Found in: Talent AU C2 - 16 hours ago

    Brisbane, Australia Troocoo Full time

    Troocoo:A client of ours in the financial services space is committed to leveraging data insights to drive strategic decision-making and enhance customer experiences. They are seeking a Senior Data Scientist who can use their skillset to influence how the organisation operates through the development of...

  • Senior Engineer

    Found in: Talent AU C2 - 2 weeks ago

    Brisbane City, Australia Hudson Full time

    Contract role through September 2024 + Extension Attractive hourly rate with WFH opportunities Bleeding edge AI technologies within Government!We are seeking a talented AI Engineer to join our clients collaborative intelligence project team. Your responsibilities will encompass the development of Large Language Model (LLM)-based agents, data models, advanced...

  • Data Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Brisbane, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia with Baseline Clearance only respond.Contract start 14 April 2023 to 12 months, 12 months extensions.Australian Citizen, Baseline Clearance, Canberra or Brisbane, Hybrid role.Send your responses to jobs@softtestpays.comOverviewData Engineer Understand complex information systems and design effective data...

  • Data Engineer

    Found in: Talent AU C2 - 2 days ago

    Brisbane, Australia Suncorp Group Full time

    Full-time 12-month contract  Flexible working locations of Brisbane, Sydney or Melbourne Modern building with state of the art facilities At Suncorp, we're seeking a Data Engineer to play a pivotal role in delivering top-quality customer complaints data that drives our commitment to customers, communities, and shareholders. Your mission includes...

  • Data Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Darwin City, Australia Softtest pays pty ltd Full time

    Australian Citizens with the ability to obtain Baseline Clearance residing in Australia only respond.Contract start 05 February 2024 to 6 months, 2 x 6 months extensions.Australian Citizen, baseline Clearance preferred, Canberra or offsite role.Send your responses to jobs@softtestpays.comOverviewAbout the BranchThe role of the Policy, Markets and Data Branch...

  • Senior Software Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Brisbane City, Australia Vero Insurance Full time

    Jobs - Job Details - Senior Software Engineer (IBM MDM) Careers at Suncorp Take the next step. Be part of something bigger at Suncorp. Senior Software Engineer (IBM MDM) Job No: 668834 Sydney - Inner Suburbs & CBD, Brisbane - Inner Suburbs & CBD, Melbourne - Inner Suburbs & CBD, Various Permanent Full Time IT Pay Band 5 We’re never just satisfied with...

  • Senior Software Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Brisbane, Australia HKT Full time

    PCCW Global is a leading international communications service provider, offering the latest mobility, voice and data solutions to multinational enterprises, telecommunications partners, cloud and application service providers. With a network footprint reaching over 3,000 cities in 160+ countries across 5 continents, our truly global coverage combined with...

  • Senior Data Architect

    Found in: Talent AU C2 - 2 weeks ago

    Brisbane, Australia CR Mining Full time

    Radical flexibilityAbility to purchase annual leaveYour birthday offFlexible public holidaysLead the charge in revolutionizing IoT data consumption as a Senior Data Architect at CR Digital. This managerial role will lead a small, dynamic team that prioritizes innovation, collaboration, and excellence!CR Powered by Epiroc, is a global supplier of...

  • Data Platform Engineer

    Found in: beBee S AU - 4 weeks ago

    Brisbane, Australia Randstad Australia Remote Work Freelance Full time

    Randstad Digital are seeking a highly skilled and experienced Azure Data Platform Engineer to join our team. In this role, you will play a pivotal role in driving the design, implementation, and maturation of our client cloud-based data analytics infrastructure for key data-centric projects. If you are passionate about leveraging Azure technologies to drive...

  • Principal Data Engineer

    Found in: Talent AU C2 - 2 weeks ago

    Brisbane, Australia Troocoo Full time

    About the role Troocoo is looking for a People Leader to join an Enterprise Data Analytics team, as a Principal Engineer. You will lead and support a team of Data and Software Engineers to continue to provide top tier solutions for a market leading, globally renowned business. This role is a newly...

  • Azure Data Engineer

    Found in: beBee S AU - 4 weeks ago

    Brisbane, Australia Randstad Australia Remote Work Freelance Full time

    Randstad Data is working with a State Government Department to find a Data Engineer to play a pivotal role in constructing an enterprise-grade data and analytics platform. This role is perfect if you thrive in designing and optimising data systems, with a love for building robust data pipelines from the ground up. You will collaborate closely with software...

  • Senior Mechanical Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Brisbane, Australia Wood Full time

    Wood is currently searching for a Senior Mechanical Engineer to join our team based in one of our offices in either Brisbane, Perth or Melbourne. Our ideal candidate will join a team of engineering specialists working within the field of engineering dynamics specifically focusing on managing vibration induced fatigue risks in Static Equipment Systems. This...

  • Senior Process Engineer

    Found in: Talent AU C2 - 2 weeks ago

    Brisbane, Australia Capstone Recruitment Full time

    Are you an experienced Process Engineer looking for an exciting opportunity to advance your career in the Resource Sector. Capstone Recruitment is proud to present an exclusive position for a talented individual to join a dynamic team as a Senior Chemical Process Engineer with a leading engineering consultancy in Brisbane.  They specialises in...

  • Senior Project Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Townsville City, Australia BMD Constructions Full time

    About the role BMD is in a significant growth phase with a strong pipeline of projects in hand and as a result, we are looking for a Senior Project Engineer to join our high calibre team, working with senior members of the project team to achieve optimum production and cost outcomes. You will provide onsite engineering services and technical support to...

  • Data Analyst

    5 days ago

    Brisbane, Australia LDK Healthcare Full time

    **Data Analyst - Join LDK Seniors’ Living and Make a Difference!** **About LDK**: At LDK Seniors’ Living, we have a powerful vision - to create the most loved seniors' communities in Australia. Love, Decency, and Kindness are the cornerstones of our approach, ensuring the well-being and happiness of our residents are always at the forefront. Together,...

  • Senior Geotechnical Engineer

    Found in: Talent AU C2 - 3 weeks ago

    Brisbane, Australia ENGEO Limited Full time

    Job Description ENGEO is looking for an experienced senior level Geotechnical Engineer to join our Brisbane office in Queensland. We currently have an exciting, dynamic and diverse workload across Australia, New Zealand and California and are interested in hearing from likeminded folk who want to make a difference and be part of our journey. We’re...