Data Engineer/Architect

1 month ago

Melbourne, Victoria, Australia CPB Contractors Full time
About North East Link

The Spark Consortium has been selected for the Central Package of the North East Link Project, Victoria's biggest road project. The Central Package will be delivered as a Public-Private Partnership, providing three-lane twin tunnels that will close the missing link in Melbourne's freeway network from the M80 Ring Road to an upgraded Eastern Freeway.

This project will reduce journey times and divert heavy vehicles away from local roads. Up to 135,000 vehicles will use North East Link every day, reducing congestion in the north-east while maintaining local roads.

About the Role:

We are seeking a skilled and detail-oriented Data Engineer with strong expertise in Azure, Databricks, and Power BI to join our Data & Analytics team. This role is ideal for professionals who have a deep understanding of data engineering processes and solution architecture within the Azure ecosystem.

The successful candidate will be responsible for designing, building, and maintaining scalable data solutions that drive business insights and decision-making, leveraging Azure and Databricks technologies.

Key Responsibilities:
  • Azure and Databricks Solution Architecture:
    • Lead the design and implementation of robust, scalable data pipelines and architectures on Azure and Databricks platforms to support business intelligence, analytics, and reporting needs.
    • Collaborate with cross-functional teams to understand data requirements and translate them into effective architectural solutions within Azure.
    • Ensure that data solutions are designed for performance, reliability, scalability, and security, with a focus on leveraging Azure-native services.
  • Data Engineering and Development:
    • Develop, test, and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Factory, Databricks, and other related tools.
    • Work with large datasets, ensuring efficient data storage, processing, and retrieval on Azure and Databricks to support analytics and reporting functions.
    • Implement and optimize data models in Databricks to improve query performance and facilitate complex data analysis.
  • Governance and Compliance:
    • Establish and enforce data governance standards within the Azure environment, ensuring data quality, consistency, and compliance with regulatory requirements.
    • Implement data security measures, including data masking, encryption, and access controls, to protect sensitive information in Azure.
    • Collaborate with stakeholders to define and enforce data governance policies and procedures across the Azure ecosystem.
  • Power BI Reporting and Analytics:
    • Design and develop reporting solutions using Power BI that provide insights into key business metrics and support data-driven decision-making.
    • Create and maintain dashboards, visualizations, and reports in Power BI that meet the needs of various stakeholders, leveraging Azure data sources.
    • Ensure that Power BI reporting solutions are accurate, timely, and aligned with business objectives.
  • Collaboration and Leadership:
    • Serve as a subject matter expert on Azure, Databricks, and Power BI, providing guidance to junior team members.
    • Collaborate with data analysts, and business stakeholders to deliver comprehensive data solutions within the Azure platform.
    • Lead and participate in design reviews, ensuring that data solutions align with best practices and organizational standards.
  • Documentation and Continuous Improvement:
    • Maintain comprehensive documentation of Azure and Databricks architectures, processes, and governance policies.
    • Continuously evaluate and improve data engineering processes, tools, and technologies within the Azure ecosystem to enhance efficiency and effectiveness.
    • Stay current with industry trends and advancements in Azure, Databricks, and Power BI.
Qualifications:
  • Education: Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.
  • Experience: 3-5 years of experience in data engineering with a focus on Azure, Databricks, and Power BI; experience with data governance and reporting is essential.
  • Technical Skills:
    • Proficiency in SQL, Python, with a focus on Azure and Databricks environments.
    • Experience with Azure data services (e.g., Azure Data Factory, Azure Data Lake, Azure Synapse Analytics) and Databricks.
    • Strong understanding of data modeling, ETL processes, and data warehousing within Azure.
    • Expertise in creating and optimizing Power BI dashboards and reports using Azure data sources.
  • Soft Skills: Strong analytical thinking, excellent problem-solving abilities, effective communication skills, and the ability to work collaboratively in a fast-paced environment. Ability to mentor associate data engineers and other team members.
Why Join Us?
  • Innovative Environment: Engage in cutting-edge projects that leverage Azure, Databricks, and Power BI technologies.
  • Professional Growth: Opportunities for learning, development, and career advancement in a supportive and dynamic team.
  • Impactful Work: Play a crucial role in shaping the data strategy of a forward-thinking organization.

CPB Contractors is committed to equal employment opportunity (EEO) and actively seeks to remove barriers people may face in gaining a successful position on the North East Link Central Package. We value diversity, inclusion, and equity through providing a working environment where all employees feel included, valued, and free to bring their different skills, experiences, and perspectives.

  • Data Architect Lead

    1 month ago

    Melbourne, Victoria, Australia Data Privacy Full time

    Data Architect OpportunityWe are seeking a highly skilled Data Architect to lead the development of a new Data Platform utilizing AWS services. The successful candidate will be responsible for providing technical leadership to the project delivery teams, advising on implementation best practices, and defining and refining release processes.Key...

  • Data Engineer

    1 month ago

    Melbourne, Victoria, Australia Emeis Cosmetics Pty Ltd Full time

    Job Title: Data Engineer - Cloud ArchitectWe are seeking a highly skilled Data Engineer - Cloud Architect to join our team. As a Data Engineer - Cloud Architect, you will be responsible for designing and implementing scalable and secure data solutions on the cloud.Key Responsibilities:Design and implement data architectures on cloud platforms such as...

  • Chief Data Architect

    4 weeks ago

    Melbourne, Victoria, Australia Data Privacy Full time

    About the RoleWe are seeking a highly skilled Chief Data Architect to lead our data architecture efforts and drive business growth through data-driven decision making.Key ResponsibilitiesDevelop and implement a comprehensive data architecture strategy to support business objectivesLead the planning and delivery of data solutions to ensure effective data...

  • Data Architect

    1 month ago

    Melbourne, Victoria, Australia Capgemini Full time

    About the RoleCapgemini is seeking a skilled Data Architect to join our team. As a key member of our Technical/Architecture Design Authority, you will play a crucial role in designing and architecting scalable and efficient data warehouse and data lakehouse solutions using AWS as our cloud platform and Databricks as our data processing platform.Key...

  • Data Architect

    3 weeks ago

    Melbourne, Victoria, Australia FourQuarters Recruitment Full time

    We are seeking a highly skilled Data Architect to join our team at FourQuarters Recruitment. As a Data Architect, you will be responsible for building and maintaining data pipelines to ingest data from source systems as part of a migration to Snowflake for a leading engineering business.Key Responsibilities:Partner with IT and non-technical stakeholders to...

  • Data Architect

    3 weeks ago

    Melbourne, Victoria, Australia Deputy Full time

    **Data Architect Role at Deputy**Deputy is a leading company that empowers businesses to build thriving workplaces. As a Data Architect, you will play a crucial role in enhancing our data and analytics ecosystem. With a focus on scalable design, you will be instrumental in building and optimizing the key components of our data infrastructure to support...

  • Data Architect Manager

    3 weeks ago

    Melbourne, Victoria, Australia Charterhouse Full time

    Job DetailsCharterhouse is seeking a highly skilled Data Architect Manager to join our team.Job Description:Lead the development of industry-leading data engineering practices and design a cutting-edge enterprise data platform on Microsoft Azure.Define strategies for data acquisition, storage, aggregation, and consumption across various levels and...

  • Data Architect

    2 days ago

    Melbourne, Victoria, Australia Worldline Full time

    At Worldline, we are seeking a highly skilled and experienced Data Architect to join our Analytics & Business Intelligence team. This is a full-time role that offers an exciting opportunity to work with cutting-edge data solutions and technologies.We are looking for a talented individual who can design, develop, and implement end-to-end data architectures...

  • Data Engineer

    1 week ago

    Melbourne, Victoria, Australia V2 Digital Full time

    About V2 Digital:We're a dynamic organization looking for a skilled Data Engineer - Cloud Architect to join our team. As part of this role, you'll play a critical part in designing and deploying cutting-edge data platforms in Azure Databricks.This position is ideal for an engineer who thrives at the intersection of platform engineering, data engineering, and...

  • Senior Data Architect

    2 days ago

    Melbourne, Victoria, Australia Infosys Singapore & Australia Full time

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to lead our data engineering team in Singapore and Australia. This is an exceptional opportunity to work with a global leader in consulting and IT services.About the Role:As a Senior Data Architect, you will be responsible for designing and implementing scalable data...

  • Data Architect

    1 month ago

    Melbourne, Victoria, Australia Profusion Group Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Profusion Group. As a Data Architect, you will play a critical part in designing and implementing advanced data solutions on AWS and related technologies.Key Responsibilities:Design Scalable Data Solutions: Perform logical data modeling and schema design, leveraging PySpark and...

  • Data Architect and Engineer Leader

    7 days ago

    Melbourne, Victoria, Australia InfoCentric Full time

    Job Description:We are seeking a highly skilled Data Architect and Engineer Leader to join our team at InfoCentric in Melbourne, Australia.Key Responsibilities:Leverage 3-5 years of experience in IT Industry to develop and maintain data architectures, databases, and large-scale processing systems.Implement and optimize SQL queries and database performance...

  • Data Engineer and Cloud Architect

    2 days ago

    Melbourne, Victoria, Australia InfoCentric Full time

    Senior Data Engineering Role at InfoCentricWe are seeking a seasoned Data Engineer and Cloud Architect to join our team in Melbourne, Australia.About the RoleThis is an excellent opportunity for a highly skilled professional to develop, test, and maintain complex data architectures, including databases and large-scale processing systems, to align with our...

  • Senior Software Engineer

    1 month ago

    Melbourne, Victoria, Australia Carsales Full time

    Job DescriptionWe are seeking a highly skilled Senior Software Engineer - Data Architect to join our team at Carsales. As a key member of our ACIL Tribe, you will be responsible for delivering scalable data architectures and data product development & design best practices.Key Responsibilities:Contributing to the delivery of scalable data architectures, and...

  • Data Architect

    1 month ago

    Melbourne, Victoria, Australia Worldline Full time

    The OpportunityWe are seeking a talented and experienced individual to join the Analytics & Business Intelligence (ABI) team as a full stack Data Architect. In this role, you will be responsible for designing, developing, and implementing end-to-end data solutions that meet our organization's needs. You will work closely with cross-functional teams to...

  • Enterprise Data Architect Lead

    3 days ago

    Melbourne, Victoria, Australia Charterhouse Full time

    Transformative Data Architect Leader WantedWe are seeking a visionary Enterprise Data Architect Lead to spearhead the development of cutting-edge data platforms, driving business growth and innovation.About the Role:Foster a culture of excellence in data engineering by implementing industry-leading practices and designing data solutions for our enterprise...

  • Data Insights Engineer

    2 weeks ago

    Melbourne, Victoria, Australia NTT DATA Full time

    About the RoleAt NTT DATA, we're seeking a seasoned Business Intelligence engineer to join our team. This role is responsible for transforming data into critical information and knowledge that can be used to make sound business decisions.Key Responsibilities:Work as part of a team to deliver modern data solutionsImplementation of modern data platformsElicit...

  • Chief Data Solutions Architect

    2 weeks ago

    Melbourne, Victoria, Australia Zone IT Solutions Full time

    We are seeking a highly skilled Chief Data Solutions Architect to lead the design and implementation of data solutions on the AWS platform using Databricks. This role is ideal for an experienced professional with a strong background in data architecture, data engineering, and cloud computing.About UsZone IT Solutions is a leading Australian recruitment...

  • Data Architect

    4 weeks ago

    Melbourne, Victoria, Australia InfoCentric Full time

    Job Title: Data Architect (AWS)About the Role:We are seeking a highly skilled Data Architect (AWS) to join our team at InfoCentric. As a Data Architect, you will be responsible for designing and implementing data architectures that align with our business needs and strategy.Key Responsibilities:Develop and maintain data architectures, including databases and...

  • Data Engineering Leader

    7 days ago

    Melbourne, Victoria, Australia Charterhouse Full time

    Data Architect ManagerA nationally recognized telecom brand is seeking a Data Architect Manager to lead the development of its enterprise data platform on Microsoft Azure.Salary: $140,000 - $165,000 per annumAbout the Role:We are looking for an experienced Data Architect Manager to join our team in Melbourne. The successful candidate will be responsible for...