Azure Data Factory Engineer

- Collaborating with team members and stakeholders to design data integration solutions that meet business requirements, utilising Microsoft Azure tools such as Azure Data Factory and SQL.
- Develop, implement, and maintain ETL pipelines to ensure efficient and secure data transfer between various systems, adhering to best practices for data processing and transformation.
- Design and maintain data models, ensuring data accuracy, consistency, and availability while considering scalability and performance optimisations.
- Implement data validation and quality checks to identify and rectify data anomalies, errors, and inconsistencies within integrated systems.
- Continuously monitor and optimise data integration processes to enhance performance, reduce latency, and minimise resource consumption.
- Create and maintain comprehensive documentation for data integration solutions, including technical specifications, data flow diagrams, and operational procedures.
- Work closely with cross-functional teams, including developers, and system analysts, to understand data requirements and ensure integrations align with business objectives.
- Troubleshoot and resolve data integration issues, working collaboratively with the team to implement effective solutions and prevent recurrence.

Job Overview

- Collaborating with team members and stakeholders to design data integration solutions that meet business requirements, utilising Microsoft Azure tools such as Azure Data Factory and SQL.
- Develop, implement, and maintain ETL pipelines to ensure efficient and secure data transfer between various systems, adhering to best practices for data processing and transformation.
- Design and maintain data models, ensuring data accuracy, consistency, and availability while considering scalability and performance optimisations.
- Implement data validation and quality checks to identify and rectify data anomalies, errors, and inconsistencies within integrated systems.
- Continuously monitor and optimise data integration processes to enhance performance, reduce latency, and minimise resource consumption.
- Create and maintain comprehensive documentation for data integration solutions, including technical specifications, data flow diagrams, and operational procedures.
- Work closely with cross-functional teams, including developers, and system analysts, to understand data requirements and ensure integrations align with business objectives.
- Troubleshoot and resolve data integration issues, working collaboratively with the team to implement effective solutions and prevent recurrence.

Job Requirement

- Proficient in Microsoft Azure Data Factory.
- Experienced in data engineering, integration, ETL, and data modelling.
- Strong SQL skills and understanding of data warehousing.
- Knowledgeable in data governance, security, and compliance.

Job Location

Canberra / Sydney

If you are interested in the above job opportunity, please apply through the links provided or please feel free to contact Newmanfor more details.

newman.ponniah@calleo.com.au
0404 331 242

Due to the nature of this role, this job is open to Australian Citizens only. Candidates who currently hold or able to obtain Federal Government Security Clearances are highly desirable.

Calleo is an equal opportunity employer and we encourage applications from all people including Aboriginal and Torres Strait Islander peoples.

Follow Calleo on LinkedIn and visit our website to keep up to date on all our current job vacancies:
www.linkedin.com/company/calleoresourcing
www.calleo.com.au
#J-18808-Ljbffr

---