Senior Consultant- Databricks, ADF

Overview

Senior Consultant- Databricks, ADF Consultant

Infosys is seeking a highly skilled and motivated Senior Consultant to join our DNA team in Melbourne. The role focuses on delivering high-quality data solutions, building and maintaining a complete data stack (integrations, data warehouse, data transformations, and services that push data into other tools), and constructing resilient, secure, high-performance infrastructure for ETL/ELT processes from diverse data sources using SQL, data lake, and Databricks technologies. You will contribute to data and AI-led transformation initiatives for the client and be involved in the execution and delivery of engagements.

Responsibilities

- Deliver high-quality data solutions and build/maintain a complete data stack (integrations, data warehouse, data transformations, and data push services).
- Design, build, and maintain scalable, reliable data pipelines (ETL/ELT) from various sources into data warehouses and data lakes.
- Develop and implement data models, schemas, and architectures ensuring data quality, integrity, performance, and availability.
- Implement ETL processes, data warehousing, and potentially deploy machine learning models.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver data-driven solutions.
- Identify and resolve complex data-related issues, analyze performance bottlenecks, and optimize systems for efficiency.
- Mentor and guide data engineers; lead projects and initiatives; contribute to continuous improvement and innovation.

Qualifications

- Excellent hands-on development experience in data engineering, data storage, analytics, and visualization tools.
- Expertise in creating efficient data pipelines and optimizing data storage, processing, and accessibility.
- Strong experience with relational databases, data modeling principles, and data architecture design.
- Ability to design, build, and maintain batch or real-time data pipelines; proficiency in SQL and scripting languages.
- Experience with cloud Data Warehouse solutions (Snowflake, Redshift, BigQuery, Azure) and data ingestion tools (Fivetran, Stitch, Matillion).
- Experience with big data technologies (Hadoop, Spark, Kafka, Cassandra) and cloud platforms (AWS, Azure, GCP).
- Proficiency with data visualization tools (Tableau, Power BI) and CI/CD practices; experience with source control (Git).
- Strong analytical and problem-solving skills; ability to learn new tools and technologies and stay current with industry trends.

Requirements

- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
- Proficiency in Python, Java, Scala, or R for data processing.
- Experience with data orchestration/workflow tools (Airflow, Azkaban) and scripting (Bash).
- Experience with distributed data processing environments and tools (Hadoop, Spark) and cloud services.
- Experience with data visualization and reporting tools (Tableau, Power BI).
- Ability to mentor teammates; strong communication and stakeholder engagement skills.
- Commitment to diversity and inclusion; equal opportunity employer.
- Other notes: Infosys ANZ section and recruitment process considerations as described in the original text.

All aspects of employment at Infosys are based on merit, competence and performance. Infosys is an equal opportunity employer. If you require adjustments to the recruitment process due to disability, illness, or injury, please contact our Recruitment team at Infosys_ta@infosys.com. Infosys does not accept unsolicited resumes from third-party vendors unless under a signed agreement; recruitment is coordinated through the Talent Acquisition department.

#J-18808-Ljbffr