Data Engineer

Infosys is seeking a highly skilled and motivated Senior Consultant to join our DNA team. As a Senior Consultant you will be responsible for delivering high-quality data solutions, build and maintain an entire data stack that includes a wide variety of integrations that ingest data, a data warehouse, a pipeline of data transformations, and several services that push data into other tools. You will also be responsible for building resilient, secure high-performance infrastructure required for optimal ETL/ELT processes from a wide variety of data sources using SQL, data lake, databricks technologies, and contributing to high-end innovative technological solutions with the client to develop data and AI led initiatives for transformation. You would be involved in the execution and delivery of such engagements, playing a key role.

Location: Melbourne

Salary Range: 108571 - 119893 AUD Annual Gross

Please Note: The above salary range is only indicative and maybe subject to suitable enhancements, based on internal company processes

Responsibilities:

• Excellent hands-on development experience in data engineering, data storage, analytics, and visualization tools and technologies
• Expertise in various technologies and methodologies to create efficient data pipelines, optimize data storage, processing and accessibility
• Work with data scientists, analysts, and business stakeholders to understand data requirements, develop and deliver data-driven solutions
• Designing, building, and maintaining scalable and reliable data pipelines for extracting, transforming, and loading (ETL/ELT) data from various sources into data warehouses and data lakes
• Defining and implementing data models, schemas, and architectures that ensure data quality, consistency, optimal performance, integrity and availability
• Experience in ETL process implementation, data warehousing, and potentially deploying machine learning models
• Experience in data modeling principles and data architecture design
• Ability to identify and resolve complex data-related issues, analyze performance bottlenecks, develop creative solutions and optimize systems for efficiency
• Managing and optimizing data warehousing solutions for efficient data storage and retrieval, performance and scalability
• Design, build and maintain batch or real-time data pipelines
• Advanced skills and experience with relational databases and database design
• Ability to write clean, efficient, and well-documented code

Requirements:

• Bachelor's degree in computer science, Engineering, Information Systems, or related field
• Proficiency in languages like Python, Java, Scala, R, with experience in building and optimizing code for data processing
• Experience working with cloud Data Warehouse solutions such as Snowflake, Redshift, BigQuery, Azure
• Experience working with data ingestion tools such as Fivetran, Stitch, Matillion
• Strong proficiency in scripting languages like Bash
• Strong proficiency in data pipeline and workflow management tools like Airflow, Azkaban
• Experience with big data technologies such as Hadoop, Spark, Kafka, Cassandra, and cloud-based solutions AWS EMR, Azure HDInsight, Google Cloud Dataproc
• Deep understanding of data modeling techniques, data warehousing principles, and experience with tools like Snowflake, Redshift, BigQuery
• Experience with cloud platforms (AWS, Azure, GCP) and their related services
• Proficiency in SQL and strong knowledge of various database technologies
• Expertise in designing and implementing efficient ETL and ELT pipelines
• Experience in data visualization tools like Tableau and Power BI
• Strong experience with data modelling techniques
• Strong analytical and problem-solving skills
• Provide guidance and mentorship to data engineers, leading projects and initiatives
• Keeping abreast of the latest trends and technologies in big data engineering and continuously learning and adopting new tools and techniques
• Experience with software engineering practices including CI/CD, Automated testing and Performance Engineering
• Experience working with distributed version control and source code management tools such as Git
• Experience in bringing initiatives and innovations that help simplify processes and automate monotonous tasks
• Flexibility in multitasking and able to contribute beyond squad/team
• Experience working with Connect-Direct and Ctrl-M Scheduler, Elastic Search (ELK Stack), Splunk

Equality and Accessibility:

All aspects of employment at Infosys are based on merit, competence and performance. We are committed to embracing diversity and creating an inclusive environment for all employees. Infosys is proud to be an equal opportunity employer.

Adjustment requests: If you are a person with disability, illness or injury and require adjustments to the recruitment and selection process, please contact our Recruitment team for adjustment at Infosys_ta@infosys.com, or indicate your preferred method of communication in your email and someone will be in touch.

Other notices: Infosys does not accept unsolicited resumes from third party vendors. In the absence of a signed agreement any submission will be deemed as non-binding and Infosys explicitly reserves the right to pursue and hire the submitted profile. All recruitment activity must be coordinated through the Talent Acquisition department.

Check out why you should join Infosys.

• Mid-Senior level

• Full-time

• Engineering, Information Technology, and Consulting
• Industries IT Services and IT Consulting and Insurance