Data Engineer with Python
4 weeks ago
Project Description:
Our client, a top-tier global financial group, is in the process of Digital Transformation across their Americas Division, as they continue to modernize technology, focus on a data-driven approach, grow, and plan for the future.
Our technology stack contains Python and MS SQL, with processes running both on-prem and in Azure. Our main Python libraries include: Pandas, PySpark, and PyArrow.
We are looking to expand and build a Global team to help us build a new unified Data Warehouse to support the latest Banking Data needs.
Responsibilities:
- Hands-on development using Python and SQL
- Building a new Data Warehouse onboarded to Azure
- Support BAU activities
- Work with in-house application development teams responsible for payment processes, collateral, accounting, and regulatory reporting processes in the bank
- Continuous improvement of the development and release environment, tooling, and processes
Mandatory Skills Description:
- Minimum 7 years of hands-on development using Python
- Experience in a large & complex application development environment, preferably in the financial services industry and on data-heavy applications and systems
- Proven experience as an Azure Data Engineer or in a similar role
- Familiarity with Azure cloud services, Azure Data Factory, Gen 2, Azure Databases, Functions, etc.
- Strong SQL skills with experience in any RDMS
- Good understanding of ETL/ELT
- Working experience in Databricks, SQL Auto loader will be a plus
- Good understanding of DevOps lifecycle (git, Jenkins, etc.)
- Experience with Jira/Confluence
- Good problem-solving skills
Nice-to-Have Skills Description:
- Experience working in Agile/Scrum projects
- Experience working with a global team, good communication and interpersonal skills
- Good understanding of computer fundamentals - OOP concepts, basic data structures, algorithms, relational algebra, basic understanding of networking, cloud computing, etc.
Languages:
Seniority level: Mid-Senior level
Employment type: Full-time
Job function: Information Technology
Industries: IT Services and IT Consulting
Referrals increase your chances of interviewing at Luxoft by 2x.
#J-18808-Ljbffr-
Banana Shire, Australia beBee Careers Full timeWe are seeking an experienced Global Data Warehouse Engineer to help build a unified data warehouse supporting the latest banking data needs for a top-tier global financial group.The Americas Division is undergoing digital transformation, modernizing technology and focusing on data-driven approaches, growth and planning for the future.We use Python and MS...
-
Data Engineer Position Overview
5 days ago
Banana Shire, Australia beBee Careers Full timeData Engineer Position OverviewWe are seeking a skilled and experienced Data Engineer to play a pivotal role in our data-driven initiatives. As part of a multidisciplinary team, you will collaborate with data engineers, machine learning engineers, and application developers to encounter numerous technical challenges and contribute to innovative projects.Key...
-
Middle/Senior Data Engineer
4 weeks ago
Banana Shire, Australia Provectus Full timeWe are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical...
-
Experienced Data Engineer Job Description
5 days ago
Banana Shire, Australia beBee Careers Full timeData Engineering Job DescriptionWe are looking for a highly skilled Data Engineer to join our team and drive the development of data solutions. As a key member of our multidisciplinary team, you will work closely with data engineers, machine learning engineers, and application developers to design, build, and maintain scalable data pipelines and...
-
Senior Data Engineer Role Summary
5 days ago
Banana Shire, Australia beBee Careers Full timeData Engineer Role SummaryA seasoned Data Engineer is required to drive the development and implementation of data solutions. You will work closely with cross-functional teams to design, build, and maintain scalable data pipelines and infrastructure. This position offers an excellent opportunity for professional growth and contribution to cutting-edge...
-
Middle/Senior Data Engineer
4 weeks ago
Banana, Australia Provectus Full timeWe are seeking a talented and experienced Data Engineer to join Provectus. Our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, require collaboration with data engineers, machine learning engineers, and application developers.Key Responsibilities:Collaborate closely with clients to understand their IT...
-
Middle Python Engineer with AWS
4 weeks ago
Banana, Australia EPAM Systems Full timeWe are seeking a motivated and capable Middle Python Engineer to join our team at EPAM Systems.Our client is one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.Key ResponsibilitiesCollaborate with cross-functional teams to develop high-quality software solutions.Write clean, maintainable code...
-
Senior Data Software Engineer
4 weeks ago
Banana, Australia EPAM Systems Full timeSenior Data Software Engineer (Python, GCP)We are seeking a Senior Data Software Engineer to contribute to a project in the telecommunications sector. This project focuses on creating network infrastructure for high-speed internet access using fiber optic communication.This role offers opportunities to learn as our client is a leading American multinational...
-
High Performance Data Engineer
5 days ago
Banana Shire, Australia beBee Careers Full timeJob SummaryWe are looking for an experienced Data Engineer to lead our data management initiatives. As a Data Engineer, you will oversee the design, development, and deployment of high-performance data management systems. You will collaborate with cross-functional teams to develop innovative solutions that drive business growth.Main Responsibilities:Lead...
-
Data Engineer
4 weeks ago
Banana, Australia PRIME IMMIGRATION LTD Full timeJob OverviewWe are seeking an exceptional Data Architect Manager/Data Engineer to lead our team in designing, building, and maintaining highly scalable data management systems.Key ResponsibilitiesData Architecture: Design and implement big data solutions, data construction, installation, testing, and maintenance of data management systems that meet business...