Data Engineer with Python

4 weeks ago


Banana Shire, Australia Luxoft Full time

Project Description:

Our client, a top-tier global financial group, is in the process of Digital Transformation across their Americas Division, as they continue to modernize technology, focus on a data-driven approach, grow, and plan for the future.

Our technology stack contains Python and MS SQL, with processes running both on-prem and in Azure. Our main Python libraries include: Pandas, PySpark, and PyArrow.

We are looking to expand and build a Global team to help us build a new unified Data Warehouse to support the latest Banking Data needs.

Responsibilities:

  1. Hands-on development using Python and SQL
  2. Building a new Data Warehouse onboarded to Azure
  3. Support BAU activities
  4. Work with in-house application development teams responsible for payment processes, collateral, accounting, and regulatory reporting processes in the bank
  5. Continuous improvement of the development and release environment, tooling, and processes

Mandatory Skills Description:

  1. Minimum 7 years of hands-on development using Python
  2. Experience in a large & complex application development environment, preferably in the financial services industry and on data-heavy applications and systems
  3. Proven experience as an Azure Data Engineer or in a similar role
  4. Familiarity with Azure cloud services, Azure Data Factory, Gen 2, Azure Databases, Functions, etc.
  5. Strong SQL skills with experience in any RDMS
  6. Good understanding of ETL/ELT
  7. Working experience in Databricks, SQL Auto loader will be a plus
  8. Good understanding of DevOps lifecycle (git, Jenkins, etc.)
  9. Experience with Jira/Confluence
  10. Good problem-solving skills

Nice-to-Have Skills Description:

  1. Experience working in Agile/Scrum projects
  2. Experience working with a global team, good communication and interpersonal skills
  3. Good understanding of computer fundamentals - OOP concepts, basic data structures, algorithms, relational algebra, basic understanding of networking, cloud computing, etc.

Languages:

Seniority level: Mid-Senior level

Employment type: Full-time

Job function: Information Technology

Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at Luxoft by 2x.

#J-18808-Ljbffr

  • Banana Shire, Australia beBee Careers Full time

    We are seeking an experienced Global Data Warehouse Engineer to help build a unified data warehouse supporting the latest banking data needs for a top-tier global financial group.The Americas Division is undergoing digital transformation, modernizing technology and focusing on data-driven approaches, growth and planning for the future.We use Python and MS...


  • Banana Shire, Australia beBee Careers Full time

    Data Engineer Position OverviewWe are seeking a skilled and experienced Data Engineer to play a pivotal role in our data-driven initiatives. As part of a multidisciplinary team, you will collaborate with data engineers, machine learning engineers, and application developers to encounter numerous technical challenges and contribute to innovative projects.Key...


  • Banana Shire, Australia Provectus Full time

    We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical...


  • Banana Shire, Australia beBee Careers Full time

    Data Engineering Job DescriptionWe are looking for a highly skilled Data Engineer to join our team and drive the development of data solutions. As a key member of our multidisciplinary team, you will work closely with data engineers, machine learning engineers, and application developers to design, build, and maintain scalable data pipelines and...


  • Banana Shire, Australia beBee Careers Full time

    Data Engineer Role SummaryA seasoned Data Engineer is required to drive the development and implementation of data solutions. You will work closely with cross-functional teams to design, build, and maintain scalable data pipelines and infrastructure. This position offers an excellent opportunity for professional growth and contribution to cutting-edge...


  • Banana, Australia Provectus Full time

    We are seeking a talented and experienced Data Engineer to join Provectus. Our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, require collaboration with data engineers, machine learning engineers, and application developers.Key Responsibilities:Collaborate closely with clients to understand their IT...


  • Banana, Australia EPAM Systems Full time

    We are seeking a motivated and capable Middle Python Engineer to join our team at EPAM Systems.Our client is one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.Key ResponsibilitiesCollaborate with cross-functional teams to develop high-quality software solutions.Write clean, maintainable code...


  • Banana, Australia EPAM Systems Full time

    Senior Data Software Engineer (Python, GCP)We are seeking a Senior Data Software Engineer to contribute to a project in the telecommunications sector. This project focuses on creating network infrastructure for high-speed internet access using fiber optic communication.This role offers opportunities to learn as our client is a leading American multinational...


  • Banana Shire, Australia beBee Careers Full time

    Job SummaryWe are looking for an experienced Data Engineer to lead our data management initiatives. As a Data Engineer, you will oversee the design, development, and deployment of high-performance data management systems. You will collaborate with cross-functional teams to develop innovative solutions that drive business growth.Main Responsibilities:Lead...

  • Data Engineer

    4 weeks ago


    Banana, Australia PRIME IMMIGRATION LTD Full time

    Job OverviewWe are seeking an exceptional Data Architect Manager/Data Engineer to lead our team in designing, building, and maintaining highly scalable data management systems.Key ResponsibilitiesData Architecture: Design and implement big data solutions, data construction, installation, testing, and maintenance of data management systems that meet business...