Data Engineer with Python

3 weeks ago


Banana, Australia Luxoft Full time

Project Description:

Our client, a top-tier global financial group, is in the process of Digital Transformation across their Americas Division, as they continue to modernize technology, focus on a data-driven approach, grow, and plan for the future.

Our technology stack contains Python and MS SQL, with processes running both on-prem and in Azure. Our main Python libraries include: Pandas, PySpark, and PyArrow.

We are looking to expand and build a Global team to help us build a new unified Data Warehouse to support the latest Banking Data needs.

Responsibilities:

  1. Hands-on development using Python and SQL
  2. Building a new Data Warehouse onboarded to Azure
  3. Support BAU activities
  4. Work with in-house application development teams responsible for payment processes, collateral, accounting, and regulatory reporting processes in the bank
  5. Continuous improvement of the development and release environment, tooling, and processes

Mandatory Skills Description:

  1. Minimum 7 years of hands-on development using Python
  2. Experience in a large & complex application development environment, preferably in the financial services industry and on data-heavy applications and systems
  3. Proven experience as an Azure Data Engineer or in a similar role
  4. Familiarity with Azure cloud services, Azure Data Factory, Gen 2, Azure Databases, Functions, etc.
  5. Strong SQL skills with experience in any RDMS
  6. Good understanding of ETL/ELT
  7. Working experience in Databricks, SQL Auto loader will be a plus
  8. Good understanding of DevOps lifecycle (git, Jenkins, etc.)
  9. Experience with Jira/Confluence
  10. Good problem-solving skills

Nice-to-Have Skills Description:

  1. Experience working in Agile/Scrum projects
  2. Experience working with a global team, good communication and interpersonal skills
  3. Good understanding of computer fundamentals - OOP concepts, basic data structures, algorithms, relational algebra, basic understanding of networking, cloud computing, etc.

Languages:

Seniority level: Mid-Senior level

Employment type: Full-time

Job function: Information Technology

Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at Luxoft by 2x.

#J-18808-Ljbffr

  • Banana Shire, Australia Luxoft Full time

    Project Description:Our client, a top-tier global financial group, is in the process of Digital Transformation across their Americas Division, as they continue to modernize technology, focus on a data-driven approach, grow, and plan for the future.Our technology stack contains Python and MS SQL, with processes running both on-prem and in Azure. Our main...


  • Banana, Australia EPAM Systems Full time

    We are seeking a highly skilled and experienced Senior Software Engineer with expertise in Python and AWS for our client, one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.This is a hybrid role requiring 3 days of work per week from our office in Gdansk or Krakow.ResponsibilitiesWork closely...


  • Banana, Australia Provectus Full time

    We are seeking a talented and experienced Data Engineer to join Provectus. Our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, require collaboration with data engineers, machine learning engineers, and application developers.Key Responsibilities:Collaborate closely with clients to understand their IT...

  • Cloud Data Engineer

    4 days ago


    Banana, Australia beBee Careers Full time

    Data Engineering ExpertiseThe ideal candidate will have no less than 7 years of hands-on experience using Python, a background in complex application development environments, preferably within the financial services industry and working on data-intensive applications and systems, demonstrated expertise as an Azure Data Engineer or similar role, familiarity...


  • Banana, Australia beBee Careers Full time

    As a key player in our diverse practices, you will collaborate with data engineers, machine learning engineers, and application developers to drive innovation and growth.Responsibilities:Collaborate closely with clients to understand their needs and goals;Develop and manage large-scale data systems;Design and implement efficient data pipelines that feed Data...


  • Banana, Australia EPAM Systems Full time

    We are seeking a motivated and capable Middle Python Engineer to join our team at EPAM Systems.Our client is one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.Key ResponsibilitiesCollaborate with cross-functional teams to develop high-quality software solutions.Write clean, maintainable code...


  • Banana, Australia EPAM Systems Full time

    We are seeking a motivated and capable Middle Python Engineer with skills in Python and AWS to join our team. Our client is one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.This is a hybrid role with 3 days of work from our office in Gdansk or Krakow.ResponsibilitiesAssist cross-functional...


  • Banana, Australia Provectus Full time

    We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical...


  • Banana, Australia EPAM Systems Full time

    Senior Data Software Engineer (Python, GCP)We are seeking a Senior Data Software Engineer to contribute to a project in the telecommunications sector. This project focuses on creating network infrastructure for high-speed internet access using fiber optic communication.This role offers opportunities to learn as our client is a leading American multinational...


  • Banana Shire, Australia EPAM Systems Full time

    We are seeking a motivated and capable Middle Python Engineer with skills in Python and AWS to join our team. Our client is one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.This is a hybrid role with 3 days of work from our office in Gdansk or Krakow.ResponsibilitiesAssist cross-functional...