Data Engineer with Python

3 weeks ago


Banana Shire, Australia Luxoft Full time

Project Description:

Our client, a top-tier global financial group, is in the process of Digital Transformation across their Americas Division, as they continue to modernize technology, focus on a data-driven approach, grow, and plan for the future.

Our technology stack contains Python and MS SQL, with processes running both on-prem and in Azure. Our main Python libraries include: Pandas, PySpark, and PyArrow.

We are looking to expand and build a Global team to help us build a new unified Data Warehouse to support the latest Banking Data needs.

Responsibilities:

  1. Hands-on development using Python and SQL
  2. Building a new Data Warehouse onboarded to Azure
  3. Support BAU activities
  4. Work with in-house application development teams responsible for payment processes, collateral, accounting, and regulatory reporting processes in the bank
  5. Continuous improvement of the development and release environment, tooling, and processes

Mandatory Skills Description:

  1. Minimum 7 years of hands-on development using Python
  2. Experience in a large & complex application development environment, preferably in the financial services industry and on data-heavy applications and systems
  3. Proven experience as an Azure Data Engineer or in a similar role
  4. Familiarity with Azure cloud services, Azure Data Factory, Gen 2, Azure Databases, Functions, etc.
  5. Strong SQL skills with experience in any RDMS
  6. Good understanding of ETL/ELT
  7. Working experience in Databricks, SQL Auto loader will be a plus
  8. Good understanding of DevOps lifecycle (git, Jenkins, etc.)
  9. Experience with Jira/Confluence
  10. Good problem-solving skills

Nice-to-Have Skills Description:

  1. Experience working in Agile/Scrum projects
  2. Experience working with a global team, good communication and interpersonal skills
  3. Good understanding of computer fundamentals - OOP concepts, basic data structures, algorithms, relational algebra, basic understanding of networking, cloud computing, etc.

Languages:

Seniority level: Mid-Senior level

Employment type: Full-time

Job function: Information Technology

Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at Luxoft by 2x.

#J-18808-Ljbffr

  • Banana Shire, Australia Luxoft Full time

    Company OverviewLuxoft is a top-tier global financial group, dedicated to digital transformation. Our mission is to modernize technology, focus on data-driven approaches, and grow for the future.Job DescriptionWe are seeking a skilled Data Engineer to join our team and contribute to building a unified Data Warehouse in Azure. As a member of our team, you...


  • Banana Shire, Australia Luxoft Full time

    Job SummaryWe are looking for a highly skilled Python Data Engineer to join our team and contribute to building a unified Data Warehouse in Azure. This role offers an opportunity to work with a leading global financial group and develop a new Data Warehouse using Python and SQL.About the JobIn this role, you will work on developing a new Data Warehouse,...

  • Data Engineer

    3 weeks ago


    Banana Shire, Australia Explore Group Full time

    Get AI-powered advice on this job and more exclusive features.Senior Data Engineer | AI-Powered Publishing | High-Growth StartupWe are building the future of AI-driven publishing and entertainment, using machine learning and predictive algorithms to discover untapped stories and transform them into global hits. With a data-first approach, our company has...

  • Big Data Engineer

    4 days ago


    Banana Shire, Australia Provectus Full time

    We are looking for a skilled data engineer to join our team at Provectus. The successful candidate will have expertise in data governance aspects like quality, discovery, lineage, security, business glossary, modeling, master data, and cost optimization.Required SkillsExperience in data engineering;Experience working with cloud data platforms (e.g.,...


  • Banana Shire, Australia EPAM Systems Full time

    As a member of our engineering team, you will be responsible for designing and implementing software solutions using Python and AWS.This role offers the opportunity to work in a dynamic environment with a talented team of engineers and professionals.Main ResponsibilitiesCollaborate with colleagues to develop high-quality software solutions.Write efficient,...


  • Banana Shire, Australia Luxoft Full time

    Senior QA Engineer with Python SkillsWe are seeking an experienced Senior QA Engineer to join our team. In this role, you will be responsible for ensuring the quality and performance of our applications, video conferencing solutions, and audio devices.Key Responsibilities:Design and develop automated tests using Python and SeleniumCollaborate with...


  • Banana Shire, Australia EPAM Systems Full time

    We are seeking a highly skilled and experienced Senior Software Engineer with expertise in Python and AWS for our client, one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.This is a hybrid role requiring 3 days of work per week from our office in Gdansk or Krakow.ResponsibilitiesWork closely...

  • Data Engineer

    2 weeks ago


    Banana, Australia Explore Group Full time

    Get AI-powered advice on this job and more exclusive features.Senior Data Engineer | AI-Powered Publishing | High-Growth StartupWe are building the future of AI-driven publishing and entertainment, using machine learning and predictive algorithms to discover untapped stories and transform them into global hits. With a data-first approach, our company has...


  • Banana Shire, Australia EPAM Systems Full time

    We are seeking a motivated and capable Middle Python Engineer with skills in Python and AWS to join our team. Our client is one of the largest providers of mutual funds and the second-largest provider of exchange-traded funds in the world.This is a hybrid role with 3 days of work from our office in Gdansk or Krakow.ResponsibilitiesAssist cross-functional...


  • Banana Shire, Australia Provectus Full time

    Required Skills and QualificationsTo succeed in this role, you must have:Key Requirements:Experience in data solution architectureProven experience in designing and implementing large-scale data engineering solutions on AWSExperience with Databricks, GCP, or Azure solutions is requiredDeep expertise in AWS platform services, including S3, EC2, Lambda, EMR,...


  • Banana Shire, Australia NorthGravity Full time

    We're on the lookout for a talented Client Success Manager to help us build cutting-edge data platforms for leading financial and energy sector clients. As a Client Success Manager, you'll work directly with English-speaking clients to understand and refine their data needs.You'll play a key role in shaping our product and influencing decisions. Our tech...


  • Banana Shire, Australia Provectus Full time

    We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical...


  • Banana Shire, Australia Luxoft Full time

    Role SummaryLuxoft is seeking a highly skilled Azure Data Warehouse Developer to join our team and contribute to building a unified Data Warehouse in Azure. This role offers an opportunity to work with a leading global financial group and develop a new Data Warehouse using Python and SQL.About the JobIn this role, you will work on developing a new Data...


  • Banana, Australia Luxoft Poland Full time

    Automation Software Test Engineer with PythonLuxoft Poland is seeking an experienced Automation Software Test Engineer to join our team.The ideal candidate will possess expertise in automation testing, including manual and automated testing, as well as a strong understanding of functional and design patterns.Key responsibilities include ensuring the quality...


  • Banana Shire, Australia EPAM Systems Full time

    As a Senior Python Engineer for Global Projects, you will be responsible for designing and developing high-quality software solutions for our clients. We are looking for an experienced professional who can lead cross-functional teams and contribute to the growth of our company.Our company is committed to having a positive impact on our customers, employees,...


  • Banana Shire, Australia Luxoft Full time

    Middle Automation Software Test Engineer with PythonLuxoft is hiring a Automation Software Test Engineer to ensure the quality and performance of applications, video conferencing solutions, and audio devices. The role involves manual and automated testing, collaborating with cross-functional teams, and identifying areas for improvement. As a member of our...


  • Banana Shire, Australia Luxoft Full time

    Regular Automation Software Test Engineer with PythonProject Description:Luxoft is hiring an Automation Software Test Engineer to ensure the quality and performance of applications, video conferencing solutions, and audio devices. The role involves manual and automated testing, collaborating with cross-functional teams, and identifying areas for improvement....

  • Data Engineer

    3 weeks ago


    Banana Shire, Australia G2A Group Full time

    G2A.COM is the world's largest marketplace for digital entertainment. On our platform, over 30 million people from 180 countries have already purchased more than 100 million digital items. Why? Sellers from all over the world present a rich offering of over 75,000 digital codes for games, software, gift cards, subscriptions, DLCs, in-game items, and various...


  • Banana Shire, Australia EPAM Systems Full time

    We are looking for an experienced software engineer to join our team and help us deliver high-quality solutions using Python and AWS.This role requires collaboration with cross-functional teams and the ability to work in a fast-paced environment.About the PositionDesign and implement software solutions that meet the highest standards.Write clean,...


  • Banana, Australia Luxoft Full time

    Job OverviewLuxoft is seeking a skilled Data Engineering Lead to join our team. This role involves designing and implementing cloud-based data processing platforms for large datasets, ensuring efficient management and real-time analysis.The ideal candidate will have experience with ETL/ELT pipelines, Azure data solution, ADLSv2, Azure Data Factory,...