Data Engineer Specialist
15 hours ago
At FinXL, we are seeking a highly skilled Data & Platform Engineer to join our team and contribute to the success of our banking client in Sydney.
Job Description:
We are looking for an experienced professional who can provide high-performing and stable platforms, implement monitoring capabilities, and design and develop data pipelines for processing large volumes of data using Apache Spark and AWS. The successful candidate will participate in downstream analysis and end-to-end data flows, contribute to troubleshooting and root cause analysis, and work closely with data architects and platform and infrastructure teams.
Required Skills and Qualifications:
- Extensive experience with Spark, PySpark, SQL, Python, Kafka, and Airflow
- Expertise in AWS technologies including EC2, S3, IAM, EKS, RDS, etc.
- Strong knowledge of big data technologies including Presto or Trino
- Experience with data quality and monitoring tools
- Excellent communication and interpersonal skills
What's on Offer:
- A 12+ month engagement working at a leading banking client
- Hybrid working in Sydney CBD
- A unique opportunity to work on exciting projects with a talented team
-
Data Engineering Specialist
2 days ago
Melbourne, Victoria, Australia ALOIS Solutions Full timeAt ALOIS Solutions, we are seeking an exceptional Data Engineering Specialist to lead our data engineering efforts and drive innovation in our data infrastructure. As a key member of our IT department, you will be responsible for designing and developing data repositories for enterprise business operations and ensuring data pipelines are scalable,...
-
Data Engineer Specialist
2 days ago
Melbourne, Victoria, Australia Xero Full timeJob DescriptionXero is a cloud-based accounting and financial management platform that helps small businesses manage their finances, invoice customers, and track expenses. We are seeking an experienced Data Engineer to join our Marketing Data Science, Analytics & Insights team.In this role, you will be responsible for designing, developing, and implementing...
-
Data Centre Engineer
1 week ago
Melbourne, Victoria, Australia Amazon Full timeCompany OverviewAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. Our team is responsible for ensuring the continuous availability of our customers' applications and data.Job DescriptionYou will join a diverse team of software, hardware, and network engineers, supply chain specialists, security...
-
Data Engineering Specialist
7 days ago
Melbourne, Victoria, Australia Tideri Jobbörse Full timeAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our Financial Services client's data team. As a key member of this team, you will be responsible for feature development in our data ecosystem, including our Data Lake, Customer Mastering System, Data Orchestration, and Cloud-based infrastructure.In this role, you will help build new...
-
Data Engineering Specialist
2 days ago
Melbourne, Victoria, Australia ClearCompany Full timeAbout the RoleWe are seeking a Data Engineer to play a key role in the migration of our client's reporting platform, focusing on back-end systems and data infrastructure.You will be responsible for ensuring seamless data integration, optimizing large-scale data processing, and building robust, scalable data pipelines to support various applications across...
-
Cloud Data Engineer Specialist
6 days ago
Melbourne, Victoria, Australia Paxus - Technology + Digital Talent Full timeJob Description:About PaxusPaxus - Technology + Digital Talent is a dynamic organization dedicated to providing innovative technology solutions.About the RoleWe are seeking a highly skilled Data Engineer with expertise in cloud-based data solutions. This role will focus on building scalable data pipelines, optimizing data workflows, and supporting machine...
-
Data Engineer Specialist
4 days ago
Melbourne, Victoria, Australia InterWorks Full timeJob OverviewWe are seeking a highly skilled data engineer to join our team.Job DescriptionAs a data engineer at InterWorks, you will be responsible for designing, developing, and maintaining large-scale data systems. Your expertise in big data technologies will enable us to provide innovative solutions to our clients.Key ResponsibilitiesTackle diverse...
-
Data Centre Operations Specialist
7 days ago
Melbourne, Victoria, Australia Amazon Full timeWe are seeking a highly skilled and motivated Data Centre Operations Specialist to join our team. The successful candidate will be responsible for the maintenance of our critical infrastructure, ensuring seamless operation of our AWS data centres.This is an exciting opportunity to work with a dynamic team that owns the design, planning, delivery, and...
-
Data Engineer Specialist
7 days ago
Melbourne, Victoria, Australia Cognizant Full timeWe are seeking an expert in data engineering and ETL processes to collaborate with our team on creating solutions for leading companies.Position SummaryThe ideal candidate will have hands-on experience of data integration tools and frameworks, as well as solid knowledge of Unix and SQL.Mandatory SkillsExperience in developing and deploying high-quality...
-
Data Engineering Manager
15 hours ago
Melbourne, Victoria, Australia Australia and New Zealand Banking Group Limited Full timeJob OverviewWe are seeking a Data Engineering Manager to join our team. This is an exciting opportunity to lead our data engineering efforts and drive business growth through advanced analytics.The successful candidate will be responsible for developing and implementing data solutions using various architectural patterns such as Microservices. They will also...
-
Big Data Transformation Specialist
5 days ago
Melbourne, Victoria, Australia Pyramid Global Technologies Full timeAbout the OpportunityJoin us as a Big Data Transformation Specialist at Pyramid Global Technologies and contribute to driving digital transformation through innovative data engineering solutions.Your expertise in designing and deploying Databricks platforms on cloud infrastructure will enable business growth and competitiveness. As a key member of our data...
-
Data Center Commissioning Specialist
2 days ago
Melbourne, Victoria, Australia Amazon Full timeAbout the RoleWe are seeking a highly skilled Data Center Commissioning Specialist to join our AWS Commissioning team. As a Commissioning Engineer, you will play a crucial role in ensuring that our data centers are designed, built, and operated to meet the highest standards of safety, security, and efficiency.
-
Enterprise Data Engineer Specialist
5 days ago
Melbourne, Victoria, Australia Quantexa Limited Full timeJob DescriptionThe Quantexa Delivery team focuses on contextualizing data. As a senior data engineer, you'll bring it all together by implementing our innovative technology across various domains. Working within a fast-paced team, you'll implement end-to-end data pipelines using our award-winning software.Key responsibilities include writing defensive,...
-
Cloud Data Engineer
3 days ago
Melbourne, Victoria, Australia Miller Leith Full timeJob Summary:Miller Leith is looking for an experienced Cloud Data Engineer to join our team. As a key member of our team, you will be responsible for designing, developing, and implementing cloud-based data engineering solutions to support data-driven decision making.Responsibilities:Design and develop cloud-based data pipelines, data lakes, and data...
-
Data Engineer Expert
5 days ago
Melbourne, Victoria, Australia Paxus - Technology + Digital Talent Full timePaxus - Technology + Digital Talent is seeking a skilled Data Engineer to join their team in Melbourne.The role involves working on one of the company's projects, utilizing data engineering skills and expertise.Responsibilities:Utilize experience in data engineering to drive project success.Achieve retail sector expertise through collaboration with...
-
Big Data Engineer
2 days ago
Melbourne, Victoria, Australia ALOIS Solutions Full timeWe are seeking a talented Big Data Engineer to join our team at ALOIS Solutions. As a key member of our IT department, you will be responsible for designing and developing data repositories for enterprise business operations and ensuring data pipelines are scalable, repeatable, and secure.We are looking for a highly skilled professional with relevant...
-
Big Data Engineer
2 days ago
Melbourne, Victoria, Australia Minutes to Seconds Full timeAt Minutes to Seconds, we offer a unique opportunity for a Data Engineer to join our team and contribute to the success of our clients' reporting platforms. As a key member of our team, you will be responsible for designing and implementing efficient data pipelines, ensuring timely and accurate data delivery for business intelligence tools.Your primary...
-
Senior Data Engineer
7 days ago
Melbourne, Victoria, Australia Tideri Jobbörse Full time6 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Quigly are a boutique consultancy with a great network of clients across many industries.Currently we are looking for a Senior Data Engineer for our Financial Services client in their data team to start around March/April of 2025.This is a 6 month...
-
Senior DevOps Engineer Leader
2 days ago
Melbourne, Victoria, Australia NTT DATA, Inc. Full timeAbout the Challenge:NTT DATA, Inc. is looking for a talented Azure DevOps Engineer to take on a challenging role within our company.We require someone with extensive knowledge of Azure DevOps and experience in designing and implementing IaC solutions.This role involves leading the implementation of IaC services, collaborating with engineering and development...
-
Data Engineer Leader
4 days ago
Melbourne, Victoria, Australia Pyramid Global Technologies Full timeAbout the Job:Data Bricks - Solution DesignerThis role focuses on leading data engineering efforts, driving strategic initiatives and solutions that maximize business value from our customers' big data platforms. The successful candidate will have extensive experience in designing, building and deploying large-scale data engineering pipelines into production...