
Associate
1 week ago
**Position Summary**:
Data Engineer with 4+ years of experience with end-to-end Big Data Pipeline design, ETL pipeline build using Apache Spark, Hive, Py-Spark and also having a hand-on experience in building of real-time data pipeline using HBase and Hadoop ecosystem. Also worked on mainly Agile methodology. Working for service-based IT consultancies have provided me the opportunities to work for different clients all over the globe. This has exposed me to different types of enterprise environments, which helped me gain knowledge in terms of technology, people, process and delivery.
**Mandatory Skills**:
1. **Skills/Tools**: Apache Spark, MapReduce, Sqoop, Py-spark, Spark SQL
2. **Database**:Hive, MySQL, Oracle
3. **Language and No-SQL**: Python and HBase
4. **Build Tools**: Expertise in setting up and managing continuous integration and continuous deployment pipelines in Bitbucket and Jenkins
5. **Job Scheduler**: Familiarity with control-M scheduling tool for ordering the Job pipeline.
6. **Monitoring and Logging**: Skills in using monitoring tools and analysing the root cause using Spark Logs
7. **Security and Compliance**: Understanding of security best practices and compliance requirements
8. **Business Domain Knowledge**:Banking (BFSI)
**Duties and Responsibilities**:
1. Being part of the Data Product team, building the data Transformation
- more precisely on Dara Transform
2. Built a data product which will be able to collect customer data from various sources from raw layer to create comprehensive customer profiles into different layers.
3. Built and end-end Metadata driven data Quality Framework that can be utilized across different projects which consists of Metadata, Attribute and Process sheets.
4. Involved in Building Python Scripts for temporary transformation tables using Py-spark and Spark SQL before populating the records into SCD Table
5. Have good knowledge on SCD type 2 logics to maintain both history and active Records.
6. Have worked on Analyzing the jobs and providing RCA if issues raised post sprint Release.
7. Took part in Implementation and Design Walkthrough with various teams and worked on Production Deployment on change related Activities.
8. Proven Experience in delivering projects successfully through effective planning, prioritizing, team building, task scheduling and tracking scheduled tasks.
9. Utilize Atlassian tools, including Jira, confluence, and Bitbucket, for project management and team collaboration.
Involved on doing the Tech PIV and testing the functionality of the tables as part of Production Implementation.
**Qualifications & Certifications (Optional)**:
**Individual Contribution**:Received several GEM Awards for the succession of Prod Implementations
**Salary Range**: $60,000-$75,000
**Date of Posting**: 11/September/2025
LI-CTSAPAC
-
Associate
3 days ago
Sydney, Australia Commonwealth Bank Full time**You are ambitious**: - **We are a specialised property lending team with a diverse mix of experience.**: - **Together we can drive sustainable business growth for our clients** **See**Yourself**In**Our**Team**: The Major Client Group serves over 1,000 clients in the large business segment across Australia with annual revenue >$150m and complex financial...
-
Associate
4 days ago
Sydney, Australia LGT Crestone Wealth Management Full timeMin Experience- 2 yearsYour team - A part of the client facing Advisory team including the National Associate Manager, Investment Advisers and Associates. - Working as part of the broader organisation of employees including: - Support roles including Office Manager, Front of House and Reception, Executive Assistant. - Operations team. - Specialists within...
-
Associate
4 days ago
Sydney, Australia Commonwealth Bank of Australia Full timeAssociate - You are ambitious - We value your ongoing professional development - Together we can drive sustainable business growth for our clients - Sydney CBD based only - 2x Positions Available **See yourself in our team**: Business Banking Client Services (BBCS) partners with frontline and specialist teams to meet the in-life Commercial Lending needs of...
-
Associate
2 weeks ago
Sydney, Australia ASPECT Studios Full timeJob Title- Associate- Location- Sydney - AU (Primary)- Employment Type- Full-time Permanent- Job DescriptionThe Studio ASPECT Studios is a purpose-orientated, design-led landscape architecture and urban design practice. Operating across Australia, Asia, the Middle East and the UK, our studios believe in the power of design to positively change people’s...
-
Associate
2 days ago
Sydney, New South Wales, Australia LGT Crestone Wealth Management Limited Full time $104,000 - $130,878 per yearLGT Crestone was formed around a clear and uncompromising vision – to bring global best practice in building institutional quality investment portfolios to Australian clients.With a shared passion for building an uncompromised business – we created something new from the ground up. A chance to leave behind the things that weren't working, while...
-
Legal Associate
2 weeks ago
Sydney, Australia Federal Court of Australia Full time**Position Overview** Legal associates assist with researching cases, points of law, preparing matters for hearing including other related matters for first instance judges and of the Court. Legal associates are responsible for providing assistance to judicial officers during court hearings and other administrative support to judges, as required. In...
-
Senior Associate
1 week ago
Sydney, New South Wales, Australia PQE Partners Full time $150,000 - $200,000 per yearSenior Associate – Commercial Litigation & InsolvencyPQE Partners are exclusively representing a growing boutique law firm who are building strong momentum in the market and seeking to add a high-calibre litigator to their team. This is not just another Senior Associate role – it is a smart next step for someone ambitious who wants to be part of a firm...
-
Associate Analyst
2 weeks ago
Sydney, Australia Advance Human Solutions Full timeHas 3 years of experience as an associate Analyst - Excellent knowledge of the AU financial market, economy, and global market - Effective communication skills, both written and verbal Are you passionate Associate Analyst looking to move to the buy side? Our client is a Boutique Investment Business with a commitment to delivering exceptional results. We...
-
Validation Associate
2 weeks ago
Sydney, Australia Icon Group Full time**Pharmacy Compounding** **Sydney** **Full Time** **Slade Health** **Validation Associate - Slade Health - Mt Kuring-gai** - Wonderful Opportunity to Develop Your Career in a Far Reaching Organisation - Fantastic Position in a Collaborative Team - Full-Time (Mon-Fri 76-hour f/n) Permanent Position - Mt Kuring-gai Location - On-site role with occasional...
-
Validation Associate
2 weeks ago
Sydney, Australia Icon Holdings Services Full time**Validation Associate - Slade Health - Mt Kuring-gai** - Wonderful Opportunity to Develop Your Career in a Far Reaching Organisation - Fantastic Position in a Collaborative Team - Full-Time (Mon-Fri 76-hour f/n) Permanent Position - Mt Kuring-gai Location - On-site role with occasional travel as required to other Slade Heath Compounding Facilities **About...