Big Data Lead Engineer
1 week ago
Role: Big Data Lead Engineer
Location: Sydney
Job Description:
Technical and Team Leadership:
- Provides technical direction and guidance to the engineering team.
- Ensures adherence to engineering standards and best practices.
- Participates in technical discussions and decision-making.
- Identifies and resolves technical challenges and issues.
- Conducts code reviews and provides feedback to other engineers.
- Maintain high development standards and practices.
- Facilitates team communication and collaboration.
- Mentoring and guiding junior engineers.
Technical Skills
- Proficient with Java, Scala/Spark, API and Streaming – Primary
- Proficient with Pyspark, Python and SQL.
- Experience in Azure cloud platform.
- Expertise in various connectors and pipelines for batch and real-time data collection/delivery.
- Performance tuning - table partitioning and indexing, process threading.
Process:
- Should have worked in Agile
- Experience of working in JIRA and Confluence
Interested people can share their resume at or can reach me on
-
Big Data Lead Engineer
6 days ago
Sydney, New South Wales, Australia Zone IT Solutions Full time $180,000 - $250,000 per yearWe are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologiesTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...
-
Big data
2 weeks ago
Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time $80,000 - $240,000 per yearJob Description for Big Data Lead Engineer:Location : SydneyTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...
-
Big Data Lead Engineer
1 week ago
Sydney, New South Wales, Australia Tata Consultancy Services Full time $180,000 - $220,000 per yearAbout the jobAbout TCS:Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven...
-
Data Engineer
1 week ago
Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Lead Data Engineer
4 days ago
Sydney, New South Wales, Australia Talenza Full time $200,000 - $250,000 per yearLead Data Engineer Sydney, Australia $230,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency. Key Responsibilities:Lead the development and...
-
Data Engineer
6 days ago
Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...
-
Lead Data Engineer – AWS
14 hours ago
Sydney, New South Wales, Australia Bluefin Resources Pty Limited Full time $80,000 - $140,000 per yearJoin a high-performing Data team that's driving a large-scale transformation program within the banking and financial services industry. This is an excellent opportunity for an ambitious and technically strong Data Engineer to play a lead role in shaping a modern, cloud-based data platform. You'll be joining a collaborative, forward-thinking environment...
-
Big Data Developer
6 days ago
Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$75,000 - US$85,000 per yearPosition Summary:We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...
-
Big Data Engineer
4 days ago
Sydney, New South Wales, Australia Kaizen Global Technologies Full time $120,000 - $180,000 per yearJob description :Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback to other engineers.Maintain high development standards...
-
Data Engineer Consultant
1 week ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...