Big Data Engineer
3 days ago
Job description :
- Provides technical direction and guidance to the engineering team.
- Ensures adherence to engineering standards and best practices.
- Participates in technical discussions and decision-making.
- Identifies and resolves technical challenges and issues.
- Conducts code reviews and provides feedback to other engineers.
- Maintain high development standards and practices.
Technical Skills
- Proficient with Java, Scala/Spark, API and Streaming – Primary
- Proficient with Pyspark, Python and SQL.
- Experience in Azure cloud platform.
- Expertise in various connectors and pipelines for batch and real-time data collection/delivery.
- Performance tuning - table partitioning and indexing, process threading.
- Should have worked in Agile
- Experience of working in JIRA and Confluence
-
Big data
2 weeks ago
Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time $80,000 - $240,000 per yearJob Description for Big Data Lead Engineer:Location : SydneyTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...
-
Big Data Lead Engineer
7 days ago
Sydney, New South Wales, Australia CareCone Group Full time $150,000 - $200,000 per yearRole: Big Data Lead EngineerLocation: SydneyJob Description:Technical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...
-
Big Data Lead Engineer
5 days ago
Sydney, New South Wales, Australia Zone IT Solutions Full time $180,000 - $250,000 per yearWe are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologiesTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...
-
Data Engineer
1 week ago
Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Data Engineer
5 days ago
Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...
-
Big Data Developer
5 days ago
Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$75,000 - US$85,000 per yearPosition Summary:We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...
-
Data Engineer Consultant
7 days ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Big Data Lead Engineer
1 week ago
Sydney, New South Wales, Australia Tata Consultancy Services Full time $180,000 - $220,000 per yearAbout the jobAbout TCS:Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven...
-
Data Engineer
1 week ago
Sydney, New South Wales, Australia PeopleLogic Full time $120,000 - $180,000 per yearJob Title:Data EngineerLocation:Sydney, AustraliaExperience:5 – 9 YearsEmployment Type:Full-Time / PermanentRole OverviewWe are seeking a highly skilled and motivatedData Engineerto join our dynamic team inSydney. The ideal candidate will possess strong expertise inAWS cloud services,Big Data technologies, andPython programming, with prior experience...
-
Data Engineer
5 days ago
Sydney, New South Wales, Australia FinXL IT Professional Services Full time $120,000 - $180,000 per yearJoin FinXL Professional Services - Data EngineerFinXL Professional Services is a leading provider of professional consulting solutions, partnering with Australia's most respected organisations to deliver critical technology and business outcomes. We pride ourselves on connecting top-tier consultants with challenging and rewarding assignments.FinXL is...