Big Data Lead Engineer
5 days ago
Scam Alert: To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers. Learn More...
Job DescriptionRequired Skills: Scala, Pyspark, Data Pipelines & Databricks
Max Salary: 140k inc super all inclusive
Job Responsibilities:
- Design, build, and maintain scalable data pipelines and workflows on the Databricks platform.
- Collaborate with data engineers, data scientists, and analysts to optimize data architecture and performance.
- Implement monitoring, alerting, and automation solutions to ensure the reliability and efficiency of Databricks clusters and jobs.
- Provide technical expertise and support for troubleshooting issues and optimizing data processing and analysis tasks.
- Proficiency in Databricks, Apache Spark, and related big data technologies.
- Experience with designing and implementing ETL processes, data modeling, and data warehousing concepts.
- Strong programming skills in languages such as Python, Scala, or SQL.
- Familiarity with cloud platforms like AWS.
- Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.
- Certifications in Databricks or related technologies are desirable.
-
Big Data Technology Lead
4 days ago
Sydney, New South Wales, Australia Kirra Services Full timeAbout the RoleKirra Services is seeking a highly experienced Big Data Technology Lead to join our team. As a Big Data Technology Lead, you will be responsible for leading the design, development, and implementation of cutting-edge big data solutions that drive business growth and success.Key Responsibilities:Design and Develop Big Data SolutionsLead...
-
Big Data Engineer Lead
5 days ago
Sydney, New South Wales, Australia Databricks Inc. Full timeAs a leader in data engineering, you will be responsible for guiding the technical evaluation phase in a hands-on environment throughout the sales process. You will serve as a technical advisor to the sales team, working closely with the product team to advocate for customers' needs.The impact you will have:You will be a Big Data expert on aspects of...
-
Lead Data Architect
4 days ago
Sydney, New South Wales, Australia Kirra Services Full timeWe are looking for a Lead Data Architect - Big Data who can drive the design and implementation of our big data architecture.Job RequirementsThe successful candidate will have a deep understanding of data architectures, modern data platforms, big data, data modelling, ML/AI, analytics, cloud platforms, data governance, and information management.Develop and...
-
Senior Big Data Engineer
4 days ago
Sydney, New South Wales, Australia Kirra Services Full timeAbout the JobKirra Services is looking for an exceptional Senior Big Data Engineer to join our team. As a Senior Big Data Engineer, you will play a key role in designing, developing, and implementing cutting-edge big data solutions that drive business growth and success.Responsibilities:Design and Develop Big Data SolutionsWork Closely with Cross-Functional...
-
Lead Engineer-Big data
5 days ago
Sydney, New South Wales, Australia Kirra Services Full timeDesign, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...
-
Big Data Systems Engineer at Atlassian
7 days ago
Sydney, New South Wales, Australia Atlassian Full timeWe are looking for a highly skilled Big Data Systems Engineer to join our Analytics Platform team at Atlassian. As a key member of our team, you will be responsible for designing and developing high-quality software services for analytics and big data systems.The ideal candidate will have experience working with product analytics and big data systems, as...
-
Data Engineer
15 hours ago
Sydney, New South Wales, Australia Big Red Group Full timeBig Red Group is the leader in the experiences industry, connecting people with a diverse range of experiences worldwide. As we expand our footprint through partnership and products, we are building a state-of-the-art platform to empower our experience partners through technology.This platform powers iconic marketplaces like RedBalloon, Adrenaline,...
-
Big Data Solutions Engineer
4 days ago
Sydney, New South Wales, Australia Luxoft Full timeData Engineering RoleWe are looking for a Big Data Solutions Engineer to join our team.ResponsibilitiesDesign and implement cloud-native solutions on AWS, focusing on data storage and processing using S3, RDS, Redshift, DataZone, and Glue.Develop technology blueprints and engineering roadmaps for multi-year data transformational programs.Skills and...
-
Big Data Engineer Leader
7 days ago
Sydney, New South Wales, Australia Databricks Full timeAbout the OpportunityWe're seeking an experienced Solutions Architect to join our team at Databricks. In this role, you'll have the opportunity to work with a leading company in AU and contribute to the growth and success of our organization.Your Key Responsibilities:You will be responsible for helping data teams complete projects and integrating our...
-
Big Data Engineering Specialist
1 day ago
Sydney, New South Wales, Australia Endava Full timeAre you passionate about driving meaningful change through technology? Join our talented data engineering team as a Big Data Engineering Specialist and contribute to creating dynamic platforms and intelligent digital experiences. Your expertise in Apache Spark, Python, and cloud-based architecture will help us build robust data infrastructures that drive...
-
Lead Data Engineer
1 week ago
Sydney, New South Wales, Australia Pyramid Global Technologies Full timeJob Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...
-
Big Data Engineer Position
1 day ago
Sydney, New South Wales, Australia Cuscal Limited Full timeAbout the RoleThis is an exciting opportunity to join our Data Team as a Cloud Data Engineer, where you will play a key role in shaping the future of our data platform. You will be responsible for building and maintaining large-scale data systems, leveraging your expertise in cloud computing and big data technologies.The ideal candidate will have a strong...
-
Big Data Engineer
4 days ago
Sydney, New South Wales, Australia Kirra Services Full timeResponsibilitiesDevelop and support future-ready data solutions for customers across industry verticals.Demonstrate understanding in data architectures, modern data platforms, big data, ML/AI, analytics, cloud platforms, data governance, and information management.Design and implement data models according to business requirements for specific use cases...
-
Big Data Engineer Position
2 hours ago
Sydney, New South Wales, Australia Macquarie Bank Limited Full timeJoin our Data Team at Macquarie Bank Limited as a Senior Data Engineer and make a significant impact on our Banking and Financial Services business unit.About the OpportunityThis role offers an excellent chance for an experienced Data Engineer to take their career to the next level, collaborating with a wide range of stakeholders to deliver a transformation...
-
Big Data Quality Engineering Expert
4 days ago
Sydney, New South Wales, Australia DigitalRecruiter™ APP Full timeRole OverviewWe are seeking an experienced Big Data Quality Engineering Expert to lead our data migration efforts. The ideal candidate will have expertise in data migration testing and ETL testing techniques, with hands-on experience in test execution and result reporting.Key ResponsibilitiesData Testing: Develop and execute comprehensive data testing...
-
Big Data Technology Lead
4 days ago
Sydney, New South Wales, Australia Kirra Services Full timeKirra Services is seeking a highly experienced Big Data Technology Lead to join our team.Job ResponsibilitiesThe ideal candidate will have expertise in implementing near real-time data flows/pipelines and distributed streaming applications using Apache Kafka.Design and implement data pipelines that meet the needs of our clients.Collaborate with...
-
Big Data Specialist
4 days ago
Sydney, New South Wales, Australia Tech Mahindra Full timeAbout the RoleThis Cloud Data Engineering Manager position requires a strong understanding of big data technologies and experience with cloud platforms like AWS. The successful candidate will design and implement ETL processes, data modeling, and data warehousing concepts.ResponsibilitiesDevelop and maintain scalable data architectures and workflows.Work...
-
Big Data Specialist
23 hours ago
Sydney, New South Wales, Australia Commonwealth Bank Full timeDo you have what it takes to shape the future of banking? As a Data Engineer at Commonwealth Bank, you'll be joining our IB&M Data Engineering team, working on exciting projects that involve building ETL applications, deploying and managing large-scale, complex big data applications using cloud native technologies.Our team is made up of big thinkers who are...
-
Big Data Architect
5 days ago
Sydney, New South Wales, Australia Kirra Services Full timeKirra Services is seeking a highly skilled Big Data Architect to join our team.The ideal candidate will have extensive experience in designing and implementing big data application architecture, with a strong focus on data transformations, reporting requirements, and Agile environments.A minimum of 10+ years of experience as a Business BA or equivalent in IT...
-
Big Data Infrastructure Specialist
4 hours ago
Sydney, New South Wales, Australia PayTech Nexus Ltd Full timeJob Overview: As a Senior Data Engineer at PayTech Nexus Ltd, you will play a key role in designing, building, and delivering enterprise-wide data ingestion, data integration, and data pipeline solutions using common programming languages such as Scala, Java, or Python in a Big Data and Data Warehouse platform.Key Responsibilities: Design and build data...