Data Engineer
3 weeks ago
Join our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, but you will also have the opportunity to integrate cutting-edge data management and software engineering technologies into our existing data structures. As an experienced Data Engineer, you will have the chance to mentor and guide junior data engineers, while ensuring data governance and security policies are followed. In addition, you will play a crucial role in monitoring the performance of our data processing systems to maintain optimal data accuracy. Embrace this opportunity to make a significant impact in the field of data engineering
Key Responsibilities
- Design, construct, install, test, and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Integrate up-and-coming data management and software engineering technologies into existing data structures.
- Lead, mentor, and guide junior data engineers.
- Ensure compliance with data governance and security policies.
- Monitor the performance of data processing systems and data accuracy.
- Maintaining the Cl/CD system and code base as per the acceptable industry standard level
- Establish procedures to maintain a high QA standard
- Maintain the cloud architecture spread across multiple accounts
- Adopt new technologies while also using the expertise you have built on modern big data tools and cloud services
Requirements
- Bachelor's degree or higher in Computer Science, Engineering, or related field.
- At least 5 years of experience in data engineering with a proven track record of designing and implementing complex data solutions.
- Strong programming skills in Python, with experience in developing robust, maintainable, and scalable data processing pipelines.
- Hands-on experience with CI/CD systems, automating workflows, and integrating data quality checks into the deployment process.
- Extensive experience with cloud services, preferably AWS, including the use of AWS data services and an understanding of Snowflake as a data warehousing solution.
- Versatile in working with various forms of data infrastructure, adept at managing both streaming and batch data systems.
- Solid understanding of data modelling, ETL (Extract, Transform, Load) processes, and data warehousing principles, with a commitment to high data quality and accuracy.
Benefits
Fostering a collaborative, open environment that’s conducive to employee success is the #1 priority at TMGM.
- Growth Opportunities - We value your growth as much as we do ours, so we include educational and career growth opportunities at every level.
- People-First Values -We believe building a great company happens by hiring great people. Our employees’ job satisfaction always comes first.
- Shared Success - We offer revenue share opportunities for the right people, allowing our employees to share in company success.
- Worldwide Team - Our worldwide team means you’ll work with others from all over the globe and gain international experience.
-
Senior Azure Data Engineer
2 months ago
North Sydney, Australia NTT DATA Full timeNTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...
-
Data Analyst
1 month ago
Sydney, Australia The Data Foundry Full timeCompany Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...
-
Data Analyst
1 month ago
Sydney, Australia The Data Foundry Full timeCompany Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...
-
Data Specialist
4 weeks ago
Sydney, Australia Data Addiction Pty Ltd Full time**What you’ll need before applying**: - At least 2 years’ experience in building data solutions, preferably in Microsoft Azure. - Experience in delivering projects using Agile/Scrum methods. - Strong problem-solving skills and the ability to deliver value. - Strong verbal and written communication skills. - Tertiary qualifications in Computer Science,...
-
Data Engineer
5 days ago
Sydney, Australia Woolworths Group Limited Full timeData Engineer Permanent role Hybrid and flexible working environment Sydney (Norwest) office location About Woolworths Woolworths Group is a food and everyday needs retailer united by the shared purpose of creating better experiences together for a better tomorrow. With more than 1,400 stores across its Woolworths Supermarkets, Countdown...
-
Data Engineer
2 months ago
Sydney, Australia Practiv Full timeAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...
-
Data Engineer
4 weeks ago
Sydney, Australia Virtusa Full timeData Engineer - CREQ186610 Description Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora Primary Location Sydney, New South Wales,...
-
Data Engineer
2 weeks ago
Sydney, Australia Talenza Full timeData Engineer Sydney $170,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team...
-
Data Engineer
2 weeks ago
Sydney, Australia INGRITY Remote Work Freelance Full timeSeeking a skilled Data Engineer with data and platform engineering experience to design, build, and maintain data platforms for a top banking client. Collaborate with teams to deliver high-quality data solutions. At INGRITY:Imagine the Impossible: It's not just an aspiration for our clients; we expect the same from our team.INGRITY isn't your typical...
-
Data Engineer
2 weeks ago
Sydney, Australia INGRITY Full timeSeeking a skilled Data Engineer with data and platform engineering experience to design, build, and maintain data platforms for a top banking client. Collaborate with teams to deliver high-quality data solutions. At INGRITY:Imagine the Impossible: It's not just an aspiration for our clients; we expect the same from our team.INGRITY isn't your...
-
Data Engineer
2 weeks ago
Sydney, Australia Onset Group Full timeJob Description Sydney or Brisbane (Hybrid 3 days WFO 2 days WFH) Salary: $140k - $160k + super Social good Data & AI Ever considered the advantages of working in a company where every key decision-maker, from top executives to the company's founders, brings a wealth of experience in data? In such an environment, the ability to scale rapidly becomes...
-
Data Engineer
1 month ago
Sydney, Australia Ofload Full timeAbout Ofload and our mission:At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry.Every day in Australia, around 30% of trucks travel empty and a further 50% are idle amounting to...
-
Data Engineer
1 month ago
Sydney, Australia Mane Consulting Full timeAre you a customer-obsessed data engineer who can focus on the delivery and innovation of new services? Can you use your Snowflake experience and knowledge to advise, design, and implement cost-effective solutions to our customers, whilst maintaining an excellent delivery posture? Do you want to shape your world and change the way the world works? Do you...
-
Data Engineer
5 days ago
North Sydney, Australia Nine Full timeJob DescriptionNine is hiring a Data Engineer to join its Data team to continue to make data a competitive advantage. As a Data Engineer, you will work with key stakeholders to build high-performing data products and reduce the complexity in our data systems and data models. You will partner with our Product function to enable the use of data to create...
-
Senior Data Engineer
4 hours ago
Sydney, Australia Talenza Full timeSenior Data Engineer Sydney, Australia 6 Months (Intially) $970pd Inc Super We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data...
-
Lead Data Engineer
4 days ago
Sydney, New South Wales, Australia Randstad Australia Full timeAbout the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...
-
Lead Data Engineer
4 days ago
Sydney, Australia Randstad Australia Full timeAbout the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...
-
Data Engineer
3 weeks ago
Sydney, Australia Hydrogen Group Full timeThe Client My client is a leading financial organisation who are continuing their journey with multiple projects where they are looking for Data Engineers. This client is working on multiple projects which would give you an exciting opportunity to cutting edge Technology tools. The Role This role offers a great chance to join a team of Engineering...
-
Data Engineer
3 weeks ago
Sydney, New South Wales, Australia Cognizant Full timeJob Description What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU - people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, together with your colleagues from all around the world, you...
-
Head of Data Engineering
5 days ago
Sydney, Australia Correlate Resources Full timeDrive Data Engineering best practices, architecture and develop roadmaps in order to deliver quality data throughout the organisation.Bullet PointsDRIVE DATA ENGINEERING BEST PRACTICESROLE CAN BE BASED ANYWHERE IN AUSTRALIALEAD, GROW AND DEVELOP A LARGE DATA ENGINEERING DEPARTMENTFull Job DescriptionABOUT THE COMPANYOur client is an industry leading brand...
