Data Engineer

4 weeks ago

Sydney, Australia Deputy Full time

Responsibilities

: Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our data warehouse.  Maintain and build on our data warehouse and analytics environment. Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks. Identify, design, and implement process improvements such as: improving database performance, optimising data delivery and re-designing infrastructure for greater scalability, and maintainability among many things Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources within our AWS and data warehouse ecosystem. Implement and monitor best in class security measures in our data warehouse and analytics environment, with an eye towards the evolving threat landscape. Work with stakeholders including the Engineering, Product, Data Analytics and Design teams to assist with data-related technical issues and support their data infrastructure needs. Work with data and analytics experts to strive for greater functionality in our data systems. Help data analysts troubleshoot their SQL, Python, or R code.

Skills & Experience:

Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database. We use Snowflake, Redshift, DynamoDB, MySQL and DBT. Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools. Advance data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets together. Demonstrated ability to write clear code that is well-documented and stored in a version control system. We use Git. Use APIs to push and pull data from various data systems and platforms. Experience in building and maintaining a dimensional data model using type 2 dimensions. Demonstrated ability to learn new techniques and troubleshoot code without support, ex. find answers to common programming challenges on Google. In other words, be able to learn on the job. Excellent listening, interpersonal, communication and problem solving skills. Demonstrated ability to work effectively in teams, in both a lead and support role.  Demonstrated ability to work independently and be a self-starter. 

Nice to have:

Software engineering, data science, data analytics experience Experience in Docker Knowledge of building data lake or data warehouse. Knowledge of handling streaming data. Experience in Infrastructure as Code and CICD practice. ML or predictive analytics experience. Experience in web or mobile application development. Employee Perks - Share Options - Paternity/Maternity Leave Policies - Flexible Work Policy - Company wide Development & Coaching - Hackathons - Awards - "Your Time to Shine & Celebrate Success"- Social Events & variety of social clubs (Books, LGBT, Games, Sports) - Mental Health Support - Munch & Learns Deputy believes in equal opportunity and that inclusiveness and diversity promotes innovation. Our global team members are from a variety of cultures. And we welcome different perspective and skills. #LI-Hybrid

  • Senior Azure Data Engineer

    4 weeks ago

    North Sydney, Australia NTT DATA Full time

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Data Analyst

    4 weeks ago

    Sydney, Australia The Data Foundry Full time

    Job DescriptionYour impact As an AWS Data Analyst, you will play a key role in working with customers to understand their business requirements, map these to their data capabilities, liaise with our internal Data Engineers to design and build elegant solutions, then partner with our customers to deploy those solutions in a way that allows them to turn data...

  • Data Engineer

    3 days ago

    Sydney, Australia TMGM Full time

    Join our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, but you will also have the opportunity to integrate cutting-edge data management...

  • Data Engineer

    4 weeks ago

    Sydney, Australia PayTech Nexus Ltd Full time

    Term: 12 monthsExperience Requirement: 3-5 yearsJob location: Sydney, AustraliaProject scope: Data Engineering in Credit Risk EnvironmentBackgroundWe are working with one of the major card schemes and a Tier 1 Australian Bank, based in Sydney. This role is a 12-month contract (likely extending to 2 years) and is for an experienced Data Engineer / Analyst...

  • Data Engineer

    4 weeks ago

    Sydney, Australia Practiv Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    7 days ago

    Sydney, Australia Virtusa Full time

    Data Engineer - CREQ186610 Description Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora Primary Location Sydney, New South Wales,...

  • Data Engineer

    2 days ago

    Sydney, Australia Tech Mahindra Full time

    Data Engineer Skill Set: AWS Data Engineer-1 Total Experience: 5.00 to 8.00 Years No of Openings: 1 Job Post Date: 08/05/2024 Job Expiry Date: 30/06/2024 Domain: IT Location: SYDNEY [Australia] Job Reference...

  • Data Engineer

    3 weeks ago

    Sydney, Australia Ofload Full time

    About Ofload and our mission:At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry.Every day in Australia, around 30% of trucks travel empty and a further 50% are idle amounting to...

  • Data Engineer

    3 weeks ago

    Sydney, Australia Nine Full time

    Job DescriptionData Engineering builds and manages the pipelines, applications and infrastructure for collecting, processing, and storing Nine’s data. We are responsible for collecting hundreds of millions of events from client devices each day and streaming them directly into our data warehouse. We extract data from the majority of Nine’s enterprise...

  • Data Engineer

    3 weeks ago

    Sydney, Australia Mane Consulting Full time

    Are you a customer-obsessed data engineer who can focus on the delivery and innovation of new services? Can you use your Snowflake experience and knowledge to advise, design, and implement cost-effective solutions to our customers, whilst maintaining an excellent delivery posture? Do you want to shape your world and change the way the world works? Do you...

  • Manager, Data Engineering

    2 days ago

    Sydney, Australia Map Talent Full time

    **Job title**: **Manager, Data Engineering** **Job type**: - Perm**Emp type**: - Full-time**Skills**: Manager **Salary type**: - Annual**Salary**: - AUD $170,000.00**Job published**: - 24/11/2023**Job ID**: - 34455**Data Engineering Manager - Sydney - $180,000 + Super** We have just partnered with a business in Sydney who work with the latest...

  • Data Engineer

    3 days ago

    Sydney, Australia Cognizant Full time

    Job Description What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment! This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, together with your colleagues from all around the world,...

  • Data Engineer

    7 days ago

    Sydney, Australia Minutes to Seconds Pty Ltd Full time

    About the jobAt Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and clients with great...

  • Data Engineer

    5 days ago

    Sydney, Australia Hydrogen Group Full time

    The Client My client is a leading financial organisation who are continuing their journey with multiple projects where they are looking for Data Engineers. This client is working on multiple projects which would give you an exciting opportunity to cutting edge Technology tools. The Role This role offers a great chance to join a team of Engineering...

  • Data Engineer

    2 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    Job Description What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU - people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, together with your colleagues from all around the world, you...

  • Senior Data Engineer

    4 weeks ago

    Sydney, Australia Coates Group Full time

    Individual AccountabilitiesTake ownership of data engineering projects from inception to completion, ensuring the successful delivery of high-quality data solutions that meet business requirements.Collaborate with Cross-Functional Teams: Work closely with various teams, including data owners, analytics engineers, and stakeholders, to understand data...

  • Data Engineering Manager

    3 days ago

    Sydney, Australia The Argyle Network Full time

    -The Argyle Network Sydney, Australia Posted 9 hours ago Permanent Competitive Salary + Bonus - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank!**The Client**: Leading Aussie Bank dedicated to innovation and collaboration. - Having invested in the latest cutting edge...

  • Senior Data Engineer

    3 weeks ago

    Sydney, Australia Pyramid Global Technologies Full time

    About the job Senior Data Engineer Job Description: Sr. Data Engineer *Power BI,*Tableau,*SQL advanced,*Data warehousing concepts, and everything related to data

  • Data Engineering Lead

    3 weeks ago

    Sydney, Australia Correlate Resources Full time

    Our client is a market leading business with a high profile and reputable brand within the Australian market. With a well-established analytics division focused on optimising both customer and operational initiatives they boast an energising, supportive and collaborative culture, and are looking for great people who want to be a part of their journey. With...

  • Principal Data Engineer

    3 weeks ago

    Sydney, Australia Troocoo Full time

    About our client: Our client is an instantly recognisable household name within the Financial Services industry. In recent years they have led the way in the creation of wealth management products and services for their customers. Due to this expansion in their offering and associated customer...