Data Engineer

Found in: Talent AU C2 - 3 weeks ago

Malvern East, Australia The Data Foundry Full time
Job Description

As an AWS Data Engineer, you will play a key role in working with customers to establish cloud infrastructure, build data pipelines and manage their data effectively.  You will have considerable experience working on data-related solutions using AWS and will be comfortable working with technical resources including data analysts, data engineers and data scientists, to enable customers to generate insight from their data.   

You will relish the opportunity to innovate, evolve and test existing assumptions and design bold solutions.  Your experience with large-scale data challenges and ability to create reliable, scalable cloud-based solutions, will see you thriving in this role  

Expectations 

  • Enjoy honing your technical skills and developing new ones, so you can make a strong contribution to deep architecture discussions.  
  • Regularly take part in further education and training to help you develop high-quality and highly performant solutions. 
  • Have a demonstrated ability to think strategically about solutions to business, product, and technical challenges. 
  • Possess an innate awareness of technology trends and how they impact the way businesses consume IT. 
  • Have a reasonable understanding of IT security and governance including security standards, access policies, and data classification schema. 
  • Love what you do and instinctively know how to make work fun 
  • Be dynamic, creative, and willing to take on challenges that have the potential to make a big impact. 
  • Relish a ground floor opportunity to work in a small, agile, startup environment and play a role in shaping its business and technical goals. 
  • A Technical degree required. (Examples include: Computer Science, Data Science, Information Technology or similar) 

Qualifications

Technical Requirements: 

  • 2+ years of: 
    - AWS hands on technical experience 
    - Software development tools and methodologies 
    - Data engineering-related experience 
    - Experience producing high-quality documentation and written communications 

  • 1+ years of experience working with DevOps tools such as Bitbucket, Bamboo, Jenkins or Ansible 
  • 1+ years of experience working with CI/CD tools integration and operations. 
  • 2+ AWS certifications that include either Developer Associate, Solution Architect Associate, SysOps Administrator Associate, Solution Architect Professional, Data Analytics Speciality and/or Machine Learning Speciality. 
  • Strong understanding of Infrastructure as Code, especially AWS Cloudformation or CDK. 
  • Programming skills in one or more of the following languages: Python, Java, TypeScript, SCALA & Spark. 
  • Understanding of SQL, ER diagrams, and data dictionaries to understand and enable the transformation and curation of data. 
  • Experience in building real-time or batch ingestion and transformation pipelines. 
  • Familiarity with data storage format types such as JSON, AVRO, Parquet, ORC. 
  • An understanding of fundamental data concepts including databases, data schema, data classification, data security, data governance, data analysis, data transformation, data engineering and data science. 
  • Experience and understanding of container technology, especially Docker (Desirable) 
  • An understanding of fundamental networking concepts (Desirable) 


Additional Information

  • We’re passionate about the technical community we are a part of, and believe in contributing to open source  and AWS initiatives
  • We care about climate change and are always looking at ways to reduce our carbon footprint
  • We support and contribute to a different cause each quarter
  • We’re committed to developing your career with customised individual growth and development plans
  • We’re committed to ensuring all our staff feel welcome, included and respected every day they work for The Data Foundry

  • Associate Data Ops Enginee

    4 days ago

    Hawthorn East, Australia Coles Supermarkets Full time

    We’ve been trusted to serve Aussie communities since 1914 and grown to become a top 30-listed on the ASX with 120,000 team members and a portfolio of iconic brands. At Coles Group, you’ll not only get to make a difference to millions of Aussie lives—you’ll also get to see your impact. **Associate Data Ops Engineer - Operations & Support**: **What...

  • Database Administrator

    4 days ago

    Hawthorn East, Australia Australia Wide Engineering Recruitment Full time

    Hybrid and flexible work arrangement - Opportunity to learn and work with Database DevOps technologies - Plural Sight subscription **The Company** Our client, based in Hawthorne East, is a global leader creating products and solutions that are deployed in many countries and play a vital role in conserving a very scarce resource - water. **The Role** You...

  • Electrical Overhead Auditor

    9 hours ago

    Oakleigh East, Australia Balpara Full time

    **Location**: Oakleigh East - Victoria**WorkType**: Full Time**Salary**: ***$0 to $0 AnnualBased in our Oakleigh office in the Eastern suburbs of Melbourne we have an exciting opportunity for a talented and experienced **VEDN Auditor** to join our growing thriving and reputable team. **The opportunity**: - In the field across Victoria reviewing Overhead...

  • Maintenance Contract C

    3 days ago

    Hawthorn East, Australia Coles Group Full time

    We’ve been trusted to serve Aussie communities since 1914 and grown to become a top 30-listed on the ASX with 120,000 team members and a portfolio of iconic brands. At Coles Group, you’ll not only get to make a difference to millions of Aussie lives—you’ll also get to see your impact. **About the team**: Procurement at Coles Group is all about...

  • Group Product Manager

    7 days ago

    Hawthorn East, Australia Coles Supermarkets Full time

    We’ve been trusted to serve Aussie communities since 1914 and grown to become a top 30-listed on the ASX with 120,000 team members and a portfolio of iconic brands. At Coles Group, you’ll not only get to make a difference to millions of Aussie lives—you’ll also get to see your impact. As the way we shop continues to evolve, our Digital team keeps us...

  • Marketing Automation and Operations Manager

    5 days ago

    Hawthorn East, Australia Coles Supermarkets Full time

    We’ve been trusted to serve Aussie communities since 1914 and grown to become a top 30-listed on the ASX with 120,000 team members and a portfolio of iconic brands. At Coles Group, you’ll not only get to make a difference to millions of Aussie lives—you’ll also get to see your impact. **About the team**: Marketing powers one of Australia’s biggest...

  • Communications Technician

    9 hours ago

    East Perth, Australia Talent International Full time

    **Job Details**: **Location** East Perth **Salary** Negotiable **Job Type** Full Time **Ref** BBBH100898_1683598574 **Contact** James Hardley **Posted** about 5 hours ago **_Experience required:_** - _Maintain (by carrying out routine maintenance procedures and fault rectification procedures) an effective and efficient level of operating...

  • Customer Care Representative

    3 days ago

    East Toowoomba, Australia National Grower Register Pty Ltd Full time

    The National Grower Register (NGR) is currently seeking a passionate individual to join our Customer Care Team as a Customer Care Representative. As a Customer Care Representative, you will play a vital role in providing exceptional support and service to our valued customers. Join our highly efficient and nimble organisation that is dedicated to delivering...

  • Technical Sales

    7 days ago

    East Melbourne, Australia MDE Consultants Full time

    **Technical Sales - Australia** **Salary**:$70,000 per year + commission **Location**:East Melbourne **Hours**:Flexible **Job type**:permanent, full-time With over 5000 people, offices in 34 countries, and millions of devices installed in over 133 countries, my client is a global pioneer in high-performance smart energy technology. Their diverse...

  • Software Development Manager Test Manager

    5 days ago

    East Melbourne, Australia Latitude Full time

    Lead cutting-edge test automation in medical tech, directly advancing healthcare - Mentor a dynamic team, shaping the future of medical technology - Influence high-quality software delivery in a role balancing innovation and tech **Software Development Manager / Test Manager** **Automation frameworks and continuous integration...

  • Cpi Analyst

    4 days ago

    Hawthorn East, Australia Coles Group Full time

    We’ve been trusted to serve Aussie communities since 1914 and grown to become a top 30-listed on the ASX with 120,000 team members and a portfolio of iconic brands. At Coles Group, you’ll not only get to make a difference to millions of Aussie lives—you’ll also get to see your impact. **About the team**: To understand our merchandising, we need to...

  • Facilities Coordinator

    7 days ago

    City East, Australia University of South Australia Full time

    Join the Facilities Management Team at the City East campus - Full-time, continuing position - Salary: $92,941 - 104,143 per annum plus 17% superannuation **About the Role** Reporting to the Campus Facilities Manager, the Facilities Coordinator supports the delivery of teaching, research and community activities by managing the operational delivery of...

  • Commercial Analyst

    1 week ago

    Hawthorn East, Australia Coles Group Full time

    **A new role = A new way to win together**: You belong at Coles Group where we look ahead, have a plan, and are up for the challenge. We learn and grow by taking career-defining opportunities and this one may just be your next. **About the team** To understand our merchandising, we need to understand our customers. That’s why you’ll find us working...

  • Online Range

    5 days ago

    Hawthorn East, Australia Coles Supermarkets Full time

    We’ve been trusted to serve Aussie communities since 1914 and grown to become a top 30-listed on the ASX with 120,000 team members and a portfolio of iconic brands. At Coles Group, you’ll not only get to make a difference to millions of Aussie lives—you’ll also get to see your impact. **Online Range & Layout Planner (107518)**: Want to discover...