Lead Data Engineer

3 weeks ago


Newcastle City Council, Australia Scott Logic Full time

Overview

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models.

These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be leading teams, setting technical direction, advising clients or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis.

Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it comes to your existing skillset.

Responsibilities

- Engage with clients to deliver pragmatic data engineering solutions, including building data platforms and pipelines to enable data and analytics capabilities.
- Participate in or lead teams, set technical direction, advise clients, and solve engineering challenges.
- Spend time on-site with clients in the London area on an ad-hoc basis as required.

What we’re looking for

- Good experience with technologies and approaches typical in modern data engineering and reporting, including storage, data pipelines to ingest and transform data, and querying & reporting of analytical data.
- Experience with Python, Spark, SQL, PySpark, Power BI, etc.
- Background in software engineering, including Front End technologies like JavaScript.
- Problem-solver with a pragmatic approach to exploring options and finding effective solutions.
- Ability to design and build well-structured, maintainable systems.
- Strong communication skills and a collaborative approach to work.
- Willingness to learn, adapt, and grow experience.

Nice to have

- Experience with relevant cloud services (AWS, Azure or GCP).
- Experience working in an Agile environment.
- Experience with vendor products such as Snowflake or Data Bricks.
- Experience with CI/CD tooling.

What you’ll get in return

- 25 days’ annual leave, rising to 30 days with each year of service.
- Generous family leave policies.
- Access to an employer pension scheme, private medical services and Group Life Assurance.
- A range of optional benefits such as discounted gym membership and a cycle-to-work scheme.
- A meaningful approach to evaluating your performance and providing feedback on your progress.

Values and environment

At Scott Logic, we value the flexibility of remote working alongside the value gained from spending time with our colleagues and clients. In our offices you’ll find employee-led clubs and events, as well as free games, books, and refreshments.

We have shared values that govern our behaviour toward others and the environment. We are proud to be a B Corp, a global movement of businesses driving for a more inclusive, equitable, and regenerative economy. We believe diversity drives innovation, and embrace a culture where everyone can contribute, irrespective of race, religion, colour, national origin, gender, sexual orientation, age, marital status or disability.

#J-18808-Ljbffr


  • Lead Data Scientist

    4 days ago


    Newcastle, Australia ClearCompany Full time

    The Opportunity Our client is a high-growth scale-up on a mission to expand and make an impact through the delivery of innovative AI and automation solutions. They’re seeking a Lead Data Scientist and a Lead AI Engineer to lead the design, engineering and delivery of GenAI solutions across a broad range of enterprise projects. This includes building AI...

  • Data Engineer

    2 weeks ago


    Council of the City of Sydney, Australia FinXL Full time

    Data Engineer Leading Government client (consulting through FinXL) FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise sectors. FinXL is...


  • Council of the City of Sydney, Australia Wisr Full time

    Our Why, What and How Wisr is committed to building a supportive, inclusive and diverse workplace, and we strongly encourage applications from all backgrounds and identities. We’re happy to accommodate any reasonable adjustments to the interview process to ensure equal opportunity for all. If you require reasonable adjustments, please reach out to us via...

  • Data Engineer

    1 day ago


    North Sydney Council, Australia Ventia Full time $120,000 - $180,000 per year

    The OpportunityVentia's Group Supply Chain is excited to offer a newly created Data Engineer role, ideally based in Sydney. This is a pivotal position responsible for designing, building, and maintaining scalable, high-performance data infrastructure that underpins the organisation's analytics, machine learning initiatives, and core operational...


  • Council of the City of Sydney, Australia Deputy Full time

    Deputy is a global SaaS remote‑first workforce management company with hubs in Sydney, Melbourne, San Francisco and London, plus team members working remotely across the United States. Our platform serves over 1.5 million workers and 375,000 workplaces across 100+ countries. We are backed by top global investors and recently achieved Unicorn status. At...


  • Newcastle City Council, Australia Thoughtworks Inc. Full time

    Principal data architects at Thoughtworks play a key part in developing modern data architecture approaches to meet business objectives and provide end-to-end data solutions. They are responsible for enabling clients and Thoughtworks teams to align on outcomes that support the vision painted by data strategists. They lead the design and architecture of the...


  • Council of the City of Sydney, Australia black.ai Full time

    Location Melbourne HQ or Sydney Employment Type Full time Department Engineering Who is Heidi? Heidi is building an AI Care Partner that supports clinicians every step of the way, from documentation to delivery of care. We exist to double healthcare’s capacity while keeping care deeply human. In 18 months, Heidi has returned more than 18 million...

  • Data Engineer

    4 weeks ago


    Council of the City of Sydney, Australia UTS College Limited Full time

    Overview UTS College is the premium pathway for students into the University of Technology Sydney (UTS), Australia's number one young university. Our vision is to actualise potential and enhance lives through the power of learning, our actions, and our people. Our purpose is to provide the best available opportunity for students to develop the knowledge,...

  • Senior Data Engineer

    2 weeks ago


    Council of the City of Sydney, Australia FinXL Full time

    Senior Data Engineer Leading government client (consulting through FinXL) FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise...


  • Council of the City of Sydney, Australia ASX Full time

    Analyst, Data Engineer page is loaded## Analyst, Data Engineerremote type: Hybridlocations: Sydneytime type: Full timeposted on: Posted 10 Days Agojob requisition id: JR100657# **ASX: Powering Australia's financial markets**# When you join ASX, you’re joining a company with a strong purpose – to power a stronger economic future by enabling a...