Data Services Specialist

Primary Details

Time Type: Full time

Worker Type: Employee

The opportunity
- Collaborate with various functions to improve the data platform, understanding fundamental system data structures, data processing architecture, and crafting data pipelines.
- Sydney, NSW
- Permanent full-time position

Your new role

The Data Services team at oversees the design and migration of data products onto the AUSPAC division's DAP platform. This platform, originally built on SQL server, is now transitioning to cloud technologies like Azure and Databricks. This data foundation and respective data products are aimed to serve various analytics, BI and machine learning use cases across QBE’s all lines of businesses, enterprise functions and key value chains in Claims and Underwriting.

As team embarks on multiple projects to deliver future ready data foundation, we have exciting opportunity for Data Services Specialist to join our Data services team. In this role, you would work with a highly skilled team of data designers, business analysts and delivery managers to design and deliver best in class data architecture, and data products on new age cloud technologies.

Primary responsibilities include:

- Contribute to Strategy and Planning for continual development of the data foundation.
- Validate, analyze, and manipulate data from operational systems and the data platform, collaborating with other business stakeholders, partners, analysts, and Data Scientists to fulfill data requirements.
- Enhance data platform capabilities to address new data challenges, sourcing and integrating additional data as needed. Create scalable feature engineering frameworks and data engineering assets to support various Business Units' data needs and internal data science activities.
- Assess feature importance and oversee the production of data features.
- Develop, test, and document data models and ETL tools for robust and scalable data assets supporting reporting and analytics.
- Deploy data assets to production and provide level 3 support for assets in production.
- Enhance data platform capabilities to tackle new challenges by identifying, sourcing, and integrating new data.
- Identify, design, and implement process improvements such as automation, optimisation of data delivery, and infrastructure redesign for greater scalability.
- Conduct peer code reviews and foster a DevOps culture within the data services team.
- Implement solutions adhering to architecture best practices.
- Contribute to the development of a best-practice Data and Analytics platform, leveraging cutting-edge technologies. Design and construct data pipelines to facilitate faster, data-informed decision-making.
- Develop an ADF framework to support Data Migration to Azure Cloud technologies and implement new projects aligned with the target architecture within Azure data cloud services.
- Create ETL solutions using Python, Databricks, Spark, and the Microsoft Azure Technology Stack to ingest data from multiple sources into the Data and Analytics platform.

About you

You will have proven experience in data engineering, solution designs and delivery. Advanced communication skills, able to articulate, present, influence and negotiate with key stakeholders. Knowledge and understanding of end-to-end data engineering lifecycle. A flair for learning new data tools and best practices.
- 4+ Years of experience in Cloud data analytics technologies: Databricks, Azure ADF
- 3+ years’ experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions Kafka, Spark Streaming)
- Solid experience using: MS Stack: Microsoft SQL Server, SSIS, SSRS, SSAS, Power BI and SQL.
- Experience working MongoDB, Graph databases, programming languages (R, Python, Spark ETL SQL VStudio), CI/tools (Bamboo, or similar), GitHub, Jira and Confluence
- Passionate in learning about new data tools and best practice
- Experience in working in Agile teams, able to collaborate and work independently.
- Strong working knowledge of the end-to-end data management lifecycle

About QBE

We can never really predict what’s around the corner, but at QBE we’re asking the right questions to enable a more resilient future - helping those around us build strength and embrace change to their advantage.

We’re an international insurer that’s building momentum towards realising our vision of becoming the most consistent and innovative risk partner.

And our people will be at the centre of our success. We’re proud to work together, and encourage each other enable resilience for our customers, our environment, our economies and our communities.

With more than more than 11,000 people working across 27 countries, we’re big enough to make a real impact, but small enough to provide a friendly workplace, where people are down-to-earth, passionate and kind.

We believe this is our moment - what if it was yours too?

Your career at QBE — let’s make it happen

**Benefits**:
We offer a ra