Senior Data Engineer
2 days ago
Our Analytics team at UpGuard supports all of our teams to extract key insights from the data that we collect. We extract data from multiple sources and build insightful dashboards to display key metrics and support leaders to make decisions. We also build integrations between systems to seamlessly collect required data
Why are we hiring for this role? As UpGuard continues to scale at an increasing rate, each of our teams, from Product to Sales, are becoming more data and insight hungry. As a result, our central Analytics function is bandwidth constrained and needs to scale with our business growth. In essence, with the emergence of automation and AI, we are looking to democratise data insights and analytics and to do this we need to enable our users with access to data, while we still ensure data integrity, security and governance are maintained. This role will be a key enabler to achieve this vision and accelerate our efforts in this area What you'll do? Data Integration & Pipeline Development: Design, build, and maintain reliable data pipelines to consolidate information from various internal systems (CRM, support platforms, marketing, product usage data, etc.) and relevant third-party sources Semantic Layer Design & Management: Develop and manage a comprehensive semantic layer (potentially using technologies like LookML, dbt or SQLMesh, Agents) that provides clear definitions and mappings for data concepts to underlying database structures as well as high level business logic. Data Quality & Governance: Implement and enforce data quality checks, validation rules, and governance processes to ensure the accuracy, consistency, and reliability of data. Be mindful of how you handle data in a secure way (we're a cybersecurity company). AI & Agent Data Enablement: Ensure AI agents have access to the necessary structured and unstructured data (Knowledge Bases, support tickets, documentation, internal data, pricing info, marketing content, etc.) required for them to perform tasks like answering questions, qualifying leads, preparing for calls, and identifying opportunities. Documentation & Knowledge Sharing: Create clear, self-maintaining documentation for data models, pipelines, and the semantic layer to enable both human users and AI agents to effectively interact with the data warehouse. What you'll bring? You can demonstrate an AI first mindset and that you've scaled an Analytics and BI function at another SaaS business in the past as the company grows, using cutting edge tools and technology. 5+ years of experience with data sourcing, storage and modelling to effectively deliver business value right through to BI platform. A can-do attitude and drive to build innovative, out-of-the-box solutions using technologies that you may be unfamiliar with. A security-first mindset - we are a cybersecurity company What would give you an edge? Looker is our main BI platform: a candidate should be familiar with Explores, Looks, Dashboards and the Developer interface - maintaining dimensions and measures, create and maintain models, and be able to run and debug raw SQL queries. Be able to edit and deploy custom visualizations using Looker's extension SDK. Interface with Looker's API. CloudSQL (PostgreSQL) and BigQuery for storage and query: be comfortable with writing complex queries, indices, materialised views, clustering, partitioning, etc. Containers, Docker and Kubernetes (via GKE) are used to run our internal automations. Being familiar and confident being a Platform Engineer in our GCP project. Be familiar with technologies like n8n to automate processes and some experience with programming languages as our non-standard ETL workers are written in Go. Be comfortable interfacing with a variety of APIs from our vendor platforms (either REST+JSON or MCP Server, depending on what a vendor platform throws at you). Have experience with version control via GitHub, and a basic review process, like GitHub Flow. If all else fails, being comfortable and confident falling back to a custom built solution, just to get data in the right shape or form to enable the Analyst to continue their work. #LI-SR
UpGuard is a Certified Great Place to Work in the US, Australia, UK and India, establishing its position as a leading global technology employer. 99% of team members agree that UpGuard is a great place to work, apply now to find out why
As an Equal Employment Opportunity and Affirmative Action Employer, qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status
For applications to positions in the United States, please note, at this time we can only support hiring in the following US states: CA, MD, MA, IL, OR, WA, CO, TX, FL, PA, LA, MO, or DC
Before starting work with us, you will need to undertake a national police history check and reference checks. Also please note that at this time, we cannot support candidates requiring visa sponsorship or relocation.
-
Data Engineer
2 weeks ago
Melbourne, Victoria, Australia Tech & Data People Full time $80,000 - $120,000 per yearAre you the kind of engineer who loves solving tricky data problems, automating the boring stuff, and making things run faster and smarter? This role puts you right in the middle of a cloud-first data environment where you'll have the freedom to design, build and optimise pipelines, bring systems together, and use DevOps to keep everything running...
-
Senior Data Engineer
5 days ago
Melbourne, Victoria, Australia DNA Technology Services Full time $120,000 - $180,000 per yearWe're Hiring: Senior Data Engineer – Melbourne Location: Melbourne Job Type: Fixed Term – 1 year (potential to extend up to 2 more years)About the RoleWe are seeking aSenior Data Engineerto join our client's Data & Insights team. This role will be a key contributor to themigration of legacy reporting platformsand themodernization of data infrastructure....
-
Senior Data Engineer
7 days ago
Melbourne, Victoria, Australia INNOVATE IT AUSTRALIA Full time $150,000 - $200,000 per yearSenior Data Engineer – MainframeJob DescriptionMust Have SkillsPL SQLMainframeUnixDetailed Job DescriptionMandatory Skills:· Strong data engineering skills using SQL, Unix, OracleDetailed Job DescriptionMandatory Skills: · Strong data engineering skills using SQL, Unix, Oracle· Sound foundation in SQL and Shell scripting· Should have SQL Query...
-
Senior Data Engineer
1 week ago
Melbourne, Victoria, Australia INNOVATE IT AUSTRALIA Full time $104,000 - $130,878 per yearTitle : Senior Data Engineer : : MainframeLocation :Melbourne, VICMust Have Skills:• PL SQL• Mainframe• UnixDetailed Job DescriptionMandatory Skills:• Strong data engineering skills using SQL, Unix, Oracle• Sound foundation in SQL and Shell scripting• Should have SQL Query optimization skills• Extensive experience working in an agile...
-
Senior Data Engineers
2 weeks ago
Melbourne, Victoria, Australia Otic Group Full time $120,000 - $180,000 per year"Otic" means smart people doing smart work, together.We are a wholly owned Australian company committed to helping our clients design and build intelligent software solutions that unlock value in their business.Otic Group was formed to provide talented technology professionals an opportunity to work with not only some of the most prominent companies in...
-
Senior Data Engineer
2 weeks ago
Melbourne, Victoria, Australia Maincode Full time $120,000 - $180,000 per yearOverviewMaincode is building sovereign AI models in Australia. We are training foundation models from scratch, designing new reasoning architectures, and deploying them on state-of-the-art GPU clusters. Our models are built on datasets we create ourselves, curated, cleaned, and engineered for performance at scale. This is not buying off-the-shelf corpora or...
-
Principal Data Engineer
2 weeks ago
Melbourne, Victoria, Australia Tech & Data People Full time $250,000 per yearPrincipal Data Engineer – Melbourne – Hybrid - $250,000 - bleeding-edge Cloud & Data tech - enable next-gen analytics & AI Tech and Data People are working with a leading organisation that is driving large-scale digital and data transformation. We're looking for a Principal Data Engineer to design and deliver modern, secure, and scalable data...
-
Senior Data Engineer
2 weeks ago
Melbourne, Victoria, Australia Australian Unity Full time $120,000 - $180,000 per yearCompany description: Join us and let's make a bigger difference together.Established in 1840, we're Australia's first member-owned wellbeing company. Today we have over $1 billion in revenue and provide smart solutions and services to more than 700,000 Australians. We employ over 7000 people and our purpose is to Help People to Thrive.It's an exciting time...
-
Senior Data Engineer
7 days ago
Melbourne, Victoria, Australia Turing Consulting Full time $120,000 - $150,000 per yearRole Title: Senior Data EngineerLocation: Melbourne, Victoria, AustraliaContract Duration: 4 months (extendable)Description:Technical:Pyspark, Python, SparkSQL, SQL and Glue.AWS cloud experienceGood understanding of dimensional modellingGood understanding DevOps, CloudOps, DataOps, CI/CD & with a SRE mindsetUnderstanding of Lakehouse and DW...
-
Senior Data Engineer
2 weeks ago
Melbourne, Victoria, Australia Fair Supply Full time $120,000 - $180,000 per yearPicture this: you're a procurement director at a major company, and someone asks you a simple question."Can you guarantee there's no forced labor in your supply chain?"The pause isn't hesitation. It is calculation. You are running through years of contracts, supplier data from every corner of the globe, and compliance requirements that change almost as fast...