Lead Data Engineer

2 days ago

Brisbane, Queensland, Australia Integrant, Inc. Full time

We're on the lookout for exceptional individuals to join our team as
Lead Data Engineers
.
As a part of our team, you'll be driving change and making a significant impact in the gaming industry.
Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.
Engage in collaborative requirement elicitation activities with our valued clientele.
Mentor and guide junior team members in the field of data engineering.
Showcase your expertise by delivering innovative analytical solutions to our clients and contributing to knowledge transfer within the organization.
8+ years of experience as a data engineer.
Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.
Knowledge of Microsoft relational engines available – both on-premises (MS SQL Server) and on the cloud (Azure SQL, Azure Synapse Analytics Dedicated Pools).
Knowledge of query and workload optimization.
Knowledge of administrating and managing analytical solutions both on premises and on the cloud.
Knowledge of NoSQL offerings on Azure (e.g. CosmosDB).
Knowledge of setting up Data Lakes on ADLS gen 2 and Azure Synapse Analytics.
Knowledge of using SSIS and Azure Data Factory to set up ETL jobs.
Knowledge of setting up OLAP solutions using SSAS.
Familiarity with Azure Data Catalog to manage data lake metadata.
Familiarity with Azure HD Insight.
Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.
Familiarity with Azure Functions to perform lightweight transformations.
Knowledge of governance over Azure based analytical solutions including using tools such as Purview, Active Directory, Key Vault, Azure DevOps, etc.
Knowledge of using Azure Stream Analytics to capture and analyze data in real time.
Knowledge of setting up data warehouse solutions both on-premises (using MS SQL Server) and on the cloud (using Azure Synapse Analytics).
Knowledge of Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).
Knowledge of implementing common ETL patterns to support data warehouse workloads.
Knowledge of using U-SQL, PolyBase and Azure Data Lake Analytics to perform federated querying.
Knowledge of PowerBI.
Familiarity with SSRS.
Snowflake Experience:
Experience with Snowflake is required.
Nice to Have:
An MSc in Computer Science or other relevant field.
Familiarity with Azure Databricks.
Familiarity with DataOps
Familiarity with Azure Cognitive Services.
Familiarity with Azure ML.
Familiarity with MLOps.
Familiarity of containerization tools and frameworks (Docker, Kubernetes, etc.)
Salary paid in USD
Six-month career advancing opportunities
Supportive and friendly work environment
Premium medical insurance [employee +family]
English language development courses
Interest-free loans paid over 2.5 years
Technical development courses
Planned overtime program (POP)
Employment referral program
Premium location in Maadi
Social insurance
#J-18808-Ljbffr

  • Data Engineer Lead

    12 hours ago

    Brisbane, Queensland, Australia beBeeDataEngineeringManager Full time $180,000 - $250,000

    Job Title: Data Engineering Manager","The role of Data Engineering Manager involves leading and growing a global team of data services, overseeing the deployment, maintenance, and scaling of cloud-native platforms. This position is crucial in ensuring the scalability, reliability, and performance of data infrastructure.","About The Role:","Lead and mentor a...

  • Lead Data Engineer

    22 hours ago

    Brisbane, Queensland, Australia CYOS Solutions Full time

    Join to apply for the Lead Data Engineer role at CYOS Solutions1 day ago Be among the first 25 applicantsJoin to apply for the Lead Data Engineer role at CYOS SolutionsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from CYOS SolutionsTalent Acquisition Specialist @ CYOS Solutions | IT RecruitmentApplication...

  • Lead Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Mantel Group Pty Ltd Full time

    About usMantel Group is an Australian-owned technology consulting business with capabilities across Cloud, Digital, Data, Delivery & Security. Since our inception in November 2017, we have experienced remarkable growth across Australia & New Zealand and are honoured to be recognised as a Great Place to Work for 5 years in a rowWe hire smart and talented...

  • Lead Data Engineer

    3 days ago

    Brisbane, Queensland, Australia Endava Full time US$125,000 - US$175,000 per year

    Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...

  • Lead Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Xero Full time

    Our Purpose At Xero, we're here to help you supercharge your business.We do this by automating routine tasks, surfacing actionable insights and connecting businesses with the right data, advisors and apps.When that happens, we're not only making life better for small business, we'll be building a stronger economy that can change the world.About the team...

  • Data Engineers

    3 weeks ago

    Brisbane, Queensland, Australia Softtest Pays Full time

    Australian Citizens residing in Australia only respond.Must be able to obtain Baseline Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace.All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia.Role Responsibilities and...

  • Leading Enterprise Data Platform Engineer

    5 days ago

    Brisbane, Queensland, Australia beBeeDataEngineeringLeader Full time

    Job Title: Data Engineering Leader", "Overview :", "This role is pivotal in shaping our enterprise data platform strategy, ensuring scalability, reliability, and performance across our data ecosystem.", "Architect and lead the development of scalable, secure, and high-performance data platforms.", "Own the design and implementation the Data platform using...

  • Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Halo Labs Full time

    Get AI-powered advice on this job and more exclusive features.Halo Labs is a future focused, end-to-end data solutions firm - transforming tomorrow, today.Our intelligent and secure technology systems and data driven solutions drive meaningful outcomes and unlock lasting value.Why work at Halo Labs?Leading Innovation: We don't just solve problems; we...

  • Cyber Security Engineer

    5 days ago

    Brisbane, Queensland, Australia Data#3 Full time

    Join to apply for the Cyber Security Engineer role at Data#31 day ago Be among the first 25 applicantsJoin to apply for the Cyber Security Engineer role at Data#3Direct message the job poster from Data#3Managed Detection and Response | Full ticketing lifecycle management | Australian Citizen | Inner-city Brisbane suburb (close to all public transport) -...

  • Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Halo Labs Full time

    Get AI-powered advice on this job and more exclusive features.Halo Labs is a future focused, end-to-end data solutions firm - transforming tomorrow, today. Our intelligent and secure technology systems and data driven solutions drive meaningful outcomes and unlock lasting value.Why work at Halo Labs?Leading Innovation: We don't just solve problems; we...