Lead Data Engineer

3 weeks ago

Townsville, Queensland, Australia Integrant, Inc. Full time
We're on the lookout for exceptional individuals to join our team as Lead Data Engineers. As a part of our team, you'll be driving change and making a significant impact in the gaming industry.

- Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.
- Engage in collaborative requirement elicitation activities with our valued clientele.
- Mentor and guide junior team members in the field of data engineering.
- Showcase your expertise by delivering innovative analytical solutions to our clients and contributing to knowledge transfer within the organization.

- 8+ years of experience as a data engineer.
- Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.
- Knowledge of Microsoft relational engines available – both on-premises (MS SQL Server) and on the cloud (Azure SQL, Azure Synapse Analytics Dedicated Pools).
- Knowledge of query and workload optimization.
- Knowledge of administrating and managing analytical solutions both on premises and on the cloud.
- Knowledge of NoSQL offerings on Azure (e.g. CosmosDB).
- Knowledge of setting up Data Lakes on ADLS gen 2 and Azure Synapse Analytics.
- Knowledge of using SSIS and Azure Data Factory to set up ETL jobs.
- Knowledge of setting up OLAP solutions using SSAS.
- Familiarity with Azure Data Catalog to manage data lake metadata.
- Familiarity with Azure HD Insight.
- Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.
- Familiarity with Azure Functions to perform lightweight transformations.
- Knowledge of governance over Azure based analytical solutions including using tools such as Purview, Active Directory, Key Vault, Azure DevOps, etc.
- Knowledge of using Azure Stream Analytics to capture and analyze data in real time.
- Knowledge of setting up data warehouse solutions both on-premises (using MS SQL Server) and on the cloud (using Azure Synapse Analytics).
- Knowledge of Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).
- Knowledge of implementing common ETL patterns to support data warehouse workloads.
- Knowledge of using U-SQL, PolyBase and Azure Data Lake Analytics to perform federated querying.
- Knowledge of PowerBI.
- Familiarity with SSRS.
- Snowflake Experience: Experience with Snowflake is required.

Nice to Have:

- An MSc in Computer Science or other relevant field.
- Familiarity with Azure Databricks.
- Familiarity with DataOps
- Familiarity with Azure Cognitive Services.
- Familiarity with Azure ML.
- Familiarity with MLOps.
- Familiarity of containerization tools and frameworks (Docker, Kubernetes, etc.)

- Salary paid in USD
- Six-month career advancing opportunities
- Supportive and friendly work environment
- Premium medical insurance [employee +family]
- English language development courses
- Interest-free loans paid over 2.5 years
- Technical development courses
- Planned overtime program (POP)
- Employment referral program
- Premium location in Maadi
- Social insurance

#J-18808-Ljbffr

  • Senior Data Engineer

    3 weeks ago

    Townsville, Queensland, Australia Integrant, Inc. Full time

    We're on the lookout for exceptional individuals to join our team as Senior Data Engineers - Cloud. As a part of our team, you'll be driving change and making a significant impact in the gaming industry.- Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.- Engage in...

  • High Salary Principal Data Engineer

    2 weeks ago

    Townsville, Queensland, Australia Integrant, Inc. Full time

    OverviewWe/'re on the lookout for exceptional individuals to join our team as Principal Data Engineers - Cloud. As a part of our team, you/'ll be driving change and making a significant impact in the gaming industry.Responsibilities- Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud...

  • Lead Structural Engineer

    1 week ago

    Townsville, Queensland, Australia Agilitus Full time

    OverviewAgilitus Townsville, Queensland, AustraliaAs engineers we are faced with some of the most exciting challenges of our generation, from energy transition to food and water security. At Agilitus QLD we believe we are here to help change the future, we have the opportunity to create innovative solutions in response to these challenges and make a positive...

  • Lead Structural Engineer

    1 week ago

    Townsville, Queensland, Australia Agilitus Full time

    OverviewAgilitus Townsville, Queensland, AustraliaAs engineers we are faced with some of the most exciting challenges of our generation, from energy transition to food and water security. At Agilitus QLD we believe we are here to help change the future, we have the opportunity to create innovative solutions in response to these challenges and make a positive...

  • Lead Structural Engineer

    1 week ago

    Townsville, Queensland, Australia Agilitus Full time $70,000 - $120,000 per year

    As engineers we are faced with some of the most exciting challenges of our generation, from energy transition to food and water security. AtAgilitus QLDwe believe we are here to help change the future, we have the opportunity to create innovative solutions in response to these challenges and make a positive impact on society and our environment.We are a...

  • Electrical Engineer Lead

    2 weeks ago

    Townsville, Queensland, Australia beBeeSenior Full time $180,000 - $200,000

    Electrical Engineer Opportunities with a Global Leader">We are seeking an experienced Senior Electrical Engineer to join our team in South Townsville. As a key member of our Resources and Industrial (R&I) team, you will be responsible for managing electrical components of projects across all phases of the project lifecycle.">About This RoleYou will...

  • Data Researcher

    6 days ago

    Townsville, Queensland, Australia beBeeData Full time $80,000 - $120,000

    Remote Data Analyst OpportunityWe are seeking a detail-oriented and research-driven individual to join our team as a Remote Data Analyst. This is a part-time long-term project that requires flexibility and the ability to work independently.The successful candidate will be responsible for working on a project aimed at enhancing digital maps used by millions...

  • Big Data Software Developer

    6 days ago

    Townsville, Queensland, Australia beBeeDeveloper Full time $160,000 - $240,000

    Join a global leader in Big Data and analytics to drive software engineering solutions. This is an exciting opportunity to work with a team of passionate technologists pushing the boundaries of innovation.Job OverviewAs a talented software developer, you will design, develop, and test scalable software solutions in an Agile environment. You will work on our...

  • Associate Engineer

    5 days ago

    Townsville, Queensland, Australia Surbana Consultants Pte Ltd – Kingdom of Saudi Arabia (KSA) branch Full time

    Associate Engineer / Senior Associate/Senior Associate Engineer - Bridges & Structures page is loaded## Associate Engineer / Senior Associate/Senior Associate Engineer - Bridges & Structureslocations: Townsvilletime type: Full timeposted on: Posted Todayjob requisition id: JR112017* **Associate/Senior Associate Engineer – Bridges & Structures***...

  • Associate Engineer

    5 days ago

    Townsville, Queensland, Australia Surbana Consultants Pte Ltd – Kingdom of Saudi Arabia (KSA) branch Full time

    Associate Engineer / Senior Associate/Senior Associate Engineer - Bridges & Structures page is loaded## Associate Engineer / Senior Associate/Senior Associate Engineer - Bridges & Structureslocations: Townsvilletime type: Full timeposted on: Posted Todayjob requisition id: JR112017* **Associate/Senior Associate Engineer – Bridges & Structures***...