Lead Data Engineer

3 weeks ago

Cairns, Australia Integrant, Inc. Full time

We're on the lookout for exceptional individuals to join our team as Lead Data Engineers. As a part of our team, you'll be driving change and making a significant impact in the gaming industry.

- Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.
- Engage in collaborative requirement elicitation activities with our valued clientele.
- Mentor and guide junior team members in the field of data engineering.
- Showcase your expertise by delivering innovative analytical solutions to our clients and contributing to knowledge transfer within the organization.

- 8+ years of experience as a data engineer.
- Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.
- Knowledge of Microsoft relational engines available – both on-premises (MS SQL Server) and on the cloud (Azure SQL, Azure Synapse Analytics Dedicated Pools).
- Knowledge of query and workload optimization.
- Knowledge of administrating and managing analytical solutions both on premises and on the cloud.
- Knowledge of NoSQL offerings on Azure (e.g. CosmosDB).
- Knowledge of setting up Data Lakes on ADLS gen 2 and Azure Synapse Analytics.
- Knowledge of using SSIS and Azure Data Factory to set up ETL jobs.
- Knowledge of setting up OLAP solutions using SSAS.
- Familiarity with Azure Data Catalog to manage data lake metadata.
- Familiarity with Azure HD Insight.
- Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.
- Familiarity with Azure Functions to perform lightweight transformations.
- Knowledge of governance over Azure based analytical solutions including using tools such as Purview, Active Directory, Key Vault, Azure DevOps, etc.
- Knowledge of using Azure Stream Analytics to capture and analyze data in real time.
- Knowledge of setting up data warehouse solutions both on-premises (using MS SQL Server) and on the cloud (using Azure Synapse Analytics).
- Knowledge of Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).
- Knowledge of implementing common ETL patterns to support data warehouse workloads.
- Knowledge of using U-SQL, PolyBase and Azure Data Lake Analytics to perform federated querying.
- Knowledge of PowerBI.
- Familiarity with SSRS.
- Snowflake Experience: Experience with Snowflake is required.

Nice to Have:

- An MSc in Computer Science or other relevant field.
- Familiarity with Azure Databricks.
- Familiarity with DataOps
- Familiarity with Azure Cognitive Services.
- Familiarity with Azure ML.
- Familiarity with MLOps.
- Familiarity of containerization tools and frameworks (Docker, Kubernetes, etc.)

- Salary paid in USD
- Six-month career advancing opportunities
- Supportive and friendly work environment
- Premium medical insurance [employee +family]
- English language development courses
- Interest-free loans paid over 2.5 years
- Technical development courses
- Planned overtime program (POP)
- Employment referral program
- Premium location in Maadi
- Social insurance

#J-18808-Ljbffr

  • [Urgent] Senior Data Engineer

    3 weeks ago

    Cairns, Australia Integrant, Inc. Full time

    We're on the lookout for exceptional individuals to join our team as Senior Data Engineers - Cloud. As a part of our team, you'll be driving change and making a significant impact in the gaming industry. - Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies. - Engage in...

  • Lead Engineer

    4 weeks ago

    Cairns, Queensland, Australia Austal Limited Full time

    Austal is seeking a Lead Engineer to oversee engineering support for the Cape Class Patrol Boats operated by the Australian Border Force. This role is responsible for managing all technical aspects of the In-Service Support contracts, ensuring compliance with regulatory frameworks, and maintaining the design integrity and configuration of the fleet....

  • Lead Control Systems Engineer

    1 week ago

    Cairns, Queensland, Australia Parasyn Full time $104,000 - $130,878 per year

    Help drive excellence and build better systems that change our industry. We are seeking professionals who can champion change and lead in their domain.Why are we here?Digital Transformation Winner of the Australian Business Awards, we are seeking qualified engineers / technologists who are passionate about their profession, who want to learn, and are...

  • Mission Systems Engineering Lead

    2 weeks ago

    Cairns, Australia Kinexus Full time

    Overview We are currently looking for an NV1 security cleared Engineering Lead to join our team on a permanent basis. This position will lead and coordinate the development and implementation of rapidly iterative and interchangeable Mission Systems and Software for Autonomous and Collaborative Platforms. This role offers uncapped training and development...

  • Turbine Engine Specialist

    6 days ago

    Cairns, Queensland, Australia MAF International Full time $80,000 - $120,000 per year

    Join MAF International as a Turbine Engine SpecialistWith over 75 years of aviation excellence, MAF (Mission Aviation Fellowship) brings help, hope, and healing to isolated communities through aviation. Your work as a Turbine Engine Specialist will directly support this mission by keeping our fleet safe, efficient, and ready to serve.Are you passionate about...

  • Senior Mechanical Engineer

    3 days ago

    Cairns, Australia GR Engineering Services Limited Full time

    Overview GR Engineering Services Limited (GRES) specialises in providing high quality engineering design and construction services to the mining and mineral processing industries. Our services cover all aspects of a project life cycle from the initial evaluation and study phase through to design, constructions, commissioning and operational support. The...

  • Mechanical Engineering Draftsperson

    2 weeks ago

    Cairns, Australia Robuk Engineering Full time

    Mechanical Engineering Draftsperson (4599074) Location: Hemmant, Australia Sector: Engineering Salary: $85,000.00 to $100,000.00 per annum Company: Robuk Engineering Pty Ltd We are seeking a dedicated and detail-oriented Mechanical Engineering Draftsperson to join our growing production team. In this role, you will be at the centre of our design...

  • JR Industrial Engineer

    5 days ago

    Cairns, Australia Crystal Migration Full time

    Job Title: JR Industrial Engineer Location: Mansfield, QLD Company: LYRO Robotics Salary: $77K - $85K Job Type: Full-Time About Us: LYRO Robotics Pty Ltd is a leader in innovative robotics and software solutions, specializing in robotic systems utilising AI enabled vision systems for complex picking, packing and visual analysis in industrial...

  • Senior Engineer – Maintenance Management Programs

    4 weeks ago

    Cairns, Queensland, Australia Cairns Regional Council Full time

    Senior Engineer – Maintenance Management ProgramsJoin to apply for the Senior Engineer – Maintenance Management Programs role at Cairns Regional CouncilSenior Engineer – Maintenance Management Programs1 day ago Be among the first 25 applicantsJoin to apply for the Senior Engineer – Maintenance Management Programs role at Cairns Regional CouncilGet...

  • Project Engineering Manager

    4 weeks ago

    Cairns, Queensland, Australia Kinexus Australia Full time

    Join to apply for the Project Engineering Manager - Darwin role at Kinexus AustraliaContinue with Google Continue with Google1 week ago Be among the first 25 applicantsJoin to apply for the Project Engineering Manager - Darwin role at Kinexus AustraliaWe're recruiting on behalf of a national infrastructure services provider delivering critical operations...