Senior Data Engineer

2 weeks ago

Cassowary Coast Regional, Australia Integrant, Inc. Full time

We're on the lookout for exceptional individuals to join our team as Senior Data Engineers - Cloud. As a part of our team, you'll be driving change and making a significant impact in the gaming industry.

  • Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.
  • Engage in collaborative requirement elicitation activities with our valued clientele.
  • Mentor and guide junior team members in the field of data engineering.
  • Showcase your expertise by delivering innovative analytical solutions to our clients and contributing to knowledge transfer within the organization.
    • 4+ years of experience as a data engineer.
    • Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.
    • Knowledge of Microsoft relational engines available – both on-premises (MS SQL Server) and on the cloud (Azure SQL, Azure Synapse Analytics Dedicated Pools).
    • Knowledge of query and workload optimization.
    • Knowledge of administrating and managing analytical solutions both on premises and on the cloud.
    • Knowledge of NoSQL offerings on Azure (e.g. CosmosDB).
    • Knowledge of setting up Data Lakes on ADLS gen 2 and Azure Synapse Analytics.
    • Knowledge of using SSIS and Azure Data Factory to set up ETL jobs.
    • Knowledge of setting up OLAP solutions using SSAS.
    • Familiarity with Azure Data Catalog to manage data lake metadata.
    • Knowledge of governance over Azure based analytical solutions including using tools such as Purview, Active Directory, Key Vault, Azure DevOps, etc.
    • Knowledge of using Azure Stream Analytics to capture and analyze data in real time.
    • Knowledge of setting up data warehouse solutions both on-premises (using MS SQL Server) and on the cloud (using Azure Synapse Analytics).
    • Knowledge of Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).
    • Knowledge of implementing common ETL patterns to support data warehouse workloads.
    • Knowledge of using U-SQL, PolyBase and Azure Data Lake Analytics to perform federated querying.
    • Knowledge of PowerBI.
    • Familiarity with SSRS.
    • Snowflake Experience: Experience with Snowflake is required.

Nice to Have:

  • An MSc in Computer Science or other relevant field.
  • Familiarity with Azure Databricks.
  • Familiarity with DataOps
  • Familiarity with Azure Cognitive Services.
  • Familiarity with Azure ML.
  • Familiarity with MLOps.
  • Familiarity of containerization tools and frameworks (Docker, Kubernetes, etc.)
  • Familiarity with Azure HD Insight.
  • Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.
  • Familiarity with Azure Functions to perform lightweight transformations.
    • Salary paid in USD
    • Six-month career advancing opportunities
    • Supportive and friendly work environment
    • Premium medical insurance [employee +family]
    • English language development courses
    • Interest-free loans paid over 2.5 years
    • Technical development courses
    • Planned overtime program (POP)
    • Employment referral program
    • Premium location in Maadi
    • Social insurance
    #J-18808-Ljbffr

  • Senior Data Solutions Architect

    2 weeks ago

    Cassowary Coast Regional, Australia beBeeData Full time $120,000 - $140,000

    Job Title: Senior Data Solutions ArchitectThis role involves driving the design, development, and maintenance of comprehensive data analytical solutions using Microsoft on-premises and cloud technologies.The ideal candidate will possess strong leadership skills and experience in mentoring junior team members in data engineering.Required Skills and...

  • Lead Data Engineer

    2 weeks ago

    Cassowary Coast Regional, Australia Integrant, Inc. Full time

    We're on the lookout for exceptional individuals to join our team as Lead Data Engineers.As a part of our team, you'll be driving change and making a significant impact in the gaming industry.Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.Engage in collaborative...

  • Principal Data Engineer

    2 weeks ago

    Cassowary Coast Regional, Australia Integrant, Inc. Full time

    OverviewWe\'re on the lookout for exceptional individuals to join our team as Principal Data Engineers - Cloud. As a part of our team, you\'ll be driving change and making a significant impact in the gaming industry.ResponsibilitiesLead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud...

  • Lead Data Engineer

    2 weeks ago

    Cassowary Coast Regional, Australia Integrant, Inc. Full time

    We're on the lookout for exceptional individuals to join our team as Lead Data Engineers. As a part of our team, you'll be driving change and making a significant impact in the gaming industry.Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.Engage in collaborative...

  • Chief Data Innovator

    1 week ago

    Cassowary Coast Regional, Australia beBeeDataEngineer Full time US$120,000 - US$140,000

    Drive Data Excellence as a Senior Data Engineer.About the RoleLead the conception, development, and upkeep of comprehensive data analytical solutions using Microsoft on-premises and cloud technologies.Engage in collaborative requirement elicitation activities with valued clients.Mentor and guide junior team members in data engineering best practices.Deliver...

  • Senior Data Architect

    1 week ago

    Cassowary Coast Regional, Australia beBeeDataEngineer Full time US$180,000 - US$200,000

    Job OpportunityWe are seeking a highly skilled Data Engineer to join our team. This individual will be responsible for designing, developing, and maintaining end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.The successful candidate will have a strong background in data engineering, with experience in leading the design...

  • Senior Data Architect

    2 weeks ago

    Cassowary Coast Regional, Australia beBeeDataEngineer Full time

    Lead Data EngineerWe are seeking a highly skilled and experienced Lead Data Engineer to join our team. In this role, you will be responsible for driving the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.Key Responsibilities:Design and develop robust data architectures to...

  • Senior Full Stack Engineer

    2 weeks ago

    Cassowary Coast Regional, Australia Integrant, Inc. Full time

    Join Our TeamAre you ready to take your development skills to the next level? Integrant is looking for a passionate and driven Senior Full Stack Engineer who specializes in Next.js to join our vibrant team In this role, you will be at the forefront of building cutting-edge web applications that deliver seamless user experiences.If you thrive in a...

  • Senior Full Stack Engineer

    2 weeks ago

    Cassowary Coast Regional, Australia Integrant, Inc. Full time

    Join Our TeamAre you ready to take your development skills to the next level? Integrant is looking for a passionate and driven Senior Full Stack Engineer who specializes in Next.js to join our vibrant team In this role, you will be at the forefront of building cutting-edge web applications that deliver seamless user experiences. If you thrive in a...

  • Data Engineer

    2 weeks ago

    Southern Downs Regional, Australia The Onset Full time

    Join to apply for the Data Engineer - Sensor Fusion role at The Onset2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Job DescriptionMLOps Engineer - Sensor FusionSydney$140,000 - $160,000 + superThis role offers an exciting opportunity to deepen your expertise in MLOps while working on cutting-edge...