Data Engineering Solutions Leader

2 days ago

Perth, Western Australia beBeeSolutions Full time

About the Role

">

Impetus is seeking a highly skilled Solutions Architect to lead our team's data engineering efforts. As a key member of our organization, you will be responsible for designing and implementing end-to-end data solutions, including data ingestion, storage, transformation, and presentation layers.

">

Main Responsibilities

">
  • ">
  • Analyze business requirements and translate them into technical specifications for data pipelines, data lakes, and analytical processes.">
  • Design and architect data solutions that meet business needs and are scalable, efficient, and secure.">
  • Lead the setup, configuration, and optimization of Databricks clusters, workspaces, and jobs to ensure the platform operates efficiently.">
  • Manage access controls and security configurations to ensure data privacy and compliance.">
  • Design and implement data integration processes, ETL workflows, and data pipelines to extract, transform, and load data from various sources.">
  • Optimize ETL processes to achieve high data quality and reduce latency.">
  • Monitor and optimize query performance and overall platform performance.">
  • Identify and resolve performance bottlenecks in the Databricks environment.">
  • Establish and enforce best practices, standards, and guidelines for Databricks development.">
  • Implement data governance and data lineage processes to ensure data accuracy and traceability.">
  • Mentor and train team members on Databricks best practices.">
">

Requirements

">
  • ">
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.">
  • Experience handling structured and unstructured datasets.">
  • Strong proficiency in programming languages like Python, Scala, or SQL.">
  • Experience with Cloud platforms like AWS, Azure, or Google Cloud.">
  • Familiarity with big data technologies like Apache Spark, Hadoop, and data lake architectures.">
  • Develop and maintain data pipelines, ETL workflows, and analytical processes on the Databricks platform.">
  • Good experience in Data Engineering in Databricks Batch process and Streaming.">
  • Good experience in creating Workflows & Scheduling the pipelines.">
  • Good exposure on how to make packages or libraries available in DB.">
  • Familiarity in Databricks default runtimes.">
">

About Us

">

Impetus Technologies is a software products and services company focused on creating powerful and intelligent enterprises through deep data awareness, data integration, and advanced data analytics.

">

We empower the real-time data-driven enterprise, helping our clients win in the modern world of digital transformation.

">

We have won several awards and global organizations have recognized and appreciated our passion for technology and great work culture.

">

Our employees are our greatest assets, and we are currently expanding our talent pool.

  • Senior Solution Architect

    3 days ago

    Perth, Western Australia Starburst Data Full time

    About Starburst Starburst is the data platform for analytics, applications, and AI, unifying data across clouds and on-premises to accelerate AI innovation. Organizations—from startups to Fortune 500 enterprises in 60+ countries—rely on Starburst for fast data access, seamless collaboration, and enterprise-grade governance on an open hybrid data...

  • Cloud & AI Solution Engineer, Data Platform - Perth

    2 weeks ago

    Perth, Western Australia Microsoft Full time €90,000 - €120,000 per year

    Are you insatiably curious, deeply passionate about the realm of databases and analytics, and ready to tackle complex challenges in a dynamic environment in the era of AI? If so, we invite you to join our team as a Cloud & AI Solution Engineer in Data Platform for commercial customers at Microsoft. Here, you'll be at the forefront of cutting-edge projects...

  • Data Engineer

    3 weeks ago

    Perth, Western Australia Codida Full time

    Job Description: Data Engineer/ Data ModellerABOUT USAt Codida, we are a specialised data & analytics company driving digital transformation in Australia's resources sector. Founded in Perth in 2023, we combine deep industry knowledge with cutting-edge data solutions to help mining, oil, and gas clients unlock operational value.Working with industry-leading...

  • Data Engineer

    3 weeks ago

    Perth, Western Australia Codida Full time

    Job Description: Data Engineer/ Data ModellerABOUT USAt Codida, we are a specialised data & analytics company driving digital transformation in Australia's resources sector. Founded in Perth in 2023, we combine deep industry knowledge with cutting-edge data solutions to help mining, oil, and gas clients unlock operational value.Working with industry-leading...

  • Data Engineer

    3 weeks ago

    Perth, Western Australia Perth Airport Full time

    Perth Airport is Australia's Western Hub connecting the people, businesses and communities of Western Australia with the rest of Australia and the world. Operating 24 hours a day, seven days a week throughout the year, Perth Airport plays a significant role in providing economic, social and cultural benefits to West Australians. Perth Airport is investing...

  • Cloud & AI Solution Engineer, Data Platform - Perth

    1 hour ago

    Perth, Western Australia Microsoft Full time

    OverviewAre you insatiably curious, deeply passionate about the realm of databases and analytics, and ready to tackle complex challenges in a dynamic environment in the era of AI? If so, we invite you to join our team as a Cloud & AI Solution Engineer in Data Platform for commercial customers at Microsoft. Here, you'll be at the forefront of cutting-edge...

  • Data Solution Architect

    11 hours ago

    Perth, Western Australia beBeeData Full time $120,000 - $160,000

    Transforming Business with Scalable Data SolutionsYou will play a pivotal role in designing, building and implementing data solutions that drive significant business value. Your experience will enable you to comprehend and dissect business requirements, translating them into precise technical specifications. As a vital link between business stakeholders and...

  • Data Engineer

    3 weeks ago

    Perth, Western Australia Perth Airport Pty Full time

    Perth Airport is Australia's Western Hub connecting the people, businesses and communities of Western Australia with the rest of Australia and the world. Operating 24 hours a day, seven days a week throughout the year, Perth Airport plays a significant role in providing economic, social and cultural benefits to West Australians.Perth Airport is investing...

  • Data Engineer

    4 weeks ago

    Perth, Western Australia Codida Full time

    Codida Perth, Western Australia, AustraliaCodida Perth, Western Australia, AustraliaGet AI-powered advice on this job and more exclusive features.Job Description: Data Engineer/ Data ModellerABOUT USAt Codida, we are a specialised data & analytics company driving digital transformation in Australia's resources sector. Founded in Perth in 2023, we combine...

  • Data Engineer

    4 weeks ago

    Perth, Western Australia Codida Full time

    Codida Perth, Western Australia, AustraliaCodida Perth, Western Australia, AustraliaGet AI-powered advice on this job and more exclusive features.Job Description: Data Engineer/ Data ModellerABOUT USAt Codida, we are a specialised data & analytics company driving digital transformation in Australia's resources sector. Founded in Perth in 2023, we combine...