Data Platform Specialist

3 days ago

Brisbane, Queensland, Australia beBeeApiDeveloper Full time $80,000 - $120,000

We are seeking an experienced API Developer to join our team and contribute to the development and maintenance of our data platform. In this role, you will be responsible for defining, designing, and maintaining enterprise platforms and solutions.


You will work with various DevOps tools and services, develop APIs using frameworks such as REST and FastAPI, and utilize Python data libraries for data engineering tasks. Your work will involve improving non-functional aspects like reliability, availability, security, and performance, as well as engaging in data engineering tasks and maintaining system reliability and uptime.


Responsibilities:
  • Platform Development: Define, design, and maintain enterprise platforms and solutions.
  • API Development: Develop APIs using tools and frameworks such as REST and FastAPI.
  • Data Libraries: Utilize Python data libraries (SQLAlchemy, PySpark) for data engineering tasks.
  • Communication: Clearly and concisely communicate technical, architectural, and organizational problems and propose thorough iterative solutions.
  • Performance Improvement: Measure and improve non-functional aspects like reliability, availability, security, and performance.
  • DevOps Tools: Work with DevOps tools and services (Git, Azure DevOps, etc.).
  • Data Engineering: Engage in data engineering tasks (ETL, Presto, Hive, etc.).
  • Continuous Integration: Implement and maintain Continuous Delivery, Continuous Integration, and Infrastructure as Code within the DevOps ecosystem.
  • Technical Support: Provide technical support, bug fixing, and enhancements for the Unity data platform.
  • Feature Development: Develop features and improvements to the Unity data platform in a secure, well-tested, and performant manner.
  • Collaboration: Collaborate with Product Management, Engineers, Cyber, and other stakeholders to maintain high quality in a fast-paced, iterative environment.
  • Security: Respond to automated Security and Vulnerability reports (e.g., generated by Snyk).
  • Issue Resolution: Investigate and resolve issues with data pipeline deployment, including metadata, middle layer, or pipeline-related problems.
  • System Reliability: Maintain system reliability and uptime.

Required Skills and Qualifications:
  • Programming Languages: Proficiency in one or more programming languages (Python, SQL).
  • API Development: Experience with API development tools and frameworks (REST, FastAPI).
  • Python Libraries: Familiarity with Python data libraries (SQLAlchemy, PySpark).
  • Platform Design: Experience in defining, designing, and maintaining enterprise platforms and solutions.
  • Communication Skills: Strong communication skills to address technical, architectural, and organizational problems.
  • Non-Functional Requirements: Understanding and experience in measuring non-functional requirements (reliability, availability, security, performance).
  • Data Engineering: Experience in the data engineering domain (ETL, Presto, Hive, etc.).
  • DevOps Knowledge: Knowledge of the DevOps ecosystem, including Continuous Delivery, Continuous Integration, and Infrastructure as Code.

Benefits:

We offer a range of benefits that help our employees grow professionally and personally. These include:

  • Pursuing innovative career tracks and opportunities.
  • Enhancing professional development through education and dedicated training.
  • A competitive compensation and benefits package.

We are committed to creating a diverse and inclusive workplace where everyone feels valued and empowered to succeed. Join us and be part of a collaborative and dynamic team that is shaping the future of technology.

  • Solution Architect – Application Platform

    4 days ago

    Brisbane, Queensland, Australia Data#3 Full time

    Solution Architect – Application PlatformData#3 Brisbane City, Queensland, AustraliaJoin or sign in to find your next jobJoin to apply for the Solution Architect – Application Platform role at Data#3Solution Architect – Application PlatformData#3 Brisbane City, Queensland, Australia1 day ago Be among the first 25 applicantsJoin to apply for the...

  • Data Platform Specialist

    1 day ago

    Brisbane, Queensland, Australia beBeeDataPlatform Full time $150,000 - $200,000

    Job Title: Data Platform EngineerWe are seeking a skilled Data Platform Engineer to join our team. As a key member of the Global Investor and Distribution Solutions (GIDS) APAC Data Platform team, you will lead the design, development, and optimization of our enterprise data platform.About the Role:The successful candidate will be responsible for shaping our...

  • Data Management Platform Specialist

    2 days ago

    Brisbane, Queensland, Australia GHD Full time

    OverviewWe're seeking a Data Management Platform Specialist to administer and maintain GHD's Informatica Cloud environments, ensuring platform stability, scalability, and seamless integration across the enterprise. This role will contribute to the Enterprise Data Management Platform strategy and help uplift and train the business on platform processes and...

  • Data Management Platform Specialist

    2 days ago

    Brisbane, Queensland, Australia GHD Full time

    OverviewWe're seeking a Data Management Platform Specialist to administer and maintain GHD's Informatica Cloud environments, ensuring platform stability, scalability, and seamless integration across the enterprise. This role will contribute to the Enterprise Data Management Platform strategy and help uplift and train the business on platform processes and...

  • Cloud Data Platform Transformation Specialist

    22 hours ago

    Brisbane, Queensland, Australia beBeeProject Full time $1,000 - $1,050

    Migration Project LeadThis is a 6-month daily rate contract with potential extensions based on project needs.We are seeking an experienced Migration Project Lead to oversee the end-to-end migration of an existing Data Warehouse (DW) to a modern cloud-based environment. This is a critical initiative that involves the decommissioning of the legacy data...

  • Senior Data Platform Specialist

    2 days ago

    Brisbane, Queensland, Australia beBeeData Full time $150,000 - $195,000

    Job OverviewWe are seeking an experienced Data Architect to lead the design and development of our enterprise data platform. This role is pivotal in shaping our data platform strategy, ensuring scalability, reliability, and performance across our data ecosystem.You will contribute to the architecture and design of scalable, secure, and high-performance data...

  • Data Platform Developer

    2 days ago

    Brisbane, Queensland, Australia beBeeEnvironmentalHealth Full time $134,483 - $153,562

    Job Title: Environmental Health Data SpecialistOverviewSupport the development of a national-scale data platform for environmental health research. Acquire, prepare, and manage complex spatial and time-series datasets from various custodians.This role focuses on data identification, acquisition, documentation, and management. You will contribute to the...

  • Senior Data Platform Specialist

    1 day ago

    Brisbane, Queensland, Australia beBeeData Full time $150,000 - $180,000

    Key Roles and ResponsibilitiesWe are seeking an experienced professional to lead the technical delivery of large-scale data platform and business intelligence solutions.The successful candidate will be responsible for designing and implementing robust data platforms and end-to-end components, as well as providing thought leadership on data profiling and...

  • Data Platform Lead

    8 hours ago

    Brisbane, Queensland, Australia beBeeDataPlatform Full time $90,000 - $120,000

    Job TitleA highly skilled Data Platform Lead, you will spearhead the technical delivery of large-scale data platform and BI solutions.About the RoleThis is a client-facing role that requires excellent communication skills, as you will be working closely with clients, practice leads, project managers, scrum masters, and teams to deliver robust Data Platform...

  • Data Platform Solutions Specialist

    3 days ago

    Brisbane, Queensland, Australia beBeeSolution Full time $115,000 - $130,000

    Solution Architect - Data PlatformsWe are seeking an experienced Solution Architect to join our dynamic data-driven organisation and help deliver critical capabilities using Databricks and modern cloud technologies.This is your opportunity to work on complex, enterprise-scale solutions that drive business outcomes across multiple portfolios.Define solution...