Data Infrastructure Expert

1 week ago

Sydney, New South Wales, Australia beBeeData Full time $100,000 - $140,000

Job Title: Senior Data Platform Specialist

Job Description:

We are seeking an experienced data platform professional to join our organization.

The successful candidate will be responsible for designing and implementing scalable and efficient data storage and retrieval systems, optimizing data lake performance, and ensuring the smooth handling of our data workloads on AWS.

  • Implement and manage data lake solutions using Apache Iceberg to handle time-travel, schema evolution, and transaction support.
  • Optimize data storage and querying by integrating Iceberg tables into AWS services like S3, Glue, Redshift, and EMR.
  • Work closely with data scientists and analysts to ensure seamless data access and efficient data processing workflows.
  • Monitor, troubleshoot, and optimize performance of data solutions, managing scalability and cost-effectiveness.
  • Keep up-to-date with the latest AWS offerings and Apache Iceberg features, continuously improving our data infrastructure.
  • Develop best practices for data governance, security, and compliance within our AWS and Iceberg environments.
  • Document system designs, architectures, and operational manuals for data solutions.

To succeed in this role, you must have extensive experience with AWS data services and a strong understanding of Apache Iceberg. A proven track record in building and optimizing data lakes and data warehouse solutions is also required.

Required Skills and Qualifications:

Our ideal candidate will possess the following skills and qualifications:

  • Extensive experience with AWS data services.
  • Strong understanding of Apache Iceberg.
  • Proven track record in building and optimizing data lakes and data warehouse solutions.
  • Proficiency in working with big data processing tools and frameworks.
  • Strong coding skills in languages such as Python, Java, or Scala.
  • Experience with infrastructure as code (IaC), such as AWS CloudFormation or Terraform.
  • Familiarity with data orchestration tools like Apache Airflow.
  • Excellent analytical, problem-solving, and teamwork skills.
  • Strong communication abilities for both technical and non-technical audiences.
Benefits:

This role offers a unique opportunity to work with a talented team of professionals and contribute to the development of innovative data solutions.

Others:

Please submit your resume and cover letter to apply for this position.

  • Data Infrastructure Optimization Expert

    2 weeks ago

    Sydney, New South Wales, Australia beBeeStorage Full time $120,000 - $170,000

    Job Summary: We are seeking an expert in storage management and optimization to take ownership of technology solutions for production enterprise storage infrastructure. The ideal candidate will have expertise in deploying, administering, and supporting network attached storage (NAS) devices in enterprise infrastructure.Key Responsibilities:Manage and...

  • Data Center Infrastructure Expert

    1 week ago

    Sydney, New South Wales, Australia beBeeInfrastructure Full time $130,000 - $170,000

    Highly skilled professionals are sought after to manage the design, planning, delivery and operation of AWS global infrastructure. As a senior data center infrastructure availability engineer, you will play a pivotal role in ensuring the seamless functioning of our cloud services.Job DescriptionThis is an exciting opportunity for individuals with expertise...

  • Associate Director, Infrastructure Portfolio

    2 weeks ago

    Sydney, New South Wales, Australia Infrastructure Nsw Full time

    **EOI Associate Director- Infrastructure Portfolio Performance, Temporary, Sydney**This role is a **4-week **temporary role commencing on **27 September 2024 to 25 October 2024**. This role is a salary Grade 11/12, with the base salary for this role starting at $139,787 base plus superannuation.**Join INSW and play your part in creating a sustainable...

  • Data Center Expert

    2 weeks ago

    Sydney, New South Wales, Australia beBeeAvailability Full time $180,000 - $250,000

    Job Title: Senior Data Center Infrastructure Availability EngineerJob Summary:A high-level expert in data center infrastructure is required to design, plan, deliver, and operate all global infrastructure to ensure customer access to innovation.Key Responsibilities:Design and develop infrastructure solutions to meet business requirements.Collaborate with...

  • Infrastructure Design Expert

    1 week ago

    Sydney, New South Wales, Australia beBeeInfrastructure Full time US$144,480 - US$168,960

    We are seeking a skilled Infrastructure Design Expert to join our engineering team. This role offers the opportunity to design and develop innovative solutions for critical communications pathways, spaces, and cabling within data centers.Key Responsibilities:Collaborate with engineers and managers company-wide to develop solutions for the physical...

  • Data Infrastructure Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeInfrastructure Full time $140,000 - $180,000

    Job Title We are seeking a Data Infrastructure Specialist to join our team. This role involves architecting and maintaining a hybrid on-premises and cloud-based data platform. The systems you build will ingest, store, and serve large amounts of financial data—reliably and with low latency. Your work will directly support trading, research, and...

  • Data Center Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDesigner Full time $100,000 - $120,000

    Infrastructure Designer - Data Center ExpertThe role of an Infrastructure Designer is pivotal in crafting and implementing infrastructure solutions for global data centers. As part of our team, you will collaborate with engineers and managers to develop cutting-edge solutions for the physical layer, ensuring timely delivery of scalable fiber optic & copper...

  • Chief Data Infrastructure Specialist

    7 days ago

    Sydney, New South Wales, Australia Bebeedataengineer Full time

    Job OverviewLeverage cutting-edge technology to drive business success. We're passionate experts prioritising accountability, excellence and work-life balance.About the RoleYou'll architect and maintain a hybrid data platform ensuring large amounts of financial data is accurate timely and accessible. This role blends data engineering and infrastructure...

  • Data-Driven Infrastructure Expert

    2 weeks ago

    Sydney, New South Wales, Australia beBeeReliability Full time $150,000 - $170,000

    Transforming Employee Experience with Data IntelligenceOur goal is to make a better world of work through data-driven insights and analytics platforms.Culture Amp empowers companies to transform employee engagement, drive performance management, and develop high-performing teams. Our platform is powered by people science and the most comprehensive employee...

  • Lead Data Infrastructure Developer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $121,107 - $125,679

    Job TitleA Senior Data Engineer is required to lead the development of data infrastructure and intelligence for a comprehensive cancer network in South Australia.Lead the development of state-of-the-art data infrastructure and intelligence for Cancer (CANDI) as a core enabler for the Comprehensive Cancer Network (CCN).Collaborate with clinicians, consumers,...