Lead, Data Engineer

2 days ago

Melbourne, Victoria, Australia L3HHCM20 Full time $120,000 - $180,000 per year

Job Title: Lead, Data Engineer 

Job Code: 29874

Job Location: Melbourne, FL (On-Site)

Job Schedule: 9/80: Employees work 9 out of every 14 days – totaling 80 hours worked – and have every other Friday off

Job Description:

L3Harris Enterprise Data and AI team is seeking a Data Engineer with experience in managing enterprise-level data life cycle processes. This role includes overseeing data ETL/ELT pipelines, ensuring adherence to data standards, maintaining data frameworks, conducting data cleansing, orchestrating data pipelines, and ensuring data consolidation. The selected individual will play a pivotal role in maintaining ontologies, building scalable data solutions, and developing dashboards to provide actionable insights for the enterprise within Palantir Foundry.

This position will support the company's modern data platform, Unified Data Layer, focusing on data pipeline development and maintenance, data platform design, documentation, and user training. The goal is to ensure seamless access to data for all levels of the organization, empowering decision-makers with clean, reliable data.

Essential Functions:

Design, build, and maintain robust data pipelines to ensure reliable data flow across the enterprise.Maintain data pipeline schedules, orchestrate workflows, and monitor the overall health of data pipelines to ensure continuous data availability.Create, update, and optimize data connections, datasets, and transformations to align with business needs.Troubleshoot and resolve data sync issues, ensuring consistent and correct data flow from source systems.Collaborate with cross-functional teams to uphold data quality standards and ensure accurate data is available for use.Utilize Palantir Foundry to establish data connections to source applications, extract and load data, and design complex logical data models that meet functional and technical specifications.Develop and manage data cleansing, consolidation, and integration mechanisms to support big data analytics at scale.Build visualizations using Palantir Foundry tools and assist business users with testing, troubleshooting, and documentation creation, including data maintenance guides.

Qualifications:

Bachelor's Degree and minimum 9 years prior Palantir experience or Graduate Degree and a minimum of 7 years of prior Palantir experience In lieu of degree, minimum 13 years of prior Palantir experience.4+ years of experience with design, development of Data Pipelines in Palantir Foundry Pipeline Builder or Code Repo, PySpark and Spark SQL, and data build/sync schedule deployment in Palantir4+ years of experience with Data Pipeline development or ETL tools such as Palantir Foundry, Azure Data Factory, SSIS or Python5+ Years of overall Data Integration experience in Palantir or similar data integration tools.

Preferred Additional Skills:

Understanding of BI (Business Intelligence) & DW (Data Warehouse) development methodologies.Experience with Snowflake cloud data platform including but not limited to hands-on experience with SnowflakeExperience with Python, Pandas, Databricks, JavaScript, Typescript or other scripting languagesExperience in ETL tools such as Palantir Foundry, ADF (Azure Data Factory), SSIS, Informatica or Talend is preferableWorking knowledge to connect and extract data from various ERP applications such as Oracle EBS, SAP ECC/S4, Deltek Costpoint, REST API, and more.Experience with AI tools such as OpenAI, Palantir AIP, Snowflake Cortex or similar.

#LI-NR1

  • Data Engineer

    1 week ago

    Melbourne, Victoria, Australia Tech & Data People Full time $80,000 - $120,000 per year

    Are you the kind of engineer who loves solving tricky data problems, automating the boring stuff, and making things run faster and smarter? This role puts you right in the middle of a cloud-first data environment where you'll have the freedom to design, build and optimise pipelines, bring systems together, and use DevOps to keep everything running...

  • Lead Data Engineer

    2 weeks ago

    Melbourne, Victoria, Australia HireCloud Full time $100,000 - $120,000 per year

    **Lead Data Engineer - $800 - $900 pd - Work from home and CBD based office - Data Transformation Program The company:**My client is a multi-award winning Superannuation providers, with over $30 billion under management, and offering a range of products. With its friendly team, flexible environment and family friendly hours, this company is an employer of...

  • Data Engineering Lead

    1 week ago

    Melbourne, Victoria, Australia LTIMindtree Full time $120,000 - $180,000 per year

    LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help...

  • Data Engineer Lead

    2 weeks ago

    Melbourne, Victoria, Australia ALOIS Solutions Full time $120,000 - $180,000 per year

    Role:Data Engineering Lead - Snowflake Implementation & Migration LeaderLocation:Melbourne, AUDuration: FTC 12 monthsThis is ahigh-visibility rolewhere the successful candidate will lead Snowflake migrations, design modern data solutions, and collaborate directly with senior client stakeholders (CIOs, Heads of Analytics, Finance teams, etc.). We are looking...

  • Principal Data Engineer

    5 days ago

    Melbourne, Victoria, Australia Tech & Data People Full time $250,000 per year

    Principal Data Engineer – Melbourne – Hybrid - $250,000 - bleeding-edge Cloud & Data tech - enable next-gen analytics & AI Tech and Data People are working with a leading organisation that is driving large-scale digital and data transformation. We're looking for a Principal Data Engineer to design and deliver modern, secure, and scalable data...

  • Lead Data Engineer

    1 week ago

    Melbourne, Victoria, Australia Feedzai Full time $120,000 - $180,000 per year

    Feedzai is the world's first RiskOps platform for financial risk management, and the market leader in safeguarding global commerce with today's most advanced cloud-based risk management platform, powered by machine learning and artificial intelligence. Feedzai is securing the transition to a cashless world while enabling digital trust in every transaction...

  • Data Consultant

    2 days ago

    Melbourne, Victoria, Australia Ignite Data Solutions Full time $90,000 - $120,000 per year

    Are you passionate about building data platforms, delivering business insights, or bringing machine learning models to life?Do you want to contribute to projects that enable the Australian Energy Transition?Want to expand your skills across cloud, machine learning, and modern BI platforms?At Ignite Data Solutions, we believe the best results come when data...

  • Machine Learning Engineer

    2 weeks ago

    Melbourne, Victoria, Australia Gamma Data Full time $438,000 - $511,000 per year

    Company DescriptionGamma Data is a team of data professionals specialising in building scalable, enterprise-grade data platforms using open source technologies. We provide services in Data Platform Engineering, Data Analytics & Machine Learning, Data Engineering, Cloud Data Infrastructure, Data Governance, and Data Strategy Consulting. Our mission is to help...

  • Data Engineering Tech Lead

    1 week ago

    Melbourne, Victoria, Australia Vanguard Australia Full time $120,000 - $180,000 per year

    About VanguardMore than 45 years ago, John C. Bogle had a vision to start an investment company that did things differently. A company with no external shareholders. Where all the profits were invested back into the business and used to lower costs. Evidently, it was as bold as it was brilliant. To this day, Vanguard Group still has no external shareholders....

  • Staff/Lead Data Engineer

    7 days ago

    Melbourne, Victoria, Australia Commonwealth Bank – Technology Full time $80,000 - $180,000 per year

    Staff Data Engineer (AWS & AI)You are passionate to stay ahead of the latest AWS Cloud, and Data Lake technologiesWe're one of the largest and most advanced Data Engineering teams in the countryTogether we can build state-of-the-art data solutions that power seamless experiences for millions of customersDo work that matters: As a Staff Data engineer with...