Current jobs related to Optimize Large-Scale Data Processing Specialist - Sydney, New South Wales - beBeeDataEngineer
-
Mastering Large-Scale Data Processing
13 hours ago
Sydney, New South Wales, Australia beBeeDataEngineer Full time $160,000 - $200,000Data Engineering is a critical discipline in the realm of information technology. As organizations continue to grapple with the challenges of big data, the role of a Data Engineer has become increasingly vital.A Data Engineer designs, builds, and maintains the infrastructure that enables organizations to collect, process, and analyze large datasets. This...
-
Sydney, New South Wales, Australia beBeeWHS Full timeAbout the RoleWe are seeking a highly skilled WHS Coordinator to join our Data Centre team in Kemps Creek or Huntingwood.The successful candidate will work alongside and support a highly experienced Safety Manager who enjoys mentoring and developing those around him.A W Edwards is a leading builder with a long history of building iconic buildings in NSW,...
-
Transformative Data Specialist
13 hours ago
Sydney, New South Wales, Australia beBeeData Full time $90,000 - $100,000Big Data SpecialistAs a Big Data Specialist, you will be responsible for designing, developing, and maintaining large-scale data systems to support machine learning and AI model training. Your primary goal will be to extract valuable insights from complex data sets using various programming languages and tools.Key Responsibilities:Design and implement...
-
Senior Data Scientist: Data Infrastructure
4 days ago
Sydney, New South Wales, Australia beBeeMachineLearning Full timeJob DescriptionWe are seeking a skilled professional to develop and implement high-performance data pipelines for processing large-scale datasets with an emphasis on reliability and reproducibility. This role involves collaborating with researchers to translate their requirements into scalable, production-grade systems for AI experimentation.The ideal...
-
.NET Developer
6 hours ago
Sydney, New South Wales, Australia beBeeBackend Full time $90,000 - $120,000High-quality software solutions built with .NET technologies are at the forefront of this dynamic and fast-paced environment.Key ResponsibilitiesDevelop scalable software using .NET technologies to drive business growth.Collaborate effectively with cross-functional teams to create innovative features and enhance existing software.Diagnose and resolve...
-
Project Manager
1 hour ago
Sydney, New South Wales, Australia beBeeEngineering Full time $100,000 - $190,000Project Manager for Large-Scale InfrastructureWe are seeking a seasoned Project Manager to coordinate and manage various project elements, ensuring efficient progress and adherence to timelines.About the RoleThis is a challenging opportunity for an experienced professional to thrive in a fast-paced environment, collaborating with multidisciplinary teams to...
-
Data Transformation Specialist
4 days ago
Sydney, New South Wales, Australia beBeeTransformation Full time $150,000 - $170,000Marketing Data Transformation LeadThis is a unique opportunity to spearhead impactful marketing initiatives in campaign migration, data enablement, and analytics optimization.About the PositionOversee the end-to-end migration of marketing campaigns across digital platformsPromote data integration within Salesforce Marketing CloudLeverage Unica capabilities...
-
Senior Data Specialist
22 hours ago
Sydney, New South Wales, Australia beBeeData Full time $90,000 - $150,000Yellow Canary seeks a skilled Data Engineer to build, optimize and maintain Python data pipelines for ingestion. The ideal candidate will have experience designing and implementing ETL/ELT workflows for complex large-scale data pipelines.Key ResponsibilitiesDesign, build, and maintain data pipelines using Python and PandasImplement ETL/ELT workflows for...
-
Supply Chain Optimization Specialist
3 days ago
Sydney, New South Wales, Australia beBeeAnalyst Full timeSupply Chain Optimization SpecialistWe are seeking a skilled professional to join our team as a Supply Chain Optimization Specialist. This is an exciting opportunity for a detail-oriented and analytical individual who thrives in a dynamic environment and values quality, sustainability, and operational excellence.About the Role:The successful candidate will...
-
Supply Chain Optimization Specialist
22 hours ago
Sydney, New South Wales, Australia beBeeSupplyChain Full time $77,000 - $90,000Supply Chain Optimization SpecialistWe are seeking an analytical Supply Chain Optimization Specialist to join our team and drive meaningful change in supply chain operations.This role offers a unique opportunity to play a key part in optimizing inventory, reducing waste, and enhancing supply chain efficiency.The successful candidate will have a strong...
Optimize Large-Scale Data Processing Specialist
2 weeks ago
**Key Responsibilities**
- Collaborate with researchers to transform experimental workflows into production-ready data pipelines that meet performance and reliability standards.
- Develop and advance platforms and tools for the Research and Data Team.
- Monitor and optimize resource usage in partnership with the Data Platform team, balancing performance and cost-effectiveness.
- Implement monitoring tools and fine-tune systems for optimal throughput, latency, and reliability, ensuring seamless access to data.
- Design, build, and manage scalable data pipelines using Spark, Databricks, and proprietary HPC tooling, ensuring high availability, scalability, and performance.
- Provide technical mentorship to junior engineers and support the growth of the data engineering function in Sydney.
**Requirements**
- Expertise in Data Engineering concepts and technologies.
- Strong problem-solving skills.
- Ability to communicate technical concepts effectively.
**What We Offer**
- A dynamic and collaborative work environment.
- The opportunity to work on challenging projects and contribute to the growth of the data engineering function.
