Senior Data Processing Specialist
2 days ago
A data engineer will develop, schedule and monitor Airflow DAGs and robust Python framework for data processing and ETL workflows.
Responsibilities:- Develop, schedule and monitor Airflow DAGs and a robust Python framework for data processing and ETL workflows.
- Collaborate with data engineers to optimize data pipelines and improve performance.
- Troubleshoot and resolve issues related to Airflow, EMR and data processing jobs.
- Enhance and maintain the existing codebase (including a robust Python framework), ensuring code quality and best practices.
- Strong proficiency in Python programming and experience with Apache Airflow.
- Must have hands-on knowledge with AWS services, especially S3, IAM, EC2, Glue, Redshift, Lambda and EMR.
- Strong Experience with Spark and big data processing frameworks.
- Understanding of data warehousing concepts and best practices.
- Excellent problem-solving and troubleshooting skills.
The ideal candidate should have at least 3-5 years of experience in data engineering and be proficient in Python programming. They should also have hands-on experience with AWS services and big data processing frameworks. Excellent problem-solving and troubleshooting skills are essential for this role.
BenefitsAs a data engineer at our company, you will have the opportunity to work on complex data processing projects and collaborate with experienced data engineers. You will also have access to ongoing training and professional development opportunities to enhance your skills and knowledge.
-
Data Science Process Analyst
4 days ago
Melbourne, Victoria, Australia beBeeDataScience Full time $90,000 - $110,000Business Process Specialist RoleWe are seeking an experienced Business Process Specialist to join our team and work within a Centre of Excellence focused on Data Science.This is an ideal opportunity for someone with strong process analysis skills, who has experience working across data science and/or MLOps projects.The successful candidate will be...
-
Solution Consultant- Data
3 weeks ago
Melbourne, Victoria, Australia Data#3 Full timeJoin to apply for the Solution Consultant- Data & AI role at Data#3Join to apply for the Solution Consultant- Data & AI role at Data#3Direct message the job poster from Data#3Passionate Talent Acquisition Specialist at Data#Collaborative, Supportive Team EnvironmentAward-Winning Culture – HRD Employer of Choice for 10 yearsNationally Respected Brand with...
-
Solution Consultant- Data
3 weeks ago
Melbourne, Victoria, Australia Data#3 Full timeJoin to apply for the Solution Consultant- Data & AI role at Data#3Join to apply for the Solution Consultant- Data & AI role at Data#3Direct message the job poster from Data#3Passionate Talent Acquisition Specialist at Data#Collaborative, Supportive Team EnvironmentAward-Winning Culture – HRD Employer of Choice for 10 yearsNationally Respected Brand with...
-
Senior Business Process Specialist
1 day ago
Melbourne, Victoria, Australia beBeeBusiness Full time $40,000 - $50,000About the RoleA senior business process specialist is required to join our team working in data science and machine learning operations. This position will provide additional support across several key projects.Key ResponsibilitiesProcess mapping and project environment designDesigning and implementing end-to-end frameworks for data science modelsDefining...
-
Senior Process Optimization Specialist
4 days ago
Melbourne, Victoria, Australia beBeeProcess Full time $90,000 - $125,000Senior Process Optimization SpecialistWe are seeking an experienced Senior Process Optimization Specialist to join our team. This role will involve leading the review of business processes, architecture, and design for intelligent solution delivery.Key Responsibilities:Engage with product owners and process owners to take end-to-end ownership of AI &...
-
Microsoft CSP Specialist – Azure
4 weeks ago
Melbourne, Victoria, Australia Data#3 Full timeJoin to apply for the Microsoft CSP Specialist – Azure role at Data#34 days ago Be among the first 25 applicantsJoin to apply for the Microsoft CSP Specialist – Azure role at Data#3Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Data#3Talent Attraction Specialist @ Data#3 | Driving Inclusive Talent...
-
Microsoft CSP Specialist – Azure
4 weeks ago
Melbourne, Victoria, Australia Data#3 Full timeJoin to apply for the Microsoft CSP Specialist – Azure role at Data#34 days ago Be among the first 25 applicantsJoin to apply for the Microsoft CSP Specialist – Azure role at Data#3Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Data#3Talent Attraction Specialist @ Data#3 | Driving Inclusive Talent...
-
Senior Software Lifecycle Specialist
4 weeks ago
Melbourne, Victoria, Australia NTT DATA Full timeAdd expected salary to your profile for insightsAs a Senior Software Lifecycle Specialist at NTT DATA, you will be our clients' trusted advisor for software, helping them maximize the value of their software investments and ensuring their overall satisfaction and loyalty with a primary focus on Cisco. Your key role is to build and maintain strong client...
-
Senior Data Governance Specialist
2 weeks ago
Melbourne, Victoria, Australia Buscojobs Full timeNewcastle-Maitland, Sydney, Melbourne, City of Brisbane AUD 100,000 - 130,000 Senior Data Governance Specialist page is loaded Senior Data Governance Specialist Apply locations Newcastle, Australia Sydney, Australia Melbourne, Australia Brisbane, Australia time type Full time posted on Posted 4 Days Ago job requisition id JR104288 Senior Data Governance...
-
Senior Data Governance Specialist
16 hours ago
Melbourne, Victoria, Australia beBeeDataGovernance Full time $93,000 - $142,625Senior Data Governance SpecialistWe are seeking a Senior Data Governance Specialist to join our team. In this role, you will be responsible for establishing and maintaining formal data management and governance functions within the organisation.
