Data Engineering Specialist

3 weeks ago

Sydney, New South Wales, Australia Attribute Group Full time

About this role

As a seasoned Data Engineer at Attribute Group, you will be responsible for designing, implementing, and managing large-scale data systems to extract, transform, and load data from diverse sources using SQL, Spark, and Cloudera technologies.

Key Responsibilities

  • Develop, implement, and manage scalable data systems to ensure efficient extraction, transformation, and loading of data from diverse sources.
  • Create high-performance algorithms, predictive models, and prototypes utilizing Spark and Scala.
  • Handle and deploy interactive Hive queries for data analysis and manipulation.
  • Maintain data privacy and compliance in line with data governance standards.
  • Collaborate with stakeholders to address technical issues and support data infrastructure needs.
  • Work with data scientists to transform data and integrate algorithms and models into automated processes.

Qualifications

  • Proficient in Spark, Scala, and Hive, with practical experience in Cloudera Data Platform (CDP).
  • Extensive experience in building and optimizing big data pipelines, architectures, and data sets.
  • Strong knowledge of Spark SQL and ANSI SQL.
  • Experience in the banking sector, preferably in Payments or Financial Crime.
  • Skilled in data pipeline and workflow management tools.
  • Excellent project management and organizational skills.
  • Proven ability to support and collaborate with cross-functional teams in a dynamic environment.

  • Data Centre Engineering Specialist

    4 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About us: CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team, promoting an inclusive workplace that values diversity.We believe that everyone's unique experiences enable us to deliver meaningful benefits for...

  • Data Centre Engineering Specialist

    1 month ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Technical Solutions Engineer to provide thought leadership, planning, management, and technical design development for our...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Drive Business Value with Data Engineering at Domain GroupWe are seeking a skilled Data Engineer to join our Data Decision Science team in Sydney. As a key member of our data department, you will play a critical role in building scalable data pipelines that power Australia's property market.About the RoleThis is an exciting opportunity to work with...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on the property market, simplifying the journey for all involved. Our expertise and exclusive data drive change. At Domain Group, our data department leads the way in driving value across the organisation.The RoleAs a Senior Data Engineer, you'll play a key role in building data pipelines that power Australia's property market....

  • Data Property Solutions Engineer

    4 days ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Solutions Data Engineer to join our team at Data-Property Data Solns Shared. As a Senior member of our organization, you will play a critical role in shaping the future of property data solutions.About UsWe shine a light on all things property, aiming to simplify the property journey for all involved. Our business is motivated...

  • Data Engineer for Property Insights

    6 days ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our Single View Property (SVP) team at Domain. This role is perfect for someone who thrives in a dynamic environment and has a passion for working with data to drive business outcomes.

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to design, implement, and support telemetry systems and reporting solutions within our IT environments. The...

  • Data Engineering Specialist

    1 month ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About the role Data Engineering SpecialistJob Overview:As a Data Engineering Specialist at Pyramid Global Technologies, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data ingestion pipelines using technologies such as Swoop and FlumeDevelop and optimize data...

  • Senior Software Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Dicker Data Full time

    Job Description:As a senior software engineer in data analysis, you will be responsible for developing and maintaining large-scale data processing systems. Your primary focus will be on designing and implementing data pipelines using Python, ensuring data quality and integrity. You will work closely with cross-functional teams to deliver high-quality...

  • Data Centre Design Engineer Position

    1 week ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, our company has grown to become the largest provider of co-location, containerised and hyperscale compute environments with high-speed carrier-grade networks connecting all campuses.We are committed to creating an...

  • Data Engineering Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Randstad Full time

    About the RoleWe are seeking an experienced Data Engineering Specialist to join our elite engineering and solution design team in Sydney.You will play a key role in creating our next-generation data capabilities at an enterprise level with a modern mindset.Your responsibilities will include designing, developing, deploying, and supporting data assets, as...

  • Senior Data Engineering Specialist

    3 weeks ago

    Sydney, New South Wales, Australia Bluefin Resources Full time

    We are seeking a skilledSenior Data Engineering Specialist to join our team at Bluefin Resources. This role will focus on designing and automating data pipelines, datasets, and processes on either AWS or GCP, ensuring high availability and performance.Key Responsibilities:Design and Automation: Develop and implement efficient data pipelines and processes to...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Cdc Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade networks.We are passionate about...

  • Senior Data Engineer

    1 month ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, we have a strong presence in Canberra, NSW, and New Zealand, with a diverse range of operations that provide secure data centre configurations for co-location, containerised, and hyperscale compute environments.We are...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About CDC Data CentresWe are a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team by creating an inclusive workplace that promotes and values diversity.About the RoleWe are seeking a highly skilled Senior Data Engineer to design,...

  • Data Engineering Leader

    2 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading provider of sovereign and secure data centre facilities in Australia.We are passionate about creating an inclusive workplace that promotes diversity and values individual experiences. Our mission is to attract, retain, and grow the world's best data centre team.Our team is dedicated to delivering meaningful benefits for...

  • Data Engineering Specialist

    1 week ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    At Commonwealth Bank of Australia, we're pushing the boundaries of innovation to create a bank that's truly fit for the future. As a Data Engineering Specialist, you'll play a key role in helping us achieve this vision.About the RoleWe're seeking an experienced Data Engineer to join our team and help us design, develop, and optimize Flink data streams for...

  • Data Engineering Specialist

    4 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Job Summary:Cognizant is seeking a highly skilled Data Engineering Specialist to join our team. As a Data Engineering Specialist, you will be responsible for designing, implementing, and optimizing data infrastructures in highly regulated environments, particularly within the professional indemnity insurance domain.Key Responsibilities:Design and develop...

  • Data Engineering and Warehousing Specialist

    4 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About the role at Pyramid Global TechnologiesJob Overview:We are seeking a highly skilled Data Engineering and Warehousing Specialist to join our team. The ideal candidate will have 5+ years of experience working in data engineering and warehousing, with a strong background in integrating data into analytical platforms.Key Responsibilities:• Develop and...

  • Data Engineer

    1 day ago

    Sydney, New South Wales, Australia Talent Insights Full time

    Job DescriptionThis is an exciting opportunity for an aspiring Data or Machine Learning Engineer to join the team at Talent Insights as a Data Engineer - Big Data Pipeline Specialist.The role involves building and optimizing data pipelines, solutioning with the team to build proof-of-concepts and deploy solutions, working with Data Scientists on Large...