Big data

2 weeks ago

Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time $80,000 - $240,000 per year

Job Description for Big Data Lead Engineer:

Location : Sydney

Technical and Team Leadership:

Provides technical direction and guidance to the engineering team.

Ensures adherence to engineering standards and best practices.

Participates in technical discussions and decision-making.

Identifies and resolves technical challenges and issues.

Conducts code reviews and provides feedback to other engineers.

Maintain high development standards and practices.

Facilitates team communication and collaboration.

Mentoring and guiding junior engineers.

Technical Skills

Proficient with Java, Scala/Spark, API and Streaming – Primary

Proficient with Pyspark, Python and SQL.

Experience in Azure cloud platform.

Expertise in various connectors and pipelines for batch and real-time data collection/delivery.

Performance tuning - table partitioning and indexing, process threading.

Process:

Should have worked in Agile

Experience of working in JIRA and Confluence

  • Big Data Developer

    5 days ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$75,000 - US$85,000 per year

    Position Summary:We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Data Analyst

    1 day ago

    Sydney, New South Wales, Australia Tech & Data People Full time $90,000 - $120,000 per year

    Do you love working with data but don't want to be stuck in a silo? This role gives you the best of both worlds — a hands-on data position inside a dynamic property business, backed by a supportive team and a manager who actually invests in your growth.Why You'll Love It HereJoin a supportive, friendly team that values balance and flexibilityWork on data...

  • Big Data Lead Engineer

    7 days ago

    Sydney, New South Wales, Australia CareCone Group Full time $150,000 - $200,000 per year

    Role: Big Data Lead EngineerLocation: SydneyJob Description:Technical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...

  • Big Data Lead Engineer

    5 days ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time $180,000 - $250,000 per year

    We are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologiesTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...

  • Big Data Engineer

    3 days ago

    Sydney, New South Wales, Australia Kaizen Global Technologies Full time $120,000 - $180,000 per year

    Job description :Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback to other engineers.Maintain high development standards...

  • Big Data Lead Engineer

    1 week ago

    Sydney, New South Wales, Australia Tata Consultancy Services Full time $180,000 - $220,000 per year

    About the jobAbout TCS:Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia CareCone Group Full time $90,000 - $120,000 per year

    Role: Data Engineer (Big Data, Python)Location: SydneyJob Description:Required Skills & Qualifications:Strong programming skills in Python .Proven experience with AWS services: EC2, EMR, S3, Redshift, IAM, Glue, RDS/Aurora, Athena, VPC .Proficiency in big data technologies: Hadoop, Spark, Scala, Hive .Experience working on the Omnia platform within...

  • Data Modeller

    3 days ago

    Sydney, New South Wales, Australia Cognizant Full time $120,000 - $150,000 per year

    Job Title: Data Modeller & Technical Business AnalystLocation: Sydney,AUDuration : Full TimeWe are seeking a seasoned professional to join our team in a hybrid work model. This unique role blends data Modelling expertise with technical business analysis, offering the opportunity to design and implement robust data solutions while engaging directly with...

  • Assistant Designer

    2 weeks ago

    Sydney, New South Wales, Australia BIG W Full time $60,000 - $90,000 per year

    Assistant Designer 9 month Fixed Term Contract opportunityNorwest Sydney based with hybrid working from home 2 daysInnovative, agile and flexible cultureAt BIG W everyday's a big day. For you, this could be the start of something big. There are over 15,000 of us, in the biggest cities and the tiniest towns. And each of us has an important role to play to...

  • Data Engineer, Data Platform

    5 days ago

    Sydney, New South Wales, Australia TikTok Full time $80,000 - $140,000 per year

    TechnologyData Engineer, Data Platform - USDSLocation:SydneyEmployment Type:RegularJob Code:A31128AResponsibilitiesAs a data engineer in the data platform team area, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world that directly supports the TikTok app. You'll have the opportunity to gain hands-on...