Senior Data Architect

1 week ago

Sydney, New South Wales, Australia Bebeebigdata Full time

Big Data Specialist
We are seeking a skilled and experienced professional to fill the role of Big Data Specialist. The ideal candidate will possess strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern tools and technologies.
The successful candidate will be responsible for developing data pipelines, transforming large volumes of data, and optimizing data infrastructure to enable real-time and batch processing for business insights and analytics.
Key Skills and Qualifications
Design, develop and maintain scalable and secure big data processing systems using tools like Apache Spark, Hadoop, Hive, Kafka etc.
Build and optimize data pipelines and architectures for data ingestion, processing and storage from diverse sources (structured, semi-structured, unstructured)
Develop ETL/ELT workflows and data transformation logic using custom code in Python, Scala, Java and job scheduling tools such as Control-M.
Translate business needs into technical specifications, develop application strategy and high-level design documentation
Mandatory Knowledge & Qualifications
Bachelor's or master's degree in computer science, data engineering, information technology, or related fields.
4+ years of experience in Big Data technologies.
Experience in template-oriented data validation / cleansing framework.
Strong programming skills in Python, Scala, Shell Scripting and Java.
Extensive experience in data transformation and building ETL pipelines using PySpark.
Primary Expertise
Hadoop - Expert
Apache Spark - Expert
Apache Atlas - Expert
Python - Expert
Scala - Expert
Shell Script - Expert
PySpark - Expert
Scikitlearn - Expert
Matplotlib - Expert

  • Senior Data Architect

    1 week ago

    Sydney, New South Wales, Australia Commonwealth Bank Full time

    Senior Data ArchitectYou aredetermined to stay ahead of the latestCloud, Big Data and Data warehouse technologies.We'reone of the largest and most advanced Data Engineering teams in the country.Together wecan build state-of-the-art data solutions that power seamless experiences for millions of customers.Do work that matters:As a Senior Data Architect, you'll...

  • Senior Data Architect

    1 week ago

    Sydney, New South Wales, Australia Bebeedata Full time

    Job Title: Senior Data ArchitectThis role involves delivering a major IT enhancement project for a leading government agency. As a senior data architect, you will be responsible for designing and implementing data architecture and integration frameworks that enable best practice data lifecycle management.Key Responsibilities:Map existing data holdings,...

  • Senior Data Infrastructure Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeData Architect Full time $160,000 - $200,000

    Job SummaryWe are seeking an accomplished data architect to spearhead the development of a hybrid on-premises and cloud-based data platform. This position demands expertise in designing scalable, high-performance data infrastructure that supports trading, research, and operations by ensuring accurate, timely, and accessible data.About the RoleCreate...

  • Senior Data Architect

    1 week ago

    Sydney, New South Wales, Australia Bebeeteradata Full time

    Job Title: Senior Data Architect - Teradata EnvironmentAs a senior data architect, you will be responsible for designing and implementing large-scale data integration solutions in a teradata environment.Key Responsibilities:Design and implement data integration solutions using teradata tools and technologies.Develop and maintain complex sql queries to...

  • Senior Data Architect

    5 days ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $250,000

    Job Title: Senior Data ArchitectOverview of Role:We are seeking an accomplished data architect to spearhead the design, implementation, and maintenance of robust data solutions. This key role focuses on aligning with enterprise architecture standards, governance policies, and business needs.The Position:This senior data architect will be responsible for...

  • Senior Data Architect

    3 weeks ago

    Sydney, New South Wales, Australia Maltem Australia Full time

    2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Maltem AustraliaEngagement: Contractor, initial 25-day part-time engagement with potential extensionStart Date: Approximately the end of AugustAbout Maltem:Maltem is a global consulting group specialising in digital...

  • Data Architect

    1 week ago

    Sydney, New South Wales, Australia Krauss Partners Full time

    Get AI-powered advice on this job and more exclusive features.This range is provided by Krauss Partners.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay range A$150,000.00/yr - A$170,000.00/yrData Architect - Health Sector | SydneyWe are seeking an experienced Data Architect to join a health...

  • Data Architect

    2 weeks ago

    Sydney, New South Wales, Australia NOVON Full time

    Join to apply for the Data Architect role at NOVON2 weeks ago Be among the first 25 applicantsJoin to apply for the Data Architect role at NOVONAzure Data SolutionsHybridCompetitive salaryNovon has an opportunity perfect for a Data Architect who excels in designing and articulating strategies and solutions for data driven transformations. This position will...

  • Data Architect

    3 weeks ago

    Sydney, New South Wales, Australia Krauss Partners Full time

    Get AI-powered advice on this job and more exclusive features.This range is provided by Krauss Partners. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay rangeA$150,000.00/yr - A$170,000.00/yrData Architect - Health Sector | SydneyWe are seeking an experienced Data Architect to join a health...

  • Data Architect

    1 week ago

    Sydney, New South Wales, Australia Bebeesnowflake Full time

    Job DescriptionWe are seeking a skilled data architect to lead our cloud-native solutions using Snowflake as the core platform.Key Responsibilities:Designing and implementing enterprise-wide data architecture with a strong focus on scalability, security, and performance optimisation.Leveraging expertise in data modelling, warehousing, governance, and...