Azure Databricks Admin
1 week ago
Job Summary:
We are seeking a highly skilled and proactive Azure Data Platform Engineer to design, implement, and manage robust data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure Synapse, Azure Databricks, Azure Fabric, and cloud infrastructure administration. This role involves maintaining server health, managing cost-effective Azure subscriptions, enforcing security protocols, and ensuring optimal performance and scalability of data platforms.
Key Responsibilities:
Azure Data Platform Engineering:
Design and implement scalable data solutions using Azure Synapse Analytics, Azure Fabric, and Azure Databricks.
Develop and optimize data pipelines, lakehouses, and analytics workflows.Cloud
Administration & Server Maintenance:
Administer Azure cloud resources including VMs, storage, networking, and compute services.Perform routine server maintenance, patching, and performance tuning.
Cost & Subscription Management:
Monitor and manage Azure subscriptions to ensure cost efficiency.
Implement tagging and budgeting strategies for resource optimization.
Monitoring & Analytics:
Set up and maintain monitoring tools for data platforms (e.g., Azure Monitor, Log Analytics).Analyze performance metrics and logs to proactively identify and resolve issues.
Security & Access Controls:
Implement and manage role-based access control (RBAC) and Azure Active Directory (AAD) integrations.
Enforce data security measures including encryption, masking, and secure data transfer protocols.
Network Security & Administration:
Configure and manage Azure networking components (VNets, NSGs, firewalls, private endpoints).
Ensure secure connectivity and compliance with organizational policies.
Required Skills & Qualifications:
Proven experience with Azure Synapse, Databricks, and Azure Fabric.
Strong understanding of Azure cloud architecture, services, and best practices.
Hands-on experience with cloud administration, server maintenance, and cost management.
Proficiency in monitoring tools, log analysis, and performance tuning.
Expertise in data and network security, including access controls and compliance.
Familiarity with scripting languages (PowerShell, Python) and Infrastructure as Code (ARM, Bicep, Terraform).
Excellent problem-solving and communication skills.
Preferred Qualifications:
8+ years in data platform management & engineering.
4+ years with Azure Synapse, Databricks and Azure Fabric.
Bachelor's or Master's in Computer Science, Engineering, or related field.
Certifications in Azure or Databricks.
Experience working with Australian insurance clients or regulatory environments
Experience in enterprise-scale data platform admin/maintenance.
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
-
Azure DevOps And Azure DataBricks
3 days ago
Sydney, New South Wales, Australia Resource Corner Full time $120,000 - $150,000 per yearJob description:ADB + Azure DevOpsPrimary Skills –Azure DataBricks, Azure DevOpsCore Responsibilities Databricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured streaming, Delta Lake, and Unity Catalog.Optimize Spark jobs and manage cluster performance.Experience in a production support...
-
Azure Devops+ Databricks
5 days ago
Sydney, New South Wales, Australia ALOIS Solutions Full time $120,000 - $180,000 per yearRole :ADB + Azure DevOpsLocation : SydneyJob Type : ContractJob description:Primary Skills – Azure DataBricks, Azure DevOpsCore ResponsibilitiesDatabricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured streaming, Delta Lake, and Unity Catalog.Optimize Spark jobs and manage cluster...
-
Databricks Engineer
4 weeks ago
Sydney, New South Wales, Australia BI & DW Australia Full timeOverviewA consultancy client requires an immediate start Senior Databricks Engineer for one of their projects for an initial 3 months with likely extension. There is also the possibility of conversion to permanent if that appeals to you. The role can be onsite, hybrid or remote.Key ResponsibilitiesIdeally lead and deliver data engineering projects from...
-
Databricks Engineer
4 weeks ago
Sydney, New South Wales, Australia BI & DW Australia Full timeOverviewA consultancy client requires an immediate start Senior Databricks Engineer for one of their projects for an initial 3 months with likely extension. There is also the possibility of conversion to permanent if that appeals to you. The role can be onsite, hybrid or remote.Key ResponsibilitiesIdeally lead and deliver data engineering projects from...
-
Data Engineer – Databricks
3 weeks ago
Sydney, New South Wales, Australia Cognizant Full timeCognizant is looking for a Data Engineer – Databricks in developing customized product for our clients. The role is expected to drive technology discussions and analyze the current landscape for gaps in addressing business needs. Cognizant needs a motivated individual to challenge the status quo and provide thought leadership/best practices to enhance our...
-
Data Engineer – Databricks
3 weeks ago
Sydney, New South Wales, Australia Cognizant Full timeCognizant is looking for a Data Engineer – Databricks in developing customized product for our clients. The role is expected to drive technology discussions and analyze the current landscape for gaps in addressing business needs. Cognizant needs a motivated individual to challenge the status quo and provide thought leadership/best practices to enhance our...
-
ADB + Azure DevOps
5 days ago
Sydney, New South Wales, Australia ITbility Full time $120,000 - $180,000 per yearADB + Azure DevOpsSydneyContract 6 + MonthsOur client in Sydney is looking forADB + Azure DevOpsthis is aContract 6 + Monthsrole. Please email me at for more information.Job description:Primary Skills –Azure DataBricks, Azure DevOpsDatabricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured...
-
Azure Data Engineer
1 week ago
Sydney, New South Wales, Australia AI Hustler Full time $120,000 - $180,000 per yearWe are urgently seeking a highly skilled and experiencedAzure Databricks Data Engineerto join our team in Sydney. This is a critical role for our data engineering function, focused on building robust, scalable, and efficient data solutions within the Azure cloud environment.If you have a passion for building complex data pipelines and thrive on solving...
-
Sr. Resident Solutions Architect, ML
4 weeks ago
Sydney, New South Wales, Australia Databricks Full timeSr. Resident Solutions Architect, ML & GenAIAs a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term engagements on their ML & AI challenges using the Databricks Data Intelligent platform. You will provide data science and cloud technology projects which require...
-
Sr. Resident Solutions Architect, ML
4 weeks ago
Sydney, New South Wales, Australia Databricks Full timeSr. Resident Solutions Architect, ML & GenAIAs a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term engagements on their ML & AI challenges using the Databricks Data Intelligent platform. You will provide data science and cloud technology projects which require...