Senior Solutions Architect (Databricks Specialist)

Category: IT Services

Location:

We are seeking an experienced Senior Solutions Architect specializing in Databricks to provide strategic leadership and architectural oversight for a large-scale data modernization program within a leading Financial Services organization.

The client is currently transitioning from a traditional SQL Server and Microsoft-centric data ecosystem to a modern Databricks-based platform to support its long-term data, analytics, and AI strategy. While the client has an established and capable Data Engineering team, they require a senior-level architect to provide strategic direction, implementation frameworks, architectural governance, and best-practice guidance to ensure a successful and cost-effective transformation.

This role will focus on defining the target-state architecture, establishing standards and governance, optimizing platform design, and ensuring alignment between technology investments and business objectives.

Key Responsibilities

Provide strategic architectural leadership for the organisation's Databricks implementation and data modernization initiatives.

Design and define enterprise-scale data and analytics architectures aligned to business and AI objectives.

Develop and implement architectural frameworks, standards, patterns, and best practices for Databricks adoption.

Guide the Data Engineering team on solution design, scalability, performance optimization, security, and governance.

Assess current SQL Server and Microsoft-based environments and define migration strategies to Databricks.

Ensure architecture decisions support future AI, machine learning, advanced analytics, and reporting requirements.

Evaluate and optimize platform utilization to drive cost efficiency and maximize return on investment.

Establish governance, architecture review processes, and implementation roadmaps.

Provide executive-level insights and recommendations on technology direction, risks, opportunities, and investments.

Collaborate with business stakeholders, technology leadership, engineering teams, and vendors to drive successful outcomes.

Oversee solution quality and ensure alignment with enterprise architecture principles and regulatory requirements.

Identify technical risks, dependencies, and potential challenges, implementing mitigation strategies where required.

Mentor engineering teams and promote architectural excellence across the program

Requirements

Required Technical Skills

Essential

Deep expertise in Databricks architecture, implementation, and optimization

Strong understanding of enterprise data platforms and modern data architectures

Data Lakehouse architecture design and implementation

Data governance, security, compliance, and data management frameworks

Data migration strategy and execution

Enterprise integration patterns and cloud-based architectures

Analytics, Business Intelligence, and AI/ML platform enablement

Preferred

Experience with Microsoft Azure Data Services

Azure Data Factory

Azure Synapse Analytics

SQL Server

Delta Lake

Unity Catalog

DataOps and DevOps practices

AI and Machine Learning platform architecture

Essential Experience & Qualifications

10+ years of experience in Solution Architecture, Enterprise Architecture, or Data Architecture roles.

Demonstrated experience delivering large-scale data transformation and modernization initiatives.

Extensive experience designing and implementing Databricks solutions in enterprise environments.

Proven track record supporting cloud migration and modern data platform programs.

Experience within Financial Services, Banking, Insurance, or highly regulated environments.

Strong understanding of data governance, security, compliance, and risk management frameworks.

Experience developing enterprise architecture standards, frameworks, and governance models.

Relevant certifications in Databricks, Cloud Platforms (Azure preferred), TOGAF, or related disciplines are highly advantageous.

Key Competencies

Strategic Leadership

Ability to align technology architecture with long-term business strategy.

Strong commercial acumen and focus on value delivery.

Ability to influence technology direction at executive level.

Stakeholder Engagement

Comfortable engaging with C-suite executives and senior business leaders.

Strong communication, presentation, and facilitation skills.

Ability to simplify complex technical concepts for non-technical audiences.

Architecture & Governance

Excellent architectural design and decision-making capabilities.

Strong focus on governance, standards, and best practices.

Ability to drive consistency across multiple teams and initiatives.

Delivery & Outcomes

Results-driven with a focus on business impact and measurable outcomes.

Strong problem-solving and analytical thinking skills.

Ability to work independently while guiding large technical teams.

Ideal Candidate Profile

The ideal candidate is a highly experienced Senior Solutions Architect with deep Databricks expertise, capable of providing strategic oversight to an established engineering team. They will bring extensive experience in enterprise data transformation, architecture governance, and cloud-based analytics platforms. The successful individual will be comfortable operating at executive level, influencing business and technology strategy, while ensuring Databricks is implemented in a scalable, cost-effective, and future-ready manner that supports the organisation's AI and data ambitions.

Details

Originally posted on Himalayas