Databricks Solution Architect - Assistant Vice President
State Street provides financial services to institutional investors through investment management, custody, and servicing solutions.
About State Street
State Street helps institutional investors manage and safeguard assets through custody, fund administration, and investment management services. You can access front-to-back investment platforms, digital asset services, and global market solutions.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will define the Databricks platform strategy, architecture, and roadmap. You will design secure, scalable AWS and Databricks environments; establish governance, security, data-quality, lineage, and observability frameworks; automate deployments; lead modernization initiatives; and provide technical leadership across engineering and architecture teams.
Requirements
- 15–20 years of experience in data engineering, analytics platforms, and cloud-based data solutions.
- Deep expertise with Databricks and modern data platforms.
- Strong experience with Spark, Delta Lake, SQL, Python, and cloud data-engineering patterns.
- Strong leadership, stakeholder-management, and product-ownership skills.
- Experience leading global teams and delivering large-scale data initiatives.
Responsibilities
- Define and own the AWS Databricks platform architecture roadmap.
- Design scalable, secure, multi-environment Databricks deployments.
- Establish standards for platform design, governance, monitoring, and operational excellence.
- Create architecture patterns and reference implementations.
- Lead platform modernization and cloud transformation initiatives.
- Design and govern Databricks workspaces, Unity Catalog, Delta Lake, Databricks SQL, Workflows, and Delta Live Tables.
- Develop standards for workspace provisioning, cluster policies, compute optimization, and cost management.
- Establish multi-tenant architectures and platform governance frameworks.
- Improve platform performance, reliability, and security.
- Architect batch, streaming, and real-time ingestion and processing frameworks.
- Establish metadata, data-quality, lineage, and observability frameworks.
- Design and manage AWS infrastructure supporting Databricks workloads.
- Define cloud networking, security zoning, and connectivity models.
- Ensure high availability, scalability, fault tolerance, and disaster recovery.
- Design security controls and support audit, regulatory, and compliance requirements.
- Architect infrastructure-as-code solutions and CI/CD pipelines.
- Automate platform provisioning and configuration management.
- Provide technical leadership, mentor engineers and architects, and lead architecture reviews.
Benefits
- Medical plans for employees and dependents.
- Employee and family life insurance and accidental death and dismemberment coverage.
- Well-being programs.
- Employee Assistance Program.
- Regionally specific savings or retirement plans.
- Paid vacation and holiday allowance.
- Two paid volunteer days.
- Paid parental leave, back-to-work support, adoption assistance, or flexible work arrangements.
- Group savings and discounts at sport clubs and cinemas.