Job Details
Senior Azure Databricks Platform Security Engineer
OpenJob Description
Job Summary
Individual contributor responsible for security of the Azure Databricks platform and the Lakehouse data estate. The incumbent will harden Databricks workspaces, govern Unity Catalog, integrate Databricks with Azure tenant security controls, and build Sentinel detections for Databricks workloads.
Key Responsibilities
- Secure Azure Databricks workspaces using VNet injection, Private Link, encryption, and access controls.
- Configure Unity Catalog, data governance, cluster policies, and secure data access.
- Implement Microsoft Entra ID, MFA, Conditional Access, PIM, and Azure Policy.
- Integrate Databricks diagnostic logs with Microsoft Sentinel and develop security alerts using KQL.
- Build Logic Apps playbooks for automated incident response, ticketing, and notifications.
- Secure ADLS Gen2, Delta Lake, and cloud data sources while ensuring compliance and audit readiness.
Required Technical Skills
- Azure Databricks: Workspace security, Unity Catalog, cluster policies, secret scopes, PAT governance.
- Azure Security: Entra ID, Conditional Access, MFA, PIM, Azure Policy, Defender for Cloud.
- Data Security: ADLS Gen2, RBAC, ACLs, CMK encryption, Private Endpoints.
- SIEM/SOAR: Microsoft Sentinel, KQL, Analytics Rules, Workbooks, Logic Apps.
- Automation: Python, PowerShell, Azure CLI, Databricks CLI, basic Terraform.
Required Experience
- 6–9 years in Azure security and data platform security.
- Minimum 2 years in Azure security and identity governance.
- At least 1.5 years in Azure Databricks platform security and Unity Catalog.
- At least 1.5 years in Microsoft Sentinel and security log integration.
- Minimum 1 year of security audit, compliance, or governance exposure.
Preferred Certifications
AZ-500, Databricks Certified Data Engineer Associate, SC-200, or AZ-700.