Senior Administrator - Azure Databricks
Kforce
Kforce is working with a client in search of a Senior Administrator - Azure Databricks to join their team in NY! This position is full time, direct hire and on-site 1-day a week.
Summary:
As an Azure Databricks Administrator, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal performance and security. This role is crucial in overseeing user administration, managing Azure storage solutions, and implementing CI/CD pipelines using Azure DevOps. By leveraging a deep understanding of Databricks architecture and proficiency in scripting languages, the administrator will automate tasks and enhance the efficiency of data operations.
Responsibilities:
* Manage and maintain Azure Databricks Platform, workspaces, clusters, and jobs
* Oversee user administration including access controls and permissions
* Handle library installations, runtime management, and policy enforcement
* Implement/analyze cost control measures and monitor platform usage and performance
* Administer Unity Catalog for data governance and security
* Collaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, and analytical pipelines on the Databricks platform
* Manage Azure storage solutions, including Blob Storage and Data Lake Storage
* Administer Azure Key Vault for secure storage of secrets and keys
* Configure and manage Azure Data Factory for data integration and ETL processes
* Implement and manage VNETs, firewalls, Azure policies and security best practices
* Implement and manage Azure DevOps for CI/CD pipelines and version control
* Implement best practices for automated deployment and continuous integration
* Set up budgets and alerts to monitor and control Azure costs and spend
* Implement monitoring solutions for platform health and performance
* Configure alerts for proactive issue detection and resolution
* Databricks Lakehouse Monitoring
Confirm your E-mail: Send Email
All Jobs from Kforce