Databricks Admin

Dear Friends, Greetings of the day!!! This is a Direct client requirement. We are looking for consultants with Independent visa's only who can work on W2. Please share your resumes to yuvi@trustartit.com Job Description: Job Title: Databricks Administrator Location: Irving, TX - Hybrid (3 days onsite) Experience: 10 - 12 Years Employment Type: Contract on W2 Domain: Telecom Duration: Long term Visa: Independent visa only on W2 Interview mode: MS Teams ( 2 Rounds) Job Summary We are looking for an experienced Databricks Administrator who can manage, maintain, and optimize our Databricks environment. The ideal candidate will have strong experience in platform administration, cluster optimization, security management, CI/CD integrations, and working closely with data engineering teams. Key Responsibilities Databricks Platform Administration Manage and administer Databricks workspaces, clusters, pools, and notebooks. Monitor cluster performance, optimize auto-scaling, and manage cluster policies. Configure and maintain Unity Catalog, access control lists, and governance policies. Manage workspace-level users, groups, entitlements, secrets, and tokens. Security & Governance Implement security best practices including IAM roles, PAT tokens, secret scopes, OAuth, SCIM provisioning, etc. Configure role-based access control (RBAC) and enforce organizational governance standards. Collaborate with cloud security teams to maintain compliance (HIPAA, SOC2, GDPR, etc., if applicable). Automation & DevOps Automate administrative tasks using Databricks CLI, Terraform, REST APIs, and PowerShell/Python scripts. Support CI/CD pipelines for Databricks jobs and workflows. Administer Delta Live Tables, jobs, repos, and scheduled workflows. Monitoring & Troubleshooting Monitor performance, usage, and cost optimization within the Databricks environment. Troubleshoot cluster failures, notebook runtime issues, job failures, and workspace errors. Work with cloud teams to resolve compute, networking, and storage-related issues. Cloud Integration (Azure / AWS / GCP) Manage and configure Databricks on Azure AWS, or GCP (mention your required cloud). Configure VNet injection, private endpoints, storage accounts, key vaults, IAM roles, etc. Manage integrations with ADLS/S3/GCS, event hubs, Kafka, API gateways, and data engineering tools. Required Skills 4–6+ years of hands-on experience as Databricks Admin or Cloud Data Platform Engineer. Strong experience with Azure/AWS/GCP Databricks administration. Good knowledge of Spark clusters, job orchestration, and performance tuning. Experience with Unity Catalog, Lakehouse security, RBAC, ACLs. Hands-on experience with Terraform, Databricks CLI, REST APIs. Strong understanding of Delta Lake, data pipelines, and cloud networking concepts. Familiarity with monitoring tools (Azure Monitor, CloudWatch, Prometheus, Splunk). Nice to Have Experience working with Delta Live Tables and MLflow. Knowledge of data engineering workflows and ETL best practices. Experience in telecom or large-scale enterprise environments. Databricks certification (Admin / Associate Data Engineer / Architect). Regards, Yuvi, Yuvi@trustartit.com 214-227-7676