AWS Databricks Architect

Role: AWS Databricks Architect Location: Raritan, NJ (Onsite) Experience: 10 or more year s Mandatory skills: Databric ks Role summa ry:We are looking for an experienced AWS Databricks Architect to design implement and optimize scalable Lakehouse solutions across AWS as well as Azure cloud platforms with 10 years of experience The ideal candidate will provide technical leadership in data architecture platform engineering data governance performance optimization and enterprise grade Databricks implementati ons Key responsibilit • ies:Design and architect end to end Databricks Lakehouse solutions across AWS and along with Azure preferably environm • entsDefine scalable data architecture patterns for ingestion transformation storage analytics and reporting workl • oadsLead implementation of Delta Lake medallion architecture Databricks SQL Unity Catalog and workflow orchestra • tionOptimize Apache Spark jobs clusters notebooks pipelines and workloads for performance reliability and cost effici • encyImplement security access control secrets management data governance and compliance best practices across cloud platf • ormsCollaborate with data engineering BI data science DevOps and business teams to deliver highquality data solut • ionsGuide CICD infrastructure as code monitoring and production deployment practices for Databricks workl • oadsProvide technical leadership architecture reviews troubleshooting support and mentoring to project t eams Mandatory sk • ills:12 plus years of experience in data engineering data architecture or big data platform implementation in AWS cloud platform and knowledge in Azure platform as • wellStrong hands-on experience with Databricks platform architecture workspace setup cluster configuration jobs notebooks and workflow orchestr • ationExpertise in AWS services such as S3 IAM VPC Glue Lambda CloudWatch and related data platform ser • vicesExpertise in Azure services such as ADLS Azure Data Factory Azure Synapse Key Vault Entra ID and Azure Mo • nitorStrong knowledge of Apache Spark PySpark SQL Delta Lake and Lakehouse architecture con • ceptsExperience with data security governance access controls Unity Catalog encryption and cloud networking con • ceptsHands-on experience with performance tuning cost optimization debugging and production support of Databricks work • loadsGood understanding of CICD Git Terraform or equivalent infrastructure as code tools and DevOps prac tices