Big Data Architect – Databricks Practice Lead • Duration: 12+ months • Location: US - Remote • Rate: 65 /hr lalit@vedicstaffing.com • No of Interviews: 1 with BigTapp + 2-3 with Computomic & Databricks PS team Background: Our consulting services and tooling help companies realize value from their data by modernizing their data stack to the latest data platform technologies like Databricks. We use accelerators that save companies up to 80% of time and money moving data from legacy platforms to Databricks. We help customers find margins of improvement in everything they do, which when aggregated creates a transformative effect on their business. We are a nimble and rapidly growing company with a global footprint, and a focus on Data & AI, and Financial Crime Prevention solutions. We have built an impressive depth of Data & AI experts with over 40 trained and certified Databricks professionals; experts in BI/ Dashboarding tools such as PowerBI and Tableau; and experts in financial crime and fraud prevention. Our name Computomic is derived from two words: Computers and Atomic. We believe in making one small change (Atomic) at a time, so that the cumulative effect of all the changes delivers a massive impact. We are one of the fastest growing partners for Databricks and are looking for a Resident Solutions Architect (RSA) to help us build out one of the most impactful Big Data practices in the industry! You will have the opportunity to shape the future of the big data landscape at leading Fortune 500 companies and cutting-edge startups. You will work on the industry’s most challenging customer engagements to solve big data problems using leading cloud platforms such as AWS/Azure/GCP, Apache Spark and Databricks. You will have the opportunity to work with some of the leading experts in the data and AI industry and develop a deep understanding of databricks and adjacent technologies. You will be empowered to architect, scope, negotiate and lead complex data migration projects, develop data and AI best practices and thought leadership, and represent both Computomic and Databricks at Industry forums and events. What you will be doing Be a core member of our rapidly growing Databricks practice Work directly with end customers and architect, scope, negotiate & lead enterprise scale Databricks migration projects Provide thought leadership in the areas of data migration, master data management, data modeling, data governance, data transformations, curation and data integration Develop data architecture blueprints, patterns and frameworks that will enable reuse and standardization Grow the practice by influencing sales deals and assist with scoping, solutioning and estimating effort Lead efforts to develop reusable frameworks, accelerators and internal product development Help us hire, train and develop highly differentiated and diverse team of Big Data experts The skills you will bring 10+ years’ experience of data engineering, data platforms & analytics. 10+ years of consulting experience Minimum 6-8+ projects delivered with hands-on experience in development on databricks. Current knowledge across the Databricks product • & platform features - and/ or complete Databricks Data Engineering Professional Certification (upon joining). Deep understanding and experience working with modern cloud data architectures and engineering for one or more of the common cloud ecosystems - AWS, Azure or GCP Familiarity with cloud native technologies specifically - Python / PySpark / JavaScript, CI/CD for production deployments , ML Ops, cloud devops, containers (Kubernetes/docker, etc.) Deep experience with distributed computing with Spark, with knowledge of Spark runtime intervals. Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practices Knowledge of cloud and Big Data ecosystems to advise clients on optimal solutions and best practices Understanding of cloud data architecture and data integration patterns (Databricks, Starburst, Azure Data Factory, AWS Glue and others), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake); Infrastructure as code (CloudFormation, Terraform) Understanding of enterprise data concepts such as Master Data Management and Enterprise Data Warehouse, experience with MDM standards Understanding of SQL, report generation using visualization tools such as Tableau/Power BI, programming using Python/Scala/Spark Ability to identify, debug bottlenecks and significantly optimize slow running data pipelines Experience migrating applications from legacy Hadoop or Data Warehouses to the cloud running Apache Spark or Databricks a huge plus Other nice to have skills: Demonstrating prior Big 4 or proven consulting experience in strategy through execution projects is a plus Experience leading and working with large Cloud Data Platform, Cloud Data migration or Enterprise Information Management programs You bring an uncompromising Growth mindset You are highly motivated, creative in your approach to technical problems and know how to leverage both internal and external networks You invest in keeping technical skills updated and are constantly looking for the next big challenge You will bring both broad and deep knowledge in Data Engineering and can architect a solution by mapping a customer business problem to an end-to-end solution. You are resourceful, confident and composed under pressure.