Databricks Engineer

Job Title: Sr. Databricks Engineer – Pharma Experience a Must Duration: 6-12 months Location: 3 days onsite in Lexington, MA - Looking for local candidates only! Compensation Range: 60-75/hour W2 preferred • • Will consider local H1B candidate Overview Join a fast-moving initiative supporting major data lake buildouts across commercial and technical operations in a life sciences environment. In this role, you’ll help keep mission-critical Databricks pipelines running smoothly—monitoring, troubleshooting, upgrading, and optimizing—while also jumping into development work as needed. You’ll collaborate closely with both technical teammates and non-technical stakeholders to deliver scalable, governed data products in a highly regulated setting.Required Skills • 8+ years of data/analytics engineering experience on modern data platforms • Life sciences / pharma Databricks experience • Strong hands-on expertise with Databricks, including: • PySpark, Delta Lake, pipeline troubleshooting, performance tuning, and upgrades • Building and maintaining data ingestion pipelines • Monitoring scheduled jobs and resolving production issues • Proven experience with Informatica PowerCenter and IDMC (including integrations and PowerCenter-to-IDMC transitions) • Strong programming and query skills: Python and SQL • Experience with Azure Data Factory • Working knowledge of: • Data lake architecture • Data governance, data quality, and coding standards • Translating requirements into scalable solution designs • Strong communication and stakeholder management skills (ability to align technical and non-technical audiences) Nice to Have Skills • Experience in commercial data domains (in addition to technical operations or other areas) • Experience with MDM and enterprise governance practices • Hands-on expertise implementing a data catalog (Unity Catalog) and creating data products • Experience leveraging AI-enabled data engineering to optimize pipelines and data lake performance • Consulting background (e.g., experience in consulting firms) with both technical and functional strengths Preferred Education and Experience • 8+ years of relevant data engineering experience (required) • Experience in pharmaceutical or highly regulated environments strongly preferred • Databricks and/or Informatica certifications preferred #TECH