Insight Global

Principal Data Engineer

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Principal Data Engineer with a 6-month contract in San Diego (hybrid). Requires 6+ years of experience, expertise in Databricks/Snowflake, advanced Python/SQL skills, and cloud data environments. Biopharma experience is a plus.
🌎 - Country
United States
💱 - Currency
$ USD
-
💰 - Day rate
840
-
🗓️ - Date
June 18, 2026
🕒 - Duration
More than 6 months
-
🏝️ - Location
Hybrid
-
📄 - Contract
Unknown
-
🔒 - Security
Unknown
-
📍 - Location detailed
San Diego County, CA
-
🧠 - Skills detailed
#Compliance #Azure #Python #Snowflake #Monitoring #AWS (Amazon Web Services) #Data Pipeline #SQL (Structured Query Language) #Spark (Apache Spark) #Databricks #Cloud #Data Governance #Delta Lake #Scala #Data Engineering #Data Warehouse #"ETL (Extract #Transform #Load)" #Deployment #Leadership #Data Processing #Security #DevOps #CDISC (Clinical Data Interchange Standards Consortium)
Role description
Location: 4x a week in San Diego, 1 day remote (Carmel Valley, 92130) Duration: 6 month contract, then opportunity to convert Please note, no current or future sponsorship will be provided. Requirements: • 6+ years of experience as Data Engineer, with recent experience at the Senior or Principal level • Expert‑level experience architecting and building scalable data solutions using Databricks or Snowflake, including Spark, Delta Lake, Unity Catalog, and Lakehouse best practices. • Strong experience designing and operating production ETL/ELT data pipelines, including orchestration, incremental processing, monitoring, and reliability. • Experience with CI/CD pipeline deployment and devops best practices • Advanced proficiency in Python and SQL, with deep experience in Spark‑based data processing, performance tuning, and production analytics workloads. • Hands‑on experience working in cloud data environments (Azure and/or AWS) supporting enterprise‑scale data platforms. • Proven technical leadership experience, including leading architecture decisions, mentoring engineers, and partnering with analytics, platform, and research teams. Nice to have: • Knowledge or experience in the Biopharma/Life Science industry. • Hands‑on experience with LIMS, ELN, or scientific/discovery data sources. • Strong understanding of data governance, security, privacy, and compliance practices in regulated environments. • Experience working with Snowflake or other cloud data warehouses alongside Databricks.