

Diligente Technologies
Data Engineer / Data Architect (Pharma / Biotech Domain)
β - Featured Role | Apply direct with Data Freelance Hub
This role is a contract-to-hire Data Engineer/Data Architect position in Westlake, CA, focusing on the pharma/biotech domain. Key skills include Azure Databricks, SQL, Python, and API integrations. Experience in commercial data ecosystems is required.
π - Country
United States
π± - Currency
$ USD
-
π° - Day rate
Unknown
-
ποΈ - Date
June 10, 2026
π - Duration
Unknown
-
ποΈ - Location
Hybrid
-
π - Contract
Unknown
-
π - Security
Unknown
-
π - Location detailed
Westlake Village, CA
-
π§ - Skills detailed
#SQL (Structured Query Language) #API (Application Programming Interface) #PySpark #Cloud #Azure cloud #Azure Databricks #Compliance #Data Integration #Scala #"ETL (Extract #Transform #Load)" #Azure Data Factory #Data Pipeline #Python #Data Quality #Security #Spark (Apache Spark) #ML (Machine Learning) #DevOps #Data Engineering #Azure #Data Architecture #Databricks #AI (Artificial Intelligence) #Automation #ADF (Azure Data Factory)
Role description
Data Engineer / Data Architect
π Location: Westlake, CA (Hybrid/Onsite)
π Type: Contract-to-Hire
We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.
Key Responsibilities
β’ Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
β’ Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
β’ Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
β’ Support AI/ML initiatives, advanced analytics, and data-driven applications.
β’ Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
β’ Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
β’ Optimize cloud data infrastructure performance, scalability, and cost efficiency.
Required Competencies & Skills
β’ Experience with Azure Cloud (Databricks, DevOps, DataFactory)
β’ Pharma / biotech domain experience, specifically within the commercial data space (sales, market access / payer, marketing)
β’ Strong hands-on python, pyspark, and SQL skills
β’ Direct experience with building and leveraging API integrations in ETL pipeline development
β’ Experience integrating with current best-in-class AI models and APIs like OpenAI API, Databricks AI models, etc.
β’ Self-driven with ability to independently design end-to-end data pipelines while ensuring architectural best practices
β’ Ability to collaborate with a broad set of stakeholders to evaluate the business need and construct a technical design that can enable stakeholder priorities
Preferred Competencies & Skills
β’ Strong knowledge of and experience with maximizing business value using Databricks Unity Catalog or Databricks One capabilities
β’ Familiarity with tools and practices in the Martech and Adtech landscape
β’ Knowledge of Consumer, Patient, or HCP data ecosystems
β’ Experience with identity providers like LiveRamp, Acxiom, Experian, etc.
β’ Experience with custom-built or third-party Customer Data Platforms (CDP)
β’ Experience with marketing automation tools
Working Conditions
β’ General office environment. Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. Travel up to 20%.
Data Engineer / Data Architect
π Location: Westlake, CA (Hybrid/Onsite)
π Type: Contract-to-Hire
We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable cloud-based data platforms supporting analytics, AI/ML, reporting, and commercial business operations.
Key Responsibilities
β’ Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, SQL, Python, and PySpark.
β’ Architect and implement data integration solutions across marketing, sales, and commercial data ecosystems.
β’ Build and maintain API integrations with internal systems, third-party platforms, and AI/LLM services.
β’ Support AI/ML initiatives, advanced analytics, and data-driven applications.
β’ Ensure data quality, governance, security, compliance, and operational excellence across Azure environments.
β’ Collaborate with business, analytics, marketing, and technology teams to deliver enterprise data solutions.
β’ Optimize cloud data infrastructure performance, scalability, and cost efficiency.
Required Competencies & Skills
β’ Experience with Azure Cloud (Databricks, DevOps, DataFactory)
β’ Pharma / biotech domain experience, specifically within the commercial data space (sales, market access / payer, marketing)
β’ Strong hands-on python, pyspark, and SQL skills
β’ Direct experience with building and leveraging API integrations in ETL pipeline development
β’ Experience integrating with current best-in-class AI models and APIs like OpenAI API, Databricks AI models, etc.
β’ Self-driven with ability to independently design end-to-end data pipelines while ensuring architectural best practices
β’ Ability to collaborate with a broad set of stakeholders to evaluate the business need and construct a technical design that can enable stakeholder priorities
Preferred Competencies & Skills
β’ Strong knowledge of and experience with maximizing business value using Databricks Unity Catalog or Databricks One capabilities
β’ Familiarity with tools and practices in the Martech and Adtech landscape
β’ Knowledge of Consumer, Patient, or HCP data ecosystems
β’ Experience with identity providers like LiveRamp, Acxiom, Experian, etc.
β’ Experience with custom-built or third-party Customer Data Platforms (CDP)
β’ Experience with marketing automation tools
Working Conditions
β’ General office environment. Work is generally sedentary in nature but may require standing and walking for up to 10% of the time. Travel up to 20%.






