

Lead Data Engineer
β - Featured Role | Apply direct with Data Freelance Hub
This role is for a Lead Data Engineer in San Jose, CA, on a long-term contract, paying $61.73 - $74.34 per hour. Requires 12+ years of experience, expertise in Databricks, ETL, Azure Data Factory, and leadership in data projects.
π - Country
United States
π± - Currency
$ USD
-
π° - Day rate
592
-
ποΈ - Date discovered
July 30, 2025
π - Project duration
Unknown
-
ποΈ - Location type
On-site
-
π - Contract type
Unknown
-
π - Security clearance
Unknown
-
π - Location detailed
Alameda, CA 94502
-
π§ - Skills detailed
#SQL (Structured Query Language) #Azure Data Factory #Cloud #Security #Migration #ADF (Azure Data Factory) #Leadership #Data Governance #Azure cloud #Azure #Storage #VPN (Virtual Private Network) #"ETL (Extract #Transform #Load)" #Java #PySpark #ML (Machine Learning) #Data Engineering #Computer Science #Python #Scala #Programming #Delta Lake #Azure Blob Storage #Spark SQL #JDBC (Java Database Connectivity) #Spark (Apache Spark) #DevOps #Data Migration #Compliance #Databricks
Role description
Heading 1
Heading 2
Heading 3
Heading 4
Heading 5
Heading 6
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.
Block quote
Ordered list
- Item 1
- Item 2
- Item 3
Unordered list
- Item A
- Item B
- Item C
Bold text
Emphasis
Superscript
Subscript
Job Title: Data Engineer LeadLocation: San Jose, CA (Onsite)
Duration: Long term contract
Key skills: Databricks with ETL and SQLEducational Qualification
β’ Bachelorβs degree in Computer Science, Information Systems, or a related field.
Job Description of Role
β’ (RNR)Overview:We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering and migration projects. The ideal candidate will have hands-on expertise in Databricks, Azure Data Factory, and related technologies, with a proven track record of leading at least 3 successful data projects.
Experience Required:Minimum of 12 years of experience in data engineering and architecture roles.Must have led 3 or more end-to-end enterprise data projects, Databricks, and Azure technologies.Primary (Must have skills)
β’ Primary Skills:
β’ Deep knowledge of architecture and complex data models
β’ Extensive experience with Databricks, PySpark, Spark SQL, and Delta Lake.
Strong command over ETL tools such as Data Services and Azure Data Factory.
Proficient in programming languages: Python, Java, or Scala.
Hands-on with Azure cloud services including networking and security configurations.
Key Responsibilities:1. Lead the design and implementation of ETL solutions using Azure Data Factory.2. Guide and mentor team members on data engineering best practices.3. Develop and maintain complex ETL pipelines using Python, Java, or Scala.4. Ensure high-quality, secure, and performant data migrations using Azure Blob Storage and Spark JDBC.5. Drive collaboration across teams to implement advanced analytics and ML models in Databricks.6. Identify and resolve performance bottlenecks and network-related issues.7. Ensure adherence to data governance and compliance standards across all data flows.Expierence Range8+ YearsSecondary Skills (Good To have)
β’ Secondary Skills:
Understanding of Databricks ML and analytics tools.
Experience resolving networking/VPN issues related to data flow.
Familiarity with data governance, security, and compliance frameworks.
Experience in setting up CI/CD pipelines and using DevOps tools is a plus.Soft skills/other skills (If any)
Analytical Skills: Strong analytical and problem-solving skills, with the ability to interpret complex data sets and derive meaningful insights
Communication Skills: Excellent verbal and written communication skills, with the ability to convey technical information to non-technical stakeholders
Leadership Skills: Proven ability to lead and manage teams, with a track record of successful project delivery.
Presentation Skills: Effectively presenting project updates and outcomes to stakeholders and executives.
Job Type: Contract
Pay: $61.73 - $74.34 per hour
Work Location: In person