Data Engineer

Job Title: Data Engineer Location: Houston, TX Job Type: 12 CTH Job Pay: 70-80 hourly Job Summary: We are seeking a Data Engineer to design, build, and maintain scalable data platforms supporting analytics, AI/ML, and operational use cases. This role focuses on the Azure + Databricks ecosystem, strong ETL/ELT engineering, and modern data platform best practices. Ideal candidates enjoy working with messy, real-world data and partnering closely with data scientists and business stakeholders, with interest in converting to fulltime. Key Responsibilities • Design, build, and maintain end-to-end data pipelines using Azure and Databricks (ADF, Spark, Delta Lake). • Implement and manage Medallion Architecture (Bronze/Silver/Gold) for reliable, scalable data processing. • Ingest, transform, and optimize structured, semi structured, and unstructured data from diverse enterprise and industrial sources. • Develop high-performance Spark jobs using PySpark and Spark SQL. • Optimize data models and storage for downstream analytics, reporting, and ML workloads. • Establish and maintain CI/CD pipelines for data engineering assets (Git, Azure DevOps, automated testing, code reviews). • Ensure data quality, reliability, observability, and performance tuning across pipelines. • Partner with data scientists, analysts, and domain experts to support analytics and AI/ML use cases. • Translate ambiguous business requirements into scalable technical solutions and production ready pipelines. Required Qualifications • 3+ years of experience as a Data Engineer or similar role. • Strong hands-on experience with Azure data services and Databricks. • Proven experience implementing ETL/ELT workflows and Medallion architecture with Delta Lake. • Advanced proficiency in Python, SQL, and Apache Spark. • Experience with CI/CD for data platforms, including version control and automated deployment. • Solid understanding of data modeling, data warehousing, and distributed processing concepts. • Ability to work through open-ended, ambiguous problems with evolving data and requirements. • Strong communication skills and ability to collaborate with both technical and nontechnical stakeholders. Preferred Qualifications • Experience with energy, oil & gas, or industrial datasets. • Familiarity with Azure Synapse, Event Hubs, IoT data, or streaming pipelines. • Exposure to supporting ML pipelines (feature engineering, MLflow integration). • Interest in leadership growth and long-term platform ownership EEO Statement: Brooksource is an equal opportunity employer that does not discriminate on the basis of actual or perceived race, color, creed, religion, national origin, ancestry, citizenship status, age, sex or gender (including pregnancy, childbirth, lactation and related medical conditions), gender identity or gender expression, sexual orientation, marital status, military service and veteran status, physical or mental disability, protected medical condition as defined by applicable state or local law, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances. Benefits & Perks Benefits & Perks: Brooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc. Pay Disclaimer: The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.