Sr Databricks Data Engineer

Peak Performers has partnered with a Texas State Agency to assist in their search for a remote Sr. Databricks Data Engineer . In this contract position, you will be responsible for developing, maintaining, and optimizing big data solutions using the Databricks Unified Analytics Platform. Major duties • Supports data engineering, machine learning, and analytics initiatives within this organization that relies on large-scale data processing. • Designing and developing scalable data pipelines • Implementing ETL/ELT workflows • Optimizing Spark jobs • Integrating with Azure Data Factory • Automating deployments • Collaborating with cross-functional teams • Ensuring data quality, governance, and security. What are we looking for? • 8+ years of experience implementing ETL/ELT workflows for both structured and unstructured data. • 8+ years of experience automating deployments using CI/CD tools • Experience designing and maintaining data models, schemas, and database structures to support analytical and operational use cases. • Proficiency in Python and R programming languages. • Strong SQL querying and data manipulation skills. • Experience with Azure cloud platform, DevOps, CI/CD pipelines, and version control systems. • Strong troubleshooting and debugging capabilities. • Experience designing and developing scalable data pipelines using Apache Spark on Databricks. • Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL. • Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake. • Knowledge of ML libraries (MLflow, Scikit-learn, TensorFlow) preferred. • Databricks Certified Associate Developer for Apache Spark preferred. • Azure Data Engineer Associate preferred. Exciting Opportunity Details • Rate: $86.00/hour • W2 Contract • Remote • 9 month contract with opportunity for extension The Peak Performers difference • Excellent medical health, dental & vision insurance at 60 days • Our employees may choose to participate in a 403(b) retirement plan • Qualified applicants with chronic medical conditions and/or disabilities receive priority placement • We pay weekly through direct deposit • In business since 1994 and thousands of job placements All employment offers are contingent on the successful completion of a pre-employment criminal background check, in compliance with all applicable federal and state laws. Applicants for employment with Peak Performers must possess work authorization that does not require sponsorship for a visa now or in the future. Peak Performers is an equal opportunity employer and will consider all applicants without regard to race, marital status, sex, age, color, religion, national origin, veteran status, disability or any other characteristic protected by law. Peak Performers does not accept unsolicited resumes from headhunters, recruitment agencies or fee-based recruitment services. KN8454841013