Sr. Databricks Engineer

Sr. Databricks Engineer Location: Plano, TX (Onsite from Day 1) Long Term Job Requirements Key Responsibilities: Collaborate with the Product Owner, Business analyst, and other team members to understand requirements and design scalable data pipelines and architectures. Build and maintain data ingestion, transformation and storage processes using Databricks and Azure services. Develop efficient ETL/ELT workflows to extract, transform, and load data from various sources into data lakes. Design solutions and drive implementation for enhancing, improving, and securing Data Lakehouse. Optimize and fine-tune data pipelines for performance, reliability, and scalability. Implement data quality checks and monitoring to ensure data accuracy and integrity. Work with data developers, engineers, and data analysts to provide them with the necessary data infrastructure and tools for analysis and reporting. Troubleshoot and resolve data-related issues, including performance bottlenecks and data inconsistencies. Stay up to date with the latest trends and technologies in data engineering and recommend improvements to existing systems and processes. Qualifications: Bachelor’s degree in computer science, Engineering, or a related field. 4+ years of proven experience as a Data Engineer, with a focus on designing and building data pipelines. Experience in working with big and complex data environments. Certifications in Databricks or Azure services is a plus. Experience with data streaming technologies such as Apache Kafka or Azure Event Hubs is a plus. Job Types: Full-time, Contract Pay: $94,713.93 - $124,064.09 per year Work Location: In person