Senior Data Engineer

Employment Eligibility Statement Due to specific project and client requirements, this position is open to U.S. Citizens and U.S. Lawful Permanent Residents (Green Card holders). Sponsorship is not available at this time. Danta Technologies evaluates all candidates in compliance with the Immigration and Nationality Act (INA) and EEOC guidelines. All hiring decisions are made without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, age, disability, veteran status, or any other protected characteristic. This role is located in Chicago, IL, and follows a hybrid work model, requiring 3 days onsite each week. The position is available only to eligible candidates based in the United States. Our client is a leading multinational organization in the insurance and financial services industry. Role Overview The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveraging Databricks , Python, ETL, and DevOps . This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives. Key Responsibilities • Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data. • Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses. • Implement data governance , security, and compliance standards. • Automate workflows using Python scripting and CI/CD pipelines. • Troubleshoot and resolve issues in data ingestion, transformation, and storage. Required Skills & Experience • 8+ years in data engineering or related roles. • Expert-level Python programming for data processing and automation. • Hands-on experience with Databricks and Delta Lake . • Strong knowledge of Azure Data Factory , Data Lake , and Synapse (or equivalent cloud platforms). • Proficiency in SQL and performance tuning. • Familiarity with DevOps practices , CI/CD, and infrastructure-as-code tools. • Experience with data migration and cloud-native architectures . • Excellent problem-solving and communication skills Notes:- All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance. Benefits: Danta offers a compensation package to all W2 employees that are competitive in the industry. It consists of competitive pay, the option to elect healthcare insurance (Dental, Medical, Vision), Major holidays and Paid sick leave as per state law. The rate/ Salary range is dependent on numerous factors including Qualification, Experience and Location.