Data Engineer

Payrate: $50.00 - $60.00/hr. Summary: We are seeking a Sr. Data Engineer who need to join our dynamic and fast-paced team. The ideal candidate should excel in development or pipeline, orchestrating data, resolving connection issue, solve production issues, guide team members. The successful candidate will play a critical role in leading the development and design of Supply Chain Data Engineering solutions, maintaining high standards of code quality, and reducing technical debt and vulnerabilities across the project. The ideal candidate should be able to work in shared service team and work in multiple initiatives parallelly. Responsibilities: • Development: - Working with varied data file formats (Avro, JSON, csv) using PySpark for ingesting and transformation, Terraform scripting and DevOps process. • Lead Development Initiatives: Develop code with FTR and of quality. Also to take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards. • Code Quality and Maintenance: Oversee the maintenance of code quality and enforce best practices, including code reviews, unit testing, CICD, and adherence to coding standards. • Reduce Technical Debt: Identify, prioritize, and implement strategies to reduce technical debt and address vulnerabilities in the codebase. • Team Leadership: Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment. • Collaboration: Work closely with cross-functional teams, including product management, Cloud Security, LOB, Network security, and DevOps, to integrate different features into broader solutions. • Problem Solving: Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience. • Documentation: Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance. • Stakeholder Communication: Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives. Qualifications: • Proven experience in a similar role, with a strong track record as Sr. Data Engineer and has helped/lead development teams in delivering high-quality data orchestration solutions with min 7+ years’ experience. • Technical skill: Azure, Databricks, PySpark, Object Oriented programming concept, Python, Delta share and Terraform • GitHub Actions: Familiarity with setting up and managing CI/CD pipelines using GitHub Actions, ensuring smooth and automated deployment processes. • Agile Methodology: Experience working in an Agile/Scrum environment, with a focus on iterative development, continuous feedback, and delivery. Desired Skills: • Python Unit Testing • Unity Catalog • Databricks Asset Bundles • Unit Testing/Mocking Pay Transparency: The typical base pay for this role across the U.S. is: $50.00 - $60.00 /hour. Non-exempt positions are eligible for overtime at a rate of 1.5 times the base hourly rate for all hours worked in excess of 40 in a work week, or as required by state or local law. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, health savings accounts with qualified medical plan enrollment, 10 paid days off, 3 days paid bereavement leave, 401(k) plan participation with employer match,  life and disability insurance, commuter benefits, dependent care flexible spending account, accident insurance, critical illness insurance, hospital indemnity insurance, accommodations and reimbursement for work travel, and discretionary performance or recognition bonus. Sick leave and mobile phone reimbursement provided based on state or local law. Consent to Communication and Use of AI Technology: By submitting your application for this position and providing your email address(es) and/or phone number(s), you consent to receive text (SMS), email, and/or voice communication whether automated (including auto telephone dialing systems or automatic text messaging systems), pre-recorded, AI-assisted, or individually initiated from Aditi Consulting, our agents, representatives, or affiliates at the phone number and/or email address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary. You represent and warrant that the email address(es) and/or telephone number(s) you provided to us belong to you and that you are permitted to receive calls, text (SMS) messages, and/or emails at these contacts. You also acknowledge and agree to Aditi Consulting LLC’s use of AI technology during the sourcing process, including calls from an AI Voice Recruiter. AI is used solely to gather data and does not replace human-based decision-making in employment decisions.  Calls may be recorded. Consent is not a condition of purchasing any property, goods, or services. You may revoke your consent at any time by replying “STOP” to messages or by contacting  privacy@aditiconsulting.com. For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our Privacy Policy . #AditiConsulting # 26 - 00276