Data Engineer

K&K Talent Solutions inc is an International recruiting agency that has been providing technical resources in the European, Canada and the USA region since 1993. This position is with one of our clients in USA , who is actively hiring candidates to expand their teams. Role: Data Engineer / Analyst – Identity Analytics - Location: San Diego, Mountain View, CA (Hybrid – 3+ days onsite) Employment type: contract Contract Duration (If role is contract): Long term Must have skills 1. Python (data processing & ETL) 1. PySpark (large-scale data transformations) 1. SQL (complex queries, joins, window functions) 1. ETL / Data Pipelines (batch & streaming) 1. AWS / Databricks (Redshift, Athena, Delta Lake) 1. Clickstream Data Handling (sessionization, pathing) About the Role • Hands-on role for a creative problem solver with passion for building, enhancing, and supporting advanced data toolkits. • Collaborate with data engineers, business analysts, data scientists, product managers, architects, and designers to mature Identity Analytics capabilities. • Leverage advanced analytics database design approaches combined with strong functional knowledge to empower business analysts and product managers. • Take ownership of complex workflows that translate clickstream and transactional data into a complete analytics platform. • Contribute to cutting-edge capabilities such as: • Real-time anomaly detection • Self-serve analytics • Bayesian-based experimentation • Other advanced data-driven solutions • Enable and scale data-driven decision making as the Identity platform evolves for the future. Responsibilities • Develop and maintain ETL pipelines from multiple distinct data sources using PySpark and SQL • Work with high volume batch and streaming datasets to deliver performant, reliable solutions • Communicate with data workers across Intuit to answer technical and functional questions • Write and implement technical specifications based on business requirements to complete maintenance and delivery of new data pipelines Technical Qualifications • 8+ years of experience working on ETL/data pipelines to support analytics use cases • Advanced Python and SQL development skillsets • Expertise working with big data and data lakes • Familiarity with AWS (Redshift, Athena, and AWS core concepts) and Databricks • Experience with clickstream data Other Qualifications • Excellent problem-solving skills and end-to-end systems thinking • Outstanding communications skills with the ability to influence decision makers and build consensus with teams • Proactive and inquisitive learner who seeks out and capitalizes on opportunities for change that enhance the business • Strong organizational skills, time management, accountability, and the ability to manage multiple projects simultaneously to meet objectives and key deadlines