Lead Data Engineer / Data Architect_only on W2

Position: Lead Data Engineer / Data Architect\_only on W2 Overview We are seeking an experienced professional to lead the design, implementation, and management of enterprise-grade data solutions. The ideal candidate will have deep expertise in data engineering, data architecture, and cloud-based data platforms, enabling scalable analytics and machine learning solutions. Education & Experience • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field. • Minimum 10 years in data engineering or architecture roles, with at least 3 years in a lead capacity. Must-Have Skills & Expertise • Proficiency in SQL and Python. • Strong experience with cloud platforms (AWS, Azure, or GCP) and associated data services. • Hands-on experience with data warehouses (Snowflake, Redshift, BigQuery), Databricks, and data lakes (S3, ADLS, HDFS). • Expertise in big data processing frameworks (Spark, Flink). • Knowledge of real-time streaming architectures (Kafka, Kinesis) and Lambda/Kappa architectures. • Experience in data modeling, data governance, and ensuring high data quality. • Hands-on experience with containerization and orchestration (Docker, Kubernetes). • Ability to design and implement end-to-end data pipelines for batch and real-time processing supporting analytics and ML. Key Responsibilities • Lead the architecture, design, and management of enterprise data platforms. • Ensure reliable, clean, and usable data across the organization. • Implement scalable data workflows and enforce data governance standards. • Collaborate with cross-functional teams to enable analytics and machine learning initiatives.