On W2 - Lead Data Egineer with DOJ/TDCJ/Courts/Judiciary/Justice Etc

Hello, Hope you are doing Good. Position: Sr. Lead Data Engineer Location: Huntsville, TX (Remote) This is with State client, Can work on C2C/ on W2. We are seeking a highly skilled and experienced professional to lead the design, implementation, and management of end-to-end enterprise-grade data solutions. This role involves expertise in building and optimizing data warehouses, data lakes, and lakehouse platforms, with a strong emphasis on data engineering, data science, and machine learning. Education: Bachelor’s Computer Science, Data Science, Engineering, or a related field. Experience: Minimum 10 years in data engineering, data architecture, or a similar role, with at least 3 years in a lead capacity. Responsibilities Include: • Architect, design, and manage the entire data lifecycle from data ingestion, • Ensure high data quality and reliability through automated data validation and testing and provide high quality clean, and usable data from data sets of varying states of disorder. • Develop and enforce architecture standards, patterns, and reference models for large-scale data platforms. • Ability to identify and implement the most appropriate data management system and enable integration capabilities for external tools to perform ingestion, compilation, analytics and visualization. REQUIRED SKILLS: • Proficient in SQL, Python, and big data processing frameworks (e.g., Spark, Flink). • Strong experience with cloud platforms (AWS, Azure, GCP) and related data services. • Hands-on experience with data warehousing tools (e.g., Snowflake, Redshift, BigQuery), Databricks running on multiple cloud platforms (AWS, Azure and GCP) and data lake technologies (e.g., S3, ADLS, HDFS). • Expertise in containerization and orchestration tools like Docker and Kubernetes. • Knowledge of MLOps frameworks and tools (e.g., MLflow, Kubeflow, Airflow). • Experience with real-time streaming architectures (e.g., Kafka, Kinesis). • Familiarity with Lambda and Kappa architectures for data processing. • Enable integration capabilities for external tools to perform ingestion, compilation, analytics and visualization. PREFERRED SKILLS: • Certifications in cloud platforms or data-related technologies. • Familiarity with graph databases, NoSQL, or time-series databases. • Knowledge of data privacy regulations (e.g., GDPR, CCPA) and compliance requirements. • Experience in implementing and managing business glossaries, data governance rules, metadata lineage, and ensuring data quality. • Highly experienced with AWS cloud platform and Databricks Lakehouse. --- Thanks Srujana EMail: srujana.b@my3tech.com | 605-674-2119