Lead Data Engineer/Architect

⭐ - Featured Role | Apply direct with Data Freelance Hub
This role is for a Lead Data Engineer/Architect with a contract length of "unknown," offering a pay rate of "unknown," located in Fort Mill, SC (Hybrid). Requires 13+ years in Data Engineering, AWS expertise, and leadership experience, preferably in BFSI.
🌎 - Country
United States
πŸ’± - Currency
$ USD
-
πŸ’° - Day rate
-
πŸ—“οΈ - Date discovered
September 4, 2025
πŸ•’ - Project duration
Unknown
-
🏝️ - Location type
Hybrid
-
πŸ“„ - Contract type
Unknown
-
πŸ”’ - Security clearance
Unknown
-
πŸ“ - Location detailed
South Carolina, United States
-
🧠 - Skills detailed
#AWS Glue #Docker #Python #SQL (Structured Query Language) #AWS (Amazon Web Services) #Data Science #Redshift #Computer Science #Data Warehouse #Scala #Spark (Apache Spark) #Agile #PySpark #Security #S3 (Amazon Simple Storage Service) #Athena #Business Analysis #Snowflake #Data Engineering #Data Lake #Deployment #Leadership #Big Data #Cloud #"ETL (Extract #Transform #Load)" #Data Framework #Data Modeling #Data Governance #Kubernetes #Data Pipeline #Lambda (AWS Lambda)
Role description
Job Title: AWS Tech Lead Location: Fort Mill, SC (Hybrid/Onsite as required) Job Summar yWe are looking for a highly experienced Data Engineer – AWS Tech Lead to design and lead scalable cloud-based data solutions. This role will combine hands-on engineering with leadership responsibilities, guiding a team of data engineers while collaborating with architects, product owners, and business stakeholders. The ideal candidate will have deep expertise in AWS data services, ETL/ELT pipelines, and big data frameworks, with proven experience in leading technical delivery . Key Responsibiliti β€’ esLead the design, development, and deployment of large-scale data pipelines and solutions on AW β€’ S.Provide technical leadership and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and performance optimizatio β€’ n.Architect data lake and data warehouse solutions leveraging AWS Glue, Redshift, S3, Athena, EMR, and Lambd β€’ a.Drive development of ETL/ELT processes using PySpark, Python, and SQ β€’ L.Implement and enforce data governance, quality checks, and security standards across the platfor β€’ m.Collaborate with business analysts, data scientists, and product teams to translate business requirements into scalable solution β€’ s.Optimize cost and performance of AWS-based data workload β€’ s.Troubleshoot production issues and ensure high availability of data pipeline β€’ s.Participate in sprint planning, backlog refinement, and Agile ceremonies as a technical lea d. Required Qualificati β€’ ons13+ years of experience in Data Engineering, with at least 4+ years in a technical leadership ro β€’ le.Strong expertise in AWS data services: Glue, S3, Redshift, Athena, Lambda, Step Functions, E β€’ MR.Proficiency in PySpark, Python, and SQL for large-scale data processi β€’ ng.Solid experience in data modeling (star, snowflake, dimensional modeling) and data lake/warehouse architectur β€’ es.Proven track record in leading and mentoring data engineering tea β€’ ms.Strong understanding of Agile methodologies and CI/CD practices for data pipelin es. Preferred Qualificat β€’ ionsExperience in BFSI / Wealth Management dom β€’ ain.AWS Certification (Data Analytics Specialty, Solutions Architect, or Big Da β€’ ta).Familiarity with containerization (Docker, Kubernetes) and orchestration framewo rks. Educ β€’ ationBachelor’s degree in Computer Science, Information Technology, Engineering, or related f β€’ ield.Master’s degree prefe rred.