

Lead Data Engineer/Architect
β - Featured Role | Apply direct with Data Freelance Hub
This role is for a Lead Data Engineer/Architect with a contract length of "unknown," offering a pay rate of "unknown," located in Fort Mill, SC (Hybrid). Requires 13+ years in Data Engineering, AWS expertise, and leadership experience, preferably in BFSI.
π - Country
United States
π± - Currency
$ USD
-
π° - Day rate
-
ποΈ - Date discovered
September 4, 2025
π - Project duration
Unknown
-
ποΈ - Location type
Hybrid
-
π - Contract type
Unknown
-
π - Security clearance
Unknown
-
π - Location detailed
South Carolina, United States
-
π§ - Skills detailed
#AWS Glue #Docker #Python #SQL (Structured Query Language) #AWS (Amazon Web Services) #Data Science #Redshift #Computer Science #Data Warehouse #Scala #Spark (Apache Spark) #Agile #PySpark #Security #S3 (Amazon Simple Storage Service) #Athena #Business Analysis #Snowflake #Data Engineering #Data Lake #Deployment #Leadership #Big Data #Cloud #"ETL (Extract #Transform #Load)" #Data Framework #Data Modeling #Data Governance #Kubernetes #Data Pipeline #Lambda (AWS Lambda)
Role description
Job Title: AWS Tech Lead
Location: Fort Mill, SC (Hybrid/Onsite as required)
Job Summar
yWe are looking for a highly experienced Data Engineer β AWS Tech Lead to design and lead scalable cloud-based data solutions. This role will combine hands-on engineering with leadership responsibilities, guiding a team of data engineers while collaborating with architects, product owners, and business stakeholders. The ideal candidate will have deep expertise in AWS data services, ETL/ELT pipelines, and big data frameworks, with proven experience in leading technical delivery
.
Key Responsibiliti
β’ esLead the design, development, and deployment of large-scale data pipelines and solutions on AW
β’ S.Provide technical leadership and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and performance optimizatio
β’ n.Architect data lake and data warehouse solutions leveraging AWS Glue, Redshift, S3, Athena, EMR, and Lambd
β’ a.Drive development of ETL/ELT processes using PySpark, Python, and SQ
β’ L.Implement and enforce data governance, quality checks, and security standards across the platfor
β’ m.Collaborate with business analysts, data scientists, and product teams to translate business requirements into scalable solution
β’ s.Optimize cost and performance of AWS-based data workload
β’ s.Troubleshoot production issues and ensure high availability of data pipeline
β’ s.Participate in sprint planning, backlog refinement, and Agile ceremonies as a technical lea
d.
Required Qualificati
β’ ons13+ years of experience in Data Engineering, with at least 4+ years in a technical leadership ro
β’ le.Strong expertise in AWS data services: Glue, S3, Redshift, Athena, Lambda, Step Functions, E
β’ MR.Proficiency in PySpark, Python, and SQL for large-scale data processi
β’ ng.Solid experience in data modeling (star, snowflake, dimensional modeling) and data lake/warehouse architectur
β’ es.Proven track record in leading and mentoring data engineering tea
β’ ms.Strong understanding of Agile methodologies and CI/CD practices for data pipelin
es.
Preferred Qualificat
β’ ionsExperience in BFSI / Wealth Management dom
β’ ain.AWS Certification (Data Analytics Specialty, Solutions Architect, or Big Da
β’ ta).Familiarity with containerization (Docker, Kubernetes) and orchestration framewo
rks.
Educ
β’ ationBachelorβs degree in Computer Science, Information Technology, Engineering, or related f
β’ ield.Masterβs degree prefe
rred.
Job Title: AWS Tech Lead
Location: Fort Mill, SC (Hybrid/Onsite as required)
Job Summar
yWe are looking for a highly experienced Data Engineer β AWS Tech Lead to design and lead scalable cloud-based data solutions. This role will combine hands-on engineering with leadership responsibilities, guiding a team of data engineers while collaborating with architects, product owners, and business stakeholders. The ideal candidate will have deep expertise in AWS data services, ETL/ELT pipelines, and big data frameworks, with proven experience in leading technical delivery
.
Key Responsibiliti
β’ esLead the design, development, and deployment of large-scale data pipelines and solutions on AW
β’ S.Provide technical leadership and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and performance optimizatio
β’ n.Architect data lake and data warehouse solutions leveraging AWS Glue, Redshift, S3, Athena, EMR, and Lambd
β’ a.Drive development of ETL/ELT processes using PySpark, Python, and SQ
β’ L.Implement and enforce data governance, quality checks, and security standards across the platfor
β’ m.Collaborate with business analysts, data scientists, and product teams to translate business requirements into scalable solution
β’ s.Optimize cost and performance of AWS-based data workload
β’ s.Troubleshoot production issues and ensure high availability of data pipeline
β’ s.Participate in sprint planning, backlog refinement, and Agile ceremonies as a technical lea
d.
Required Qualificati
β’ ons13+ years of experience in Data Engineering, with at least 4+ years in a technical leadership ro
β’ le.Strong expertise in AWS data services: Glue, S3, Redshift, Athena, Lambda, Step Functions, E
β’ MR.Proficiency in PySpark, Python, and SQL for large-scale data processi
β’ ng.Solid experience in data modeling (star, snowflake, dimensional modeling) and data lake/warehouse architectur
β’ es.Proven track record in leading and mentoring data engineering tea
β’ ms.Strong understanding of Agile methodologies and CI/CD practices for data pipelin
es.
Preferred Qualificat
β’ ionsExperience in BFSI / Wealth Management dom
β’ ain.AWS Certification (Data Analytics Specialty, Solutions Architect, or Big Da
β’ ta).Familiarity with containerization (Docker, Kubernetes) and orchestration framewo
rks.
Educ
β’ ationBachelorβs degree in Computer Science, Information Technology, Engineering, or related f
β’ ield.Masterβs degree prefe
rred.