Data Engineer II

Job Title: Data Engineer II Location: Arlington, VA (Local Candidates Preferred) Employment Type: Contract (C2C) IndustryPayments / Financial Services Important Notes • Local candidates strongly preferred. • No third-party vendors. • The submitting company must directly sponsor/hold the candidate's visa. • Please submit candidates with competitive C2C rates based on their skills and experience. Required Experience We are seeking a highly skilled Data Engineer II with 8+ years of hands-on data engineering experience building and maintaining large-scale ETL pipelines and enterprise data solutions. The ideal candidate will have a strong background in the payments or financial services industry, along with excellent communication and stakeholder management skills. Required Qualifications • Bachelor's degree in Engineering, Mathematics, Finance, Business, Computer Science, or a related quantitative field (or equivalent practical experience). • 8+ years of experience as a Data Engineer or in a similar role. • Strong expertise in designing, developing, and optimizing enterprise ETL pipelines. • Advanced SQL skills with the ability to write and optimize complex queries. • Hands-on experience with: • Apache Spark (PySpark, Spark SQL, Spark Streaming) • Hadoop ecosystem (HDFS/Ozone, Hive, YARN) • Python • Strong understanding of data modeling and database design. • Experience troubleshooting and resolving data quality and pipeline issues. • Knowledge of data validation and testing methodologies. • Excellent verbal and written communication skills with the ability to collaborate effectively across technical and business teams. Preferred Experience • Experience designing, implementing, and maintaining enterprise-scale ETL processes. • Ability to develop scalable, high-performance data processing solutions. • Experience building and optimizing big data pipelines using Apache Spark and Hadoop. • Collaborate with cross-functional teams to deliver high-quality data solutions. • Experience supporting global data platforms and enterprise data delivery initiatives. • Ability to build strong relationships with stakeholders and contribute to both local and global projects. Responsibilities • Design, develop, and maintain scalable ETL pipelines and data processing frameworks. • Build and optimize large-scale data pipelines using Apache Spark, Hadoop, SQL, and Python. • Improve data processing performance and efficiency for large datasets. • Automate routine data engineering tasks and streamline workflows. • Apply best practices including version control, code reviews, testing, and data validation. • Partner with Data Engineers, Analysts, and business stakeholders to deliver reliable, high-quality data solutions. • Monitor, troubleshoot, and resolve data pipeline and data quality issues. • Ensure compliance with internal policies, security standards, and regulatory requirements. Must-Have Skills • Data Engineering • ETL Development • Apache Spark (PySpark, Spark SQL, Spark Streaming) • Hadoop (HDFS/Ozone, Hive, YARN) • Python • SQL • Data Modeling • Big Data Technologies • Payments or Financial Services Domain • Strong Communication & Stakeholder Management