Senior Data Engineer #11325

ECCO Select is a talent acquisition and consulting company specializing in people, process and technology solutions. We provide the talent behind the technology enabling our clients to achieve their goals. For more information about ECCO Select, visit us at www.eccoselect.com. Position Title: Senior Data Engineer / Data Architect Location Information Washington, D.C. Position Responsibilities: As a Senior Data Engineer / Data Architect, you will play a pivotal role in designing, building, optimizing, and maintaining modern data platforms and data integration solutions that support enterprise analytics, reporting, research, and operational initiatives. You will leverage your expertise in data modeling, database design, and workflow automation to provide scalable, reliable, and efficient data solutions. In this position, you will collaborate with various teams and stakeholders to deliver data-driven technologies that enable organizational growth and data-informed decision-making. Key responsibilities include: • Designing, developing, and maintaining scalable enterprise data architectures, databases, data lakes, and data warehouse solutions. • Building, optimizing, and automating ETL/ELT processes as well as data integration pipelines. • Developing and maintaining robust data processing frameworks to handle both structured and unstructured data sources. • Designing and implementing logical, physical, and conceptual data models tailored to business and analytical requirements. • Ensuring data quality, integrity, governance, and security across enterprise data environments. • Monitoring and optimizing database performance, storage utilization, and data processing workloads. • Developing and implementing workflow orchestration and automation solutions to support data operations and analytics. • Collaborating with cross-functional teams to gather requirements and deliver scalable, reliable data solutions. • Performing root cause analysis and troubleshooting for data-related issues to enhance operational efficiency. • Supporting cloud migration initiatives and modernization projects involving data platforms and pipelines. • Implementing and maintaining CI/CD processes, DataOps practices, and deployment automation. • Documenting technical designs, architectural decisions, data flows, and operational procedures. • Evaluating emerging technologies to recommend and implement improvements to data infrastructure and engineering approaches. • Providing technical leadership, guidance, and mentorship to junior members and project teams. Essential Skills, Experience • Bachelor’s degree in Computer Science, Information Technology, Engineering, Mathematics, or a related technical field. • At least 7 years of experience in data engineering, data architecture, database administration, or closely related fields. • Expertise in designing, developing, and optimizing enterprise data pipelines and integration solutions. • Advanced proficiency with SQL and relational database systems (e.g., PostgreSQL, SQL Server, MySQL). • Strong programming skills with Python and experience with scripting languages used in data engineering and analytics. • Hands-on experience managing large-scale data environments, distributed computing, and big data processing systems. • Proficiency with workflow orchestration and automation tools (e.g., Apache Airflow, Prefect, Dagster, AWS Step Functions). • Experience developing and supporting data solutions in Linux-based environments. • Familiarity with source control and collaboration tools such as GitHub and GitLab. • Strong analytical, troubleshooting, and problem-solving abilities. • Excellent written and verbal communication skills with the ability to relay technical concepts to diverse audiences. • Preferred Experience/Skills:Advanced degree in Computer Science, Data Science, Engineering, or a related discipline. • Experience with cloud platforms (AWS, Azure, or Google Cloud Platform). • Knowledge of Snowflake or other modern cloud data platforms. • Experience with NoSQL and graph databases. • Experience implementing enterprise data warehouses and Change Data Capture (CDC) methodologies. • Background in migrating data platforms and workflows between on-premises and cloud environments. • Experience with CI/CD pipelines and DataOps best practices. • Experience developing, deploying, and maintaining machine learning solutions. • Understanding of time-series data, forecasting models, and advanced analytics. • Experience supporting research, financial, regulatory, healthcare, public sector, or other data-intensive domains. • Working knowledge of additional programming languages (Java, Scala, JavaScript, Perl, etc.). • Core Competencies:Data Architecture & Modeling • Data Engineering & Integration • Database Design & Administration • Cloud Data Platforms • ETL/ELT Development • Workflow Automation • Data Governance & Quality • DataOps & CI/CD • Performance Optimization • Problem Solving & Troubleshooting • Cross-Functional Collaboration • Technical Leadership ECCO Select is committed to hiring and retaining a diverse workforce. Our policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Veterans of our United States Uniformed Services are specifically encouraged to apply for ECCO Select opportunities. Equal Employment Opportunity is The Law This Organization Participates in E-Verify