Data Engineer

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Genesis10, is seeking the following. Apply via Dice today! Genesis10 is currently seeking a Data Engineer for a remote position with a Financial Services Organization located in New York, NY. This is a 6+ month contract opportunity. Our client is composed of data scientists, AI engineers, and software engineers, drives innovation by developing advanced AI and data science solutions that enhance decision-making across our financial advisory and asset management business lines. This team ensures our client stays at the forefront of a data-driven world, delivering insights that support client engagements and strengthen key partnerships, while keeping the firm competitive and efficient in an evolving financial landscape. As a Data Engineer, you'll lead efforts to onboard and model datasets on modern cloud data platforms, delivering reliable pipelines and high-quality data layers that serve analytics, reporting, and ML/AI workloads. Responsibilities: • Ingest and model data from APIs, files/SFTP, and relational sources; implement layered architectures (raw/clean/serving) using PySpark/SQL and dbt, Python. • Design and operate pipelines with Prefect (or Airflow), including scheduling, retries, parameterization, SLAs, and welldocumented runbooks. • Build on cloud data platforms, leveraging S3/ADLSS for storage and a Spark platform (e.g., Databricks or equivalent) for compute; manage jobs, secrets, and access. • Publish governed data services and manage their lifecycle with Azure API Management (APIM) - authentication/authorization, policies, versioning, quotas, and monitoring. • Enforce data quality and governance through data contracts, validations/tests, lineage, observability, and proactive alerting. • Optimize performance and cost via partitioning, clustering, query tuning, job sizing, and workload management. • Uphold security and compliance (e.g., PII handling, encryption, masking) in line with firm standards. • Collaborate with stakeholders (analytics, AI engineering, and business teams) to translate requirements into reliable, productionready datasets. • Enable AI/LLM use cases by packaging datasets and metadata for downstream consumption, integrating via Model Context Protocol (MCP) where appropriate. • Continuously improve platform reliability and developer productivity by automating routine tasks, reducing technical debt, and maintaining clear documentation. Requirements: • Bachelor's or advanced degree in Computer Science, Data Engineering, or a related field. • 4-15 years of professional data engineering experience. • Strong Python, SQL, and Spark (PySpark) skills, and/or Kafka. • Snowflake (Snowpipe, Tasks, Streams) as a complementary warehouse. • Databricks (Delta formats, workflows, cataloging) or equivalent Spark platforms. • Hands-on experience building ETL/ELT with Prefect (or Airflow), dbt, Spark, and/or Kafka. • Experience onboarding datasets to cloud data platforms (storage, compute, security, governance). • Familiarity with Azure/AWS/Google Cloud Platform data services (e.g., S3/ADLSS; Redshift/BigQuery; Glue/ADF). • Git-based workflows CI/CD and containerization with Docker (Kubernetes a plus). • Only candidates available and ready to work directly as Genesis10 employees will be considered for this position. Desired: • Advanced APIM practices (custom policies, OAuth2/JWT, mTLS, private endpoints) and Azure AD integration. • Integrating datasets into MCP tools/providers for LLM/agent applications; familiarity with frameworks such as LangChain or LlamaIndex. • Data observability/quality tools (e.g., Great Expectations, Monte Carlo, Datafold) and strong lineage practices. • Exposure to financial datasets and controls (PII handling, encryption, masking). Pay rate range: $100 - $115 hourly. If you have the described qualifications and are interested in this exciting opportunity, please apply! Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals. For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: • Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years. • The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years. • Access to an experienced, caring recruiting team (more than 7 years of experience, on average.) • Behavioral Health Platform • Medical, Dental, Vision • Health Savings Account • Voluntary Hospital Indemnity (Critical Illness & Accident) • Voluntary Term Life Insurance • 401K • Sick Pay (for applicable states/municipalities) • Commuter Benefits (Dallas, NYC, SF) For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website. Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.