Data Engineer

Immediate need for a talented Data Engineer. This is a 12 months contract opportunity with long-term potential and is located in Charlotte, NC(Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID:25-91114 Pay Range: $68 - $70/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: • Design, develop, and maintain data pipelines and ETL workflows using Spark and other modern data engineering tools. • Integrate and process large-scale financial datasets, ensuring accuracy, scalability, and high performance. • Collaborate with business and operations teams to support OTC trade data processing, reconciliation, and reporting. • Implement data validation, transformation, and quality frameworks aligned with business and regulatory requirements. • Optimize Spark jobs and SQL queries to improve performance in large data environments. • Partner with data architects, analysts, and application developers to deliver robust, efficient, and scalable solutions. • Automate workflows and develop reusable data engineering components to streamline processes. Key Requirements and Technology Experience: • Key Skills:"Spark", “ETL”, “OTC” . • Hands-on experience with Apache Spark for large-scale data processing. • Strong understanding of OTC trading operations, trade lifecycle, and financial instruments. • Proficiency in SQL, data warehousing concepts, and ETL frameworks. • Experience working with cloud platforms (AWS, Azure, or GCP) and data orchestration tools (Airflow, Databricks, etc.). • Strong analytical, troubleshooting, and problem-solving abilities in data-centric environments. • Ability to work collaboratively in a fast-paced, agile financial domain. Our client is a leading IT Consulting Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration. Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.