Data Engineer

ProArch is looking for a talented Data Engineer to enhance our data processing and management capabilities. In this role, you will design and implement data solutions that support various business needs, ensuring data is accessible, accurate, and available for analysis. You will work closely with data scientists, analysts, and other stakeholders to gather requirements and deliver effective data solutions. If you have a passion for data and are eager to join a dynamic team, we want to hear from you! Key Responsibilities: • Architect and implement scalable data pipelines to process and integrate structured and unstructured data • Design end-to-end data solutions, including data lakes, warehouses, and marts, to support analytics and operational systems • Collaborate with stakeholders to translate business requirements into scalable, high-performing data architectures • Develop and enforce data governance standards, ensuring consistency, accuracy, and compliance with regulatory frameworks (e.g., GDPR, HIPAA) • Implement data lineage, metadata management, and auditability practices using tools like Apache Atlas or AWS Glue Data Catalog • Establish and manage data stewardship frameworks to improve data quality and trust across the organization • Partner with analytics, AI/ML, and software engineering teams to ensure seamless data integration and usability • Mentor junior data engineers on best practices in data governance, solution design, and modern engineering techniques • Optimize system performance by designing and implementing data partitioning, indexing, and compression strategies • Ensure data security through access controls, encryption, and secure design practices Requirements • Bachelor's degree in Computer Science, Engineering, or a related field • 8+ years of experience in data engineering, with a strong emphasis on data governance and solution design • Expertise in developing scalable data architectures for enterprise reporting and AI/ML applications • Proficiency in distributed data frameworks like Apache Spark and Flink • Experience with enterprise data modeling (e.g., Erwin, dbt, SQL Data Modeler) and Integration (e.g. POSTMAN, SOAP-UI) tools • Advanced knowledge of data governance tools and frameworks, such as Apache Atlas or Collibra • Strong understanding of cloud platforms and data services, including AWS Redshift, Azure Synapse, and GCP BigQuery • Excellent analytical and troubleshooting skills with attention to detail • Strong communication skills to effectively articulate technical concepts to non-technical stakeholders • Ability to prioritize tasks in a dynamic environment and manage multiple initiatives simultaneously • Certifications in cloud, database, and programming are a plus