Data Engineer

BCforward is currently seeking a highly motivated Data Engineer - Remote Job Title: Data Engineer Location: Remote Duration: Contract – 12+ Months Job Description We are seeking a skilled Data Engineer to join our team. The ideal candidate will have strong experience in SQL, Python, cloud data platforms (GCP and Azure), and data pipeline development. This role requires the ability to design, build, and optimize scalable data architectures and workflows that support business needs. Key Responsibilities • Assemble large, complex datasets that meet both functional and non-functional requirements. • Build and maintain batch and near real-time data pipelines for ingestion, cleansing, transformation, and curation of structured and unstructured data. • Design, expand, and optimize data architectures and data flows across cross-functional teams. • Write, troubleshoot, and optimize SQL queries for data mining, analysis, and data product development. • Perform complex data analysis to interpret results and provide actionable recommendations. • Apply data modeling techniques and optimize performance in cloud data warehouses, including partitioning and clustering. • Support ETL and ELT processes, including validation and testing to ensure data accuracy and quality. • Implement processes for data transformation, metadata management, dependency tracking, and workload management. • Develop and maintain monitoring, logging, and alerting systems for data pipelines and platforms. • Use Infrastructure as Code tools such as Terraform for cloud provisioning and configuration. • Configure and support cloud services for data ingestion, integration, messaging, CI/CD, and processing across GCP and Azure platforms, including Microsoft Fabric. • Support the setup and optimization of operational databases or data-serving layers based on business use cases. • Collaborate with engineers, analysts, and product teams in an agile, product-focused environment. • Conduct data quality reviews and drive continuous improvement initiatives. Required Skills & Qualifications • Strong proficiency in SQL and Python for data transformation and analysis. • Hands-on experience with Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage) and Microsoft Azure, including Microsoft Fabric. • Experience building batch and streaming data pipelines and applying data modeling concepts. • Experience with Infrastructure as Code tools, preferably Terraform. • Ability to profile, validate, and improve data quality using data exploration and profiling techniques. • Strong analytical and problem-solving skills, including root cause analysis. • Excellent time management skills with the ability to manage multiple priorities. • Experience collaborating with cross-functional teams including developers, analysts, and data scientists. Preferred Skills • Familiarity with CI/CD practices for data workflows. • Experience with data quality tools and data cataloging solutions. Education • Bachelor’s degree in Computer Science, Engineering, or a related field, • OR • Associate’s degree with at least 2 years of relevant experience.