Data Pipeline Engineer

Job Title: Data Pipeline Engineer (Python, Privacy & Data Processing) Location: Remote (PST Hours) Duration: 6 Months Contract (Possible Extension) Looking for a W2 candidate. About the Role We are seeking a detail-oriented Data Pipeline Engineer to design, build, and maintain scalable data processing pipelines. In this role, you will transform raw, multi-format datasets (text, code, documents, structured exports) into clean, structured, and privacy-compliant data for downstream research and analysis. Key Responsibilities • Build and maintain data pipelines for ingestion, processing, and transformation • Normalise and structure data from diverse formats (JSON, NDJSON, HTML/XML, archives) • Ensure high data quality through validation, QA checks, and continuous improvements • Implement privacy safeguards, including PII detection and anonymisation • Collaborate with internal teams to identify issues, iterate, and improve pipeline performance • Develop tools for data monitoring, auditing, and exploration • Manage data storage, access controls, and pipeline reliability Required Skills & Experience • 4+ years of experience in software engineering or data engineering • Strong proficiency in Python • Hands-on experience building and scaling data pipelines (ETL/ELT) • Experience working with semi-structured or unstructured data • Understanding of data privacy, PII handling, and anonymisation techniques • Familiarity with cloud platforms (AWS/GCP) and storage systems (S3, IAM) • Strong attention to detail and problem-solving skills