Senior Big Data Engineer

Net2Source is a Global Workforce Solutions Company headquartered at NJ, USA with its branch offices in Asia Pacific Region. We are one of the fastest growing IT Consulting company across the USA and we are hiring "Senior Big Data Engineer" for one of our clients. We offer a wide gamut of consulting solutions customized to our 450+ clients ranging from Fortune 500/1000 to Start-ups across various verticals like Technology, Financial Services, Healthcare, Life Sciences, Oil & Gas, Energy, Retail, Telecom, Utilities, Technology, Manufacturing, the Internet, and Engineering. Position: Senior Big Data Engineer Location: Remote ( East Coast Only) Type: Contract Note: Need Strong exp on Scala/Java along with Python & SQL Data Engineer Owns the data pipelines that move data from operational source systems onto the data platform extraction, ingestion, transformation, orchestration, and the day-to-day operational health of those pipelines. Also plays a role as a hands-on builder of Foundational Data Products (raw record-of-truth) and potentially Derivative Data Products (composed from upstream products). Core skills SQL & Python (table stakes); Scala/Java for high-throughput streaming Pipeline build & operations: design, develop, deploy, monitor, and remediate batch and streaming pipelines that land source data on the platform; manage backfills, replays, late-arriving data, schema drift, and SLA breaches Ingestion patterns: full-load, incremental, change-data-capture (Debezium, Fivetran, Qlik Replicate, GoldenGate), event-driven ingest, API and file-based intake Pipeline frameworks: dbt, Apache Spark, Apache Beam, Airflow, Dagster, Prefect Streaming: Kafka, Kinesis, Flink, Spark Structured Streaming Data product packaging: schema contracts (Avro/Protobuf/JSON Schema), versioning, SLAS/SLOs, data contracts, output-port design (SQL, file, API, event) Storage formats: loeberg, Delta Lake, Hudi (open table formats are now the mesh default) Quality & observability: Great Expectations, Soda, Monte Carlo, dbt tests, data lineage (OpenLineage) CI/CD for data: GitOps pipelines, unit + integration tests, environment promotion Al-adjacent vector store ingestion (pgvector, Pinecone), feature stores (Feast, Tecton), RAG-ready chunking and embedding pipelines Mesh-specific: knowing when to build a derivative product vs. extending an existing one; consuming upstream products through governed input ports rather than reaching into source systems Why Work With Us? We believe in more than just jobs—we build careers. At Net2Source, we champion leadership at all levels, celebrate diverse perspectives, and empower you to make an impact. Think work-life balance, professional growth, and a collaborative culture where your ideas matter. Our Commitment to Inclusion & Equity Net2Source is an equal opportunity employer, dedicated to fostering a workplace where diverse talents and perspectives are valued. We make all employment decisions based on merit, ensuring a culture of respect, fairness, and opportunity for all, regardless of age, gender, ethnicity, disability, or other protected characteristics. Awards & Recognition • America’s Most Honored Businesses (Top 10%) • Fastest-Growing Staffing Firm by Staffing Industry Analysts • INC 5000 List for Eight Consecutive Years • Top 100 by Dallas Business Journal • Spirit of Alliance Award by Agile1 Madhukar Singh Email: madhukar@net2source.com