Verified Job On Employer Career Site Job Summary: Apex Systems is a world-class IT services company that serves thousands of clients across the globe. They are seeking a Data Engineer to design and deploy data-centric architecture on Google Cloud Platform for their Materials Management Platform, which is part of a larger IT transformation effort. The role involves building ETL pipelines, optimizing data workflows, and collaborating with stakeholders to ensure data requirements align with business objectives. Responsibilities: • Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs. • Build ETL pipelines to ingest the data from heterogeneous sources into our system • Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data • Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets • Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements • Optimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure. • Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments. • Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failures • Troubleshoot and resolve issues related to data processing, storage, and retrieval. • Promptly address code quality issues using SonarQube, Checkmarx, Fossa, and Cycode throughout the development lifecycle • Implement security measures and data governance policies to ensure the integrity and confidentiality of data • Collaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives. • Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance. • Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems. • Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment. Qualifications: Required: • Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs. • Build ETL pipelines to ingest the data from heterogeneous sources into our system • Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data • Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets • Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements • Optimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure. • Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments. • Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failures • Troubleshoot and resolve issues related to data processing, storage, and retrieval. • Promptly address code quality issues using SonarQube, Checkmarx, Fossa, and Cycode throughout the development lifecycle • Implement security measures and data governance policies to ensure the integrity and confidentiality of data • Collaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives. • Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance. • Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems. • Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment. • Requires a bachelor’s or foreign equivalent degree in computer science, information technology or a technology related field Company: Apex Systems, a division of On Assignment, provides organizations with IT staffing solutions to address gaps in their current workforce. Founded in 1995, the company is headquartered in Richmond, Virginia, USA, with a team of 1001-5000 employees. The company is currently Late Stage. Apex Systems has a track record of offering H1B sponsorships.