Data Engineer

Hello Professionals, Our client is looking Data Engineer for Long term project in New York, NY (Onsite) below is the detailed requirements . Job Title: Data Engine erLocation : New York , NY (Onsit e)Duration : Long Te rm Must Have Skil • ls:Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, • SQLCloud Platforms: • AWSData Warehousing & Analytics: Redshift or Snowflake or Big Qu • eryData Integration & ETL: AWS Glue, Aws EMR, Spark, Data Bri • cksCI/CD: AWS Code Pipeline, Jenkins, CloudFormation, Docker, Kuberne tes Job Descript • ion:Bachelor's degree in Computer science or equivalent, with minimum 12+ Years of relevant Experie • nce.Extensive experience utilizing Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Data prep, and Pub/Sub, for data engineering soluti • ons.Proficient in building and managing GCP data pipelines with tools like Cloud Composer and Cloud Dataf • low.Proven ability in developing and deploying applications on Google Kubernetes Engine (G • KE).Strong background in implementing security and compliance on GCP, ensuring data privacy and regulatory adhere • nce.Track record of optimizing cost and resource usage within GCP environme • nts.Skilled in AWS services such as Amazon EMR, Redshift, and Glue for efficient data process • ing.Expertise in architecting scalable, cost-effective solutions on AWS, with proficiency in configuring AWS Lambda for serverless comput • ing.Adept at setting up AWS Kinesis streams to process real-time data, enhancing system responsiveness and data-driven decision-mak • ing.Proficient in leveraging AWS DynamoDB to create scalable, low-latency NoSQL databases for dynamic applicati • ons.Deep expertise in optimizing and managing Amazon Redshift data warehouses to deliver high-performance analytics and business insig • hts.Experienced in integrating AWS services into CI/CD pipelines, streamlining automation for continuous integration, delivery, and deploym • ent.Skilled in setting up and securing AWS Virtual Private Cloud (VPC) environme • nts.Proficient in managing Azure virtual machines (VMs) for cloud infrastructure operati • ons.Extensive experience managing on-premises data infrastructure, including data warehouses and databa • ses.Familiar with AWS DevOps practices for continuous integration and deploym • ent.Expertise in using Git for version control in DBT projects, ensuring proper tracking and documentation of data model chan • ges.Skilled in performance optimization and tuning of on-premises data syst • ems.Proficient in data migration strategies between on-premises and cloud environme • nts.Strong troubleshooting skills in resolving issues within on-premises data syst • ems.Proven ability to maintain high availability and disaster recovery solutions in on-premises environme • nts.Experienced in implementing CI/CD pipelines using tools like Jenkins and GitLab CI • /CD.Adept in automated testing processes, including unit, integration, and regression test • ing.Skilled in gathering and analyzing project requirements to ensure alignment with business go • als.Experienced in Agile project management, contributing to successful outcomes through data-driven analytics and collaborative team work With Re gards Ruban Raj TLorven Technologies , Inc.101 Morgan Lane | Suite 209 | Plainsboro | NJ 08536Tel: -609-799-4202 • 259 | Fax:609-91 8-4204Email: Ruban@lorventech.com| Web: www.lorvente ch.com