Lead Data Engineer

Hi , Senior Data Engineer Atlanta, GA (Remote only Local ) 12+ months contract Data Engineer BigData Cloudera Bigquery ETL Python Spark Job Description: The Marketing Services (MS) Technology team is looking for a Senior Data Engineer who is passionate about data and analytics, highly motivated and can take technical ownership of data solutions with an emphasis on engineering efficiency and on-time delivery The ideal candidate is exposed to the fast-paced world of Big Data technology and has experience in building data solutions using new and emerging technologies while maintaining stability of the platform. The person will get a chance to work with diverse datasets and be on the cutting edge of transforming the way Mastercard captures, processes, stores and visualizes data. Role- • Design & Develop batch and streaming solutions using various Big Data technologies • Work closely with architect to design secure and scalable • Be responsible for assessing technologies and approaches for ingestion, transformation and storage • Develop software utilizing open source technologies to interface with distributed and relational data sources • Work closely with team members from across Mastercard to identify functional and system requirements All About you • Hands-on experience with Big Data and analytics technologies including Hadoop, Spark, and related trameworks. • Programming expertise in languages such as Java, Scala, or Python, with an emphasis on developing data processing and transformation logic. • Real-time and batch data processing skills with experience in building robust data pipelines for real-time or near-real-time ingestion. • Proficiency in data modeling and schema design for relational and non-relational databases, supporting high data volume, and optimized query performance. • Exposure to cloud technologies with hands-on experience in Databricks and Cloudera, including knowledge of cloud architecture data security, and scalability best practices • Experience in optimizing and managing ETL workflows using scheduling monitoring, and debugging tools: • Strong problem-solving abilities with a mindset for automation and efficiency improvements. • Excellent communication and collaboration skills to work effectivelv across technical and business teams, facilitating knowledge sharing and alignment on data engineering best practices. • Proven track record of delivering software projects and wilingness to roll up sleeves to get the job done. • Have excelient oral and written communication Be familiar with Agile/Scrum methodologies • Have the ability to manage multiple priorities simultaneously Have a BS/BA degree in Computer Science, Information Systems or related field Regards, Nitesh Jaiswal | Tekgence Inc Linkedin:- https://www.linkedin.com/in/nitesh-jaiswal-a378b5222/ Direct: 469-421-5604 , Ext- 218 • nitesh.j@tekgence.com 6655 Deseo Dr, Suite 104,Irving, TX , 75039 • www.tekgence.com