Cloud Data Engineer (AWS / PySpark / Serverless)

Select "APPLY" If you're interested in learning more about this position or email your resume directly to MCasey@calance.com ============================================= • • • We will NOT work with C2C/3rd Party Agencies for any reason • • • ============================================= • • We will NOT consider NON-LOCAL Candidates, even if your willing to relocate. You MUST BE LOCAL. • • JOB DETAILS: Position: Senior Cloud Data Engineer (AWS / PySpark / Serverless) JOB REF#: 43883 Duration: 12+ Months (On-Going Contract) Location: HYBRID - Torrance, CA 90501 Pay Rate: $70.00 - $74.00 per hour (W2 Only) HYBRID: Must be able to work ONSITE 4 days a week (LOCAL CANDIDATE ONLY) RESPONSIBILITIES INCLUDE: • Design, develop, and maintain robust ETL/ELT pipelines using AWS Glue for large-scale data processing • Build serverless applications and microservices using AWS Lambda for real-time and batch data processing • Implement data transformation logic using PySpark for distributed computing on large datasets • Develop and optimize SQL queries for data extraction, transformation, and loading processes • Implement Infrastructure as Code (IaC) using AWS CloudFormation, CDK, or Terraform • Design event-driven architectures using AWS services, such as EventBridge, SQS, and SNS • Develop RESTful APIs and web services using Node.js for data access and integration • Mentor junior developers and provide technical guidance to the team • Collaborate with data scientists, analysts, and stakeholders to understand requirements • Participate in code reviews and maintain high coding standards • Document technical designs, processes, and best practices • Develop and maintain web applications using Node.js, Java, and Python. Design and implement RESTful APIs and microservices. Experience with AWS services (EC2, S3, Lambda, RDS, etc.). • Write clean, maintainable, and efficient code while adhering to best practices. Troubleshoot and debug applications to ensure optimal performance. • Participate in code reviews and contribute to team knowledge sharing. Proficiency in Node.js, Java, and Python. REQUIRED EXPERIENCE/SKILLS: • • MUST BE ABLE TO INTERVIEW ONSITE • • LOCAL CANDIDATES ONLY • • W2 Hrly • 5+ years relevant experience with 3+ years in Cloud environments • Strong proficiency in Python with extensive experience in PySpark for big data processing • Hands-on experience with AWS Glue for ETL pipeline development and management • Proven expertise in AWS Lambda for serverless application development • Solid understanding of Node.js for API development and backend services • Experience with SQL and NoSQL databases (PostgreSQL, MySQL, MongoDB, DynamoDB) • Proficiency in AWS services including S3, IAM, CloudWatch, and VPC • Experience with CI/CD pipelines and DevOps practices • Understanding of Infrastructure as Code tools (CloudFormation, CDK, Terraform) • Familiarity with version control systems (Git) and agile development methodologies • Strong understanding of data warehousing concepts and dimensional modeling • Experience with data formats (JSON, Parquet, Avro, ORC) and data serialization • Understanding of data security, privacy, and compliance requirements • Strong understanding of front-end technologies (HTML, CSS, JavaScript, frameworks like React or Angular). ----------------------------------------- ----------------------------------------- Calance Consultant Benefits Offerings: - EPO/PPO Medical Plans - HMO/PPO Dental programs - Vision - VSP (Vision Plan Summary) - 401K Retirement vesting program (VOYA) - Paid Bi-Weekly/Direct Deposit - Flex Spending Plan - Voluntary Life, AD&D, STD or LTD plans