Big Data Developer

Job Title: Big Data Engineer / Spark Scala Developer (Ex- Apple candidate is preferred only) Location: Sunnyvale, CA or Austin, TX Duration: 6 Months (Contract) Job Overview: We are seeking a skilled Big Data Engineer with strong experience in Spark and Scala to join our team in Sunnyvale, CA or Austin, TX. The ideal candidate will be responsible for developing scalable data solutions, integrating systems, optimizing data pipelines, and supporting both technical and functional project needs. This role requires close collaboration with business and technical stakeholders to deliver high-performance data processing systems. Responsibilities: 🔧 Technical Responsibilities: • Develop and implement scalable data solutions using Spark, Scala, and Hadoop. • Manage system integrations and optimize data pipelines for performance and scalability. • Provide technical support and troubleshoot issues in data processing environments. 📈 Functional Responsibilities: • Gather and analyze business requirements and translate them into functional specifications. • Streamline and improve business processes through effective system design. • Conduct system and user acceptance testing (UAT). • Deliver end-user training and create relevant documentation. • Collaborate with business stakeholders and development teams to ensure solution alignment. Required Skills & Qualifications: 🛠 Technical Skills: • Strong hands-on experience with Spark and Scala • Advanced knowledge of SQL (basic and complex queries) • Proficient in Apache Kafka and Cassandra • Experience with Spark Streaming for real-time processing • Good knowledge of Python and Unix shell scripting • Familiarity with Big Data ecosystems including Hadoop • AWS experience is a plus 👥 Functional Skills: • Proven ability in business process mapping and functional requirements gathering • Experience in creating functional specification documents • Strong communication, interpersonal, and problem-solving skills • Knowledge of Agile methodologies and practices