PySpark Developer

Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction. Amazing things happen when we work in environments where everyone feels a true sense of belonging and when candidates have the requisite skills and opportunities to succeed. At Droisys, we invest in our talent and support career growth, and we are always on the lookout for amazing talent who can contribute to our growth by delivering top results for our clients. Join us to challenge yourself and accomplish work that matters. Job Title- PySpark Developer Job Location - Charlotte, NC Pay Rate - $50-60/hr Must Have PySpark, Big Data, Python, Spark, Hadoop, ETL, AWS Job Description Job Description • Experience with big date processing and distributed computing systems like Spark, PySpark. • Implement ETL pipelines and data transformation processes. • Ensure data quality and integrity in all data processing workflows. • Understand sources, dependencies and data flow from coverted PySpark code. • Strong programming skills in Python and SQL. • Experience with big data technologies like Hadoop, Hive, Kafka. • Understanding of data warehousing concepts and relational databases like SQL. • Demonstrate and document code lineage. • Integrate PySpark code with frameworks such as ingestion framework etc. • Ensure compliance with data security, privacy regulations and organizational standards. • Knowledge of CI/CD pipelines and DevOps practices. • Excellent communication and leadership skills. Qualification • 4+ years of experience in big data development, Hadoop, hive and spark framework. • Good to have experience in SAS. • Strong python, PySpark Development and SQL knowledge. • Certification in big data or cloud technologies is preferred. • Excellent communication, collaboration and problem-solving skills. Droisys is an equal opportunity employer. We do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Droisys believes in diversity, inclusion, and belonging, and we are committed to fostering a diverse work environment