Big Data Developer

Job Location: Denver, CO or Chicago, IL (5 days onsite) Key Responsibilities • Design, build, and support near-real-time and batch data pipelines • Develop and optimize large-scale distributed data processing systems • Work closely with cross-functional teams in an Agile environment • Troubleshoot, tune, and enhance performance of Spark, MapReduce, and SQL workloads • Partner with stakeholders to understand requirements and deliver effective data solutions Required Skills & Experience Data & Big Data Technologies • Strong SQL skills (one or more of MySQL, Hive, Impala, Spark SQL) • Experience with Hadoop/Big Data ecosystems and distributed systems • Hands-on experience with Spark (including Structured Streaming), Sqoop, Kafka, MapReduce • Experience with NoSQL technologies such as HBase, Solr • Exposure to Cloudera (CDP/HDP), ElasticSearch, Kibana Data Ingestion & Integration • Experience ingesting data from message queues, file shares, REST APIs, and relational databases • Familiarity with data formats such as JSON, CSV, XML Programming & DevOps • Hands-on programming experience in Scala, Python, Shell scripting (PHP a plus) • Performance tuning experience for Spark, MapReduce, and SQL jobs • Strong proficiency with Linux • Experience with source control (Git, SVN, Bitbucket) • Working knowledge of Jenkins and JAR/package management • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • More about Dexian • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals. Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more. Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status. Dexian | Unlock trajectory changing opportunities. Unlock business potential with Dexian's comprehensive solutions. Discover staffing, talent development, and valuable resources. Explore now!