AI Data Engineer

Job Title: AI Data Engineer 1 Location: Remote Daily Schedule & OT estimate: Mon to Fri – 40Hrs/week Top Skills & 2+ years of experience for each: Data Engineering background that includes: • Python • SQL • Kubernetes • Airflow • Scala Explain a typical day in the role: As a Software engineer - Data, candidate will be responsible for designing, developing, and maintaining efficient and reliable data pipelines. The candidate will work closely with stakeholders across the company to gather business requirements, build data models, and ensure data quality and accessibility. Expertise in Python, SQL, Airflow, and Spark will be crucial in optimizing our data infrastructure and enabling data-driven decision-making. Key Responsibilities: • Data Platform: Design, build, and maintain scalable data platform and pipelines using Python, SQL, Airflow, and Spark. • Business Requirements Gathering: Collaborate with stakeholders to understand and translate business requirements into technical specifications. • Data Modeling: Develop and implement data models that support analytics and reporting needs. • Data Quality and Governance: Ensure data accuracy, consistency, and reliability by implementing robust data validation and quality checks. • Stakeholder Collaboration: Work with cross-functional teams, including data analysts, data scientists, and business leaders, to deliver high-quality data solutions. • Performance Optimization: Continuously monitor and optimize data pipelines for performance, scalability, and cost-efficiency. • Monitoring and Observability: Build and implement monitoring and observability metrics to ensure data quality and detect anomalies in data pipelines. • Documentation and Communication: Maintain clear and comprehensive documentation of data processes and communicate technical concepts effectively to non-technical stakeholders. Qualifications: • Experience: 2 years of experience in a data engineering and infrastructure. • Technical Skills: Proficiency in datawarehouse management, Python, SQL, Airflow, and Spark. • Data Pipeline Expertise: Strong experience in building and maintaining robust data pipelines and ETL processes. • Analytical Skills: Ability to gather business requirements, debug issues for ingestion or any other areas of the data warehouse. • Communication: Excellent verbal and written communication skills, with the ability to convey technical information to non-technical audiences. • Collaboration: Proven ability to work effectively in a collaborative, cross-functional environment. • Education: Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field. Preferred Qualifications: • Experience with cloud platforms such as AWS, GCP, or Azure. • Familiarity with data warehousing technology (e.g., Deltalake, Azure Fabric, Snowflake, Redshift, BigQuery). • Knowledge of data governance and data security best practices. Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals. Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more. Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.