Data Engineer

Title: Data Engineer Duration: 2 Month Contract (could extend longer) Location: Remote Must Have: Databricks, Python, SQL, ETL Tooling experience Our client within the Technology Consulting space is looking to bring on a Data Engineer for a 2-month contract to help oversee and deliver on a wide variety of data/AI focused projects centered around their client facing products. Responsibilities: • Support projects leveraging an agile delivery model through requirements gathering and documentation, data ingestion pipeline development, and technical testing. • Coordinate activities with data source application owners to understand the underlying data, ensure integration and data integrity • Contribute to project delivery in the following ways: • Gather technical requirements and develop solutions with collaboration across the DE&A team • Add configurations for data enrichments such as lookups, type conversions, calculations, and concatenations • Add data quality rules • Connect to new data sources • Map multiple sources into a single output • Interpret error messages to troubleshoot data pipelines • Create outputs that facilitate reporting, dashboarding, and semantic modeling for tools such as Tableau and Power BI • Test data pipelines to ensure accuracy Qualifications: • 5+ years of hands-on professional development experience, consulting experience preferred. • 3+ years of experience working with DataBricks • Experience writing complex SQL queries related to data manipulation strategies • Experience building or working with metadata-driven ETL / ELT patterns and concepts. • Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and/or Lambda. • Exposure using ETL tools such as Azure Data Factory, AWS Glue, Informatica, Talend, IBM DataStage, etc. • Experience in technical testing, issue identification and resolution • Experience with AWS a plus