Senior Data Engineer

Work Location Hybrid, 3 days onsite & 2 days remote Office Location: 1900 Aldrich St Austin, TX 78723 Candidates must be local to Austin, TX or surrounding areas. • • Job Description We are currently seeking a contract Senior Data Engineer to be a key resource on a technical services team for our client, the Teacher Retirement Systems of Texas (TRS). Responsibilities Client is seeking a hands-on Senior Data Engineer with extensive experience (Hands on) in Azure data services and Databricks. Responsibilities: • Design and implement data solutions using Azure services (e.g., Synapse Analytics, Databricks, Snowflake, Azure SQL, Azure Blob Storage, ADLS Gen2, Azure Functions, Azure Key Vault, AI/ML). • Develop data pipelines and transformations (ETL/ELT). • Collaborate with stakeholders to understand data requirements and deliver solutions. • Ensure data solutions are scalable, reliable, and secure. • Implement CI/CD and DevOps practices. • Maintain and publish code to GitHub. • Follow PMO/Scrum master instructions using Agile/Scrum methodologies. Qualifications Minimum (Required): • 10+ years of: IT experience, including a minimum of 5 years as a Data Engineer. • 5+ years of: Experience with the Azure cloud platform. • Proven experience with Azure data services (e.g., Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions). • Experience with Databricks, Microsoft Fabric, Power Automate, Power BI and SQL. • Proficiency in Python, SQL, API, and PySpark. • Expertise in optimizing ETL processes, data warehouse, and data lake management. • Experience with CI/CD and DevOps practices. • Experience with structured, unstructured, and semi-structured data. • Experience with maintaining and publishing code to GitHub. • Ability to work in a cross-functional team and coordinate with Infra/Ops and Information Security departments. • Experience with requirement gathering and Scrum methodologies Preferred (Optional): • Experience with on premises to Azure cloud migration. • Knowledge of Snowflake, Microsoft Fabric, Microsoft Purview, AI/ML, streaming data services, and marketplace data services. • Relevant certifications. • Experience with multiple cloud implementations. Company Overview Allied Consultants has been contracted with the Texas State Government for 34 years, we are a Top Ten ranked vendor, and premier provider of technical and business staffing solutions. Allied Consultants offers its family of consultants excellent rates, a local support staff, and an attractive benefits package which includes medical insurance (Allied shares a percentage of the cost), life insurance, a matching 401(k) plan and a cafeteria plan. Candidates selected for interview will be required to undergo criminal background checks and may be required to complete a drug screen in accordance with Federal and State Law. Offers of Employment are contingent on a successful background check. Allied Consultants is an equal opportunities employer.