Senior Data Engineer

We currently have a career opportunity for a Senior Data Engineer to join our AI Data Platforms-Data & Analytics-Delivery Team in Boston, MA. The Senior Data Engineer will be driving the design, automation, and scaling of our cloud-native data platform. Job Overview: As a Senior Data Engineer, you’ll work closely with engineering and business leaders to design and build data integration solutions that drive enterprise analytics and decision-making. You’ll leverage cloud technologies, CI/CD pipelines, and Power BI to deliver scalable, high-performance data solutions. The ideal candidate excels in ETL programming, data integration, and data modeling, enabling self-service analytics and ensuring data accessibility, governance, and integrity. You’ll be part of an agile team, participating in Scrum ceremonies and deliver continuous value to stakeholders. Perficient is always looking for the best and brightest talent, and we need you! We’re a quickly growing, global digital consulting leader, and we’re transforming the world’s largest enterprises and biggest brands. You’ll work with the latest technologies, expand your skills, and become a part of our global community of talented, diverse, and knowledgeable colleagues. Responsibilities • As a senior member, collaborate with a small team of data engineers, driving excellence in data platform evolution. Promote a culture of innovation, accountability, and continuous improvement. • Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and SQL Server (T-SQL). • Implement configuration-driven ingestion processes for batch and near real-time data. • Ingest, transform, and integrate data from diverse sources (APIs, JSON, CSV, XLS, etc.) using industry best practices. • Analyze, design, and document data models (ERDs), create data dictionaries and data flow diagrams as part of pipeline development. • Design and implement Lakehouse solutions leveraging Medallion architecture. • Develop and maintain SSRS and Power BI datasets and reports. • Oversee the health, scalability, and security of the Azure-based data platform. • Support and enhance data governance, cataloging, and MDM initiatives. • Ensure data security, privacy, and compliance best practices are followed. • Manage access controls, data lineage, and metadata to support data discoverability and compliance. • Continuously evaluate and improve data engineering processes for efficiency, automation, and reliability. • Develop and maintain CI/CD pipelines using GitHub Actions or CircleCI. • Implement and refine monitoring, alerting, and observability for data pipelines and platform health. • Collaborate with cross-functional teams to identify and eliminate process bottlenecks. • Optimize data pipelines and platform components for performance, scalability, and cost-effectiveness. • Evaluate and implement data quality and observability tools to ensure data reliability and accessibility. • Work closely with the data product manager, program manager, engineering manager, and scrum master to define and deliver data products based on priorities. • Participate in sprint planning, backlog refinement, and Agile ceremonies. • Collaborate with offshore and cross-functional teams to deliver high-quality solutions. • Refine user stories and requirements to ensure clarity and actionability. • Participate in new teammate onboarding, provide guidance and mentorship to junior engineers and facilitate regular feedback sessions, career development planning, and technical upskilling. • Stay current with industry trends, emerging technologies, and best practices in data engineering. Qualifications • 7+ years of professional experience in data engineering and BI, with a focus on Azure technologies. • Deep expertise in SQL Server (2016+), Azure Data Factory, Databricks, and NoSQL databases. • Strong experience in ingesting and integrating data from APIs, JSON, XML, CSV, XLS, and other formats. • Experience with configuration-driven data ingestion and transformation processes. • Strong understanding of Lakehouse architecture, data warehousing concepts, and dimensional modeling. • Experience with Power BI, SSRS, and/or Microsoft Fabric for reporting and analytics. • Hands-on experience with CI/CD tools (ADO/GitHub Actions/CircleCI) and DataOps practices. • Familiarity with data quality, data observability, data governance, cataloging, and MDM tools. • Proficient in Agile methodologies; experience with Scrum ceremonies, sprint planning, and backlog management, burndown metrics, and incremental delivery. • Demonstrated ability to leverage AI tools to enhance productivity, streamline workflows, and support data-informed task execution. • Familiarity with AI-enhanced platforms is a plus. • A solid understanding of AI capabilities and limitations, including ethical considerations, is expected. • Excellent collaboration, communication, and mentoring skills, including working with offshore teams. • Proactive, self-driven, and committed to continuous learning and improvement. • Positive influence on a team of skilled data engineers. • Needs to be on-site 4 days of the week (Boston) Nice to have skills: • Knowledge of the data domain is a plus. • Databricks / Snowflake knowledge is a plus Perficient, Inc. proudly provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws. Perficient, Inc. complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Perficient, Inc. expressly prohibits any form of unlawful employee harassment based on race, color, religion, gender, sexual orientation, national origin, age, genetic information, disability, or covered veterans. Improper interference with the ability of Perficient, Inc. employees to perform their expected job duties is absolutely not tolerated. Applications will be accepted until the position is filled or the posting is removed. The salary range for this position takes into consideration a variety of factors, including but not limited to skill sets, level of experience, applicable office location, training, licensure and certifications, and other business and organizational needs. The new hire salary range displays the minimum and maximum salary targets for this position across all US locations, and the range has not been adjusted for any specific state differentials. It is not typical for a candidate to be hired at or near the top of the range for their role, and compensation decisions are dependent on the unique facts and circumstances regarding each candidate. A reasonable estimate of the current salary range for this position is $64,974 to $149,880,.Please note that the salary range posted reflects the base salary only and does not include benefits or any potential variable compensation programs. Information regarding the benefits available for this position are in our benefits overview.