Senior Data Engineer

A globally recognized professional services firm serving clients across the financial services sector.

The client operates an internal development center, a product-focused engineering unit embedded within the firm, responsible for building and delivering proprietary software across four core service lines. The unit runs approximately 50 active projects across five product verticals, built on an Azure-based technology stack.

We are looking for a Data Engineer with strong experience in Microsoft Fabric and modern Azure data platforms. The role will focus on designing, building, and maintaining scalable data pipelines, lakehouse solutions, and analytics-ready data products using Microsoft Fabric as the primary platform. The ideal candidate has strong hands-on experience with data engineering, Medallion architecture, Azure integration services, SQL, Python, and CI/CD practices using GitHub Actions.

The candidate will join Brightgrove's embedded team, working alongside existing placements including Product Owners, Engineering Leads, and specialists across the client's product verticals. On the client side, they will report to the Technology Solutions Lead and collaborate daily with Product Owners, Engineering Leads and development teams across verticals.
The client's development center is organized around three pillars: Product Management, Technology & Engineering and Digital Operations, and this role sits firmly within the Technology & Engineering pillar.

• Interview process that respects people and their time
• Professional and open IT community
• Internal meet-ups and resources for knowledge sharing
• Time for recovery and relaxation
• Bright online and offline events
• Opportunity to become part of our internal volunteer community

• Design, build, and maintain data pipelines using Microsoft Fabric as the primary data platform.
• Develop scalable Lakehouse and Warehouse solutions within Microsoft Fabric.
• Implement Medallion architecture using Bronze, Silver, and Gold layers for ingestion, transformation, governance, and consumption.
• Build and maintain batch and event-driven data processing workflows.
• Integrate data from multiple internal and external systems into Fabric.
• Work with Azure messaging and integration services, especially Azure Service Bus, Kafka and Azure Event Hubs.
• Develop transformation logic using SQL, Python, notebooks, and Fabric-native capabilities.
• Support semantic models, reporting layers, and Power BI integration.
• Implement data quality checks, validation rules, monitoring, and operational controls.
• Collaborate with business stakeholders, analysts, architects, and engineering teams to deliver reliable data products.
• Support CI/CD processes for data solutions using GitHub Actions.
• Ensure data solutions follow security, governance, and access control standards.

• Strong hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Data Factory pipelines, notebooks, semantic models, and Power BI integration.
• Strong understanding of Medallion architecture and modern lakehouse design patterns.
• Experience designing and implementing scalable data pipelines.
• Strong SQL skills for querying, transformation, validation, and optimization.
• Strong Python skills for data engineering, automation, and pipeline development.
• Experience with Azure data and integration services.
• Experience with Azure Service Bus; exposure to Kafka and Azure Event Hubs is also valuable.
• Experience working with structured, semi-structured, and unstructured data.
• Good understanding of data governance, security, access control, and enterprise data management.
• Experience implementing data quality, monitoring, logging, and error-handling practices.
• Experience with CI/CD practices, especially using GitHub Actions.
• Ability to translate business requirements into robust technical data solutions.
• Strong communication skills and ability to work with both technical and non-technical stakeholders.

Nice To Have

• PostgreSQL experience.
• Experience with additional Azure cloud services.
• Experience designing Power BI semantic models or enterprise reporting solutions.
• Familiarity with data cataloging, lineage, and governance tooling.