Role: Senior Data Engineer
Contract Length: 6 months
Location: Manchester or London - hybrid
IR35: Inside
Pay Rate to Intermediary: Up to £650 per day
Spinwell is recruiting for a Senior Data Engineer for an excellent opportunity within the private sector.
RESPONSIBILITIES OF THE SENIOR DATA ENGINEER
- Design, develop, and deliver solutions from our increasing backlog using Azure Data Factory, Azure SQL, Azure API Management, Logic Apps, Function Apps, C#, and Copilot-assisted development.
- Build and maintain scalable, resilient data pipelines and integration workflows to support analytics, operational systems, and APIs.
- Implement and manage APIs using Azure API Management, including policies, security, and lifecycle management.
- Develop serverless solutions with Azure Functions (C# preferred) and Logic Apps to orchestrate business processes and integrations.
- Apply solution and data/architecture design best practices to ensure performant, secure, and maintainable data and integration solutions.
- Incorporate Copilot and AI-assisted development tools into daily engineering practice to accelerate solution creation, improve code quality, and enhance test coverage and documentation.
- Lead the definition and continuous improvement of environment strategy, governance, and Application Lifecycle Management (ALM) processes for data and integration assets.
- Design and implement DevOps pipelines for build, test, and deployment of data and integration jobs, APIs, and infrastructure-as-code where appropriate.
- Replace legacy and manual processes with automated, auditable, cloud-based workflows and integrations.
- Work alongside Data Engineers, BI Developers, and Application teams to integrate solutions with data warehouses/lakes, Dataverse, Azure SQL, APIs, and other enterprise systems.
- Optimise data and integration performance, reliability, and cost, while ensuring compliance with data protection and security standards.
- Establish and maintain monitoring, alerting, and logging for data pipelines, APIs, and serverless components to support robust operations and incident response.
- Stay current with Azure data and integration advancements, DevOps practices, Copilot/AI capabilities, and industry best practices, sharing knowledge with the wider team.
SKILLS/EXPERIENCE OF THE SENIOR DATA ENGINEER
- University/Post Graduate (Masters Degree).
- Intermediate/Advanced certification in Azure Data / Integration / Developer disciplines (e.g. Azure Data Engineer, Azure Developer, Integration or Architect-level certifications).
- Proven experience delivering Azure-based data and integration solutions, including Azure Data Factory, Azure SQL, Azure API Management, Logic Apps, and Function Apps.
- Advanced SQL skills, including complex joins, window functions, performance tuning, and working with large datasets.
- Strong data engineering and integration design skills, including ETL/ELT patterns, orchestration, error handling, and idempotent processing.
- Proficiency in C# for building Azure Functions, integration logic, and supporting libraries/services.
- Experience with Azure Data Factory for designing and managing pipelines, data flows, triggers, and integration with other Azure services.
- Expertise in Azure API Management, including API design, security (OAuth, keys, certificates), policies, and lifecycle management.
- Hands-on experience designing and implementing Logic Apps and Function Apps for event-driven and workflow-based integrations.
- Experience implementing and maintaining DevOps pipelines (e.g. Azure DevOps/GitHub Actions) for CI/CD of data and integration components.
- Strong understanding of security and compliance best practices, including authentication/authorisation, network security, secret management (Key Vault), and data protection.
- Proven ability to optimise performance and troubleshoot complex issues across data pipelines, APIs, and serverless workloads.
- Strong testing, troubleshooting, and debugging skills (including unit tests, integration tests, and non-functional testing where appropriate).
- Demonstrated ability to work independently on complex projects, make sound technical decisions, and mentor others in engineering best practices.
- Demonstrated experience using or rapidly adopting Copilot and AI-assisted development tools to improve productivity, quality, and documentation.
- Demonstrated ability to collaborate with stakeholders and mentor colleagues to build wider data and integration capability within the team.
- Familiarity with Agile frameworks (SAFe 6.0 preferred, others considered).
- Knowledge of ITIL v4 (or v3) practices for service management.
- Azure certification and hands-on experience with a broad set of Azure services relevant to data engineering and integration (e.g. Data Factory, Synapse, Storage, Key Vault, Monitor).
- Awareness of DevOps practices, including CI/CD pipelines, branching strategies, code review, and backlog management.
- Understanding of cloud platforms beyond Microsoft, such as AWS, and hybrid integration scenarios (desirable).
- Experience applying software engineering principles (version control, code review, automated testing, coding standards).
- Excellent time management and prioritisation across multiple concurrent projects.
- Commitment to continuous learning and staying current with emerging Azure, DevOps, Copilot/AI, and data engineering advancements.
- Experience in utilities or telecoms sectors, or other complex, regulated industries (desirable).
If you are a Senior Data Engineer, apply now or send your CV to Spinwell!
We welcome all applications regardless of background, in line with our commitment to diversity, equality and inclusion.
Applying to this or any other vacancy advertised by Spinwell Ltd constitutes an agreement for Spinwell Ltd to hold your details for 24 months for the purpose of assessing suitability for the advertised position and to make you aware of any other positions deemed suitable of which You will make you aware by means of either email, text or phone. In line with GDPR regulations you are able to request your details be removed from the company data at any time by emailing us