Software Delivery Manager - AI Metrics & Performance
CV-LibraryCity of London, LondonpermanentPosted: 5 May 2026
Apply NowJoin an award-winning, internationally recognised organisation at the forefront of Generative AI, delivering next-generation B2B intelligence products. This is an opportunity for a delivery-focused leader with strong data and analytical capability to drive execution and performance visibility across a growing AI product suite.
As a Software Delivery Manager, you will own the end-to-end delivery of AI-driven software initiatives, ensuring releases are executed smoothly, on time, and with clear, data-backed performance insights. You will operate at the intersection of delivery, data analysis, and AI model performance - turning complex evaluation metrics into actionable delivery decisions and executive-level reporting.
Reporting to the Director of Generative AI, you will play a key role in coordinating delivery across software engineering, data science, and product teams, while building the dashboards and metrics frameworks that underpin release confidence and strategic decision-making
Key Responsibilities
Lead the end-to-end delivery lifecycle for AI products and software releases, from planning through to deployment and iteration
Own delivery planning, release cycles, dependencies, and cross-functional coordination across engineering, data science, product, and operations
Drive delivery execution at pace, proactively managing risks, sequencing work, and ensuring alignment to strategic milestones
Develop and maintain dashboard reporting (e.g., Power BI/ SQL ) to track delivery progress and AI model performance
Analyse and interpret AI evaluation metrics (e.g., latency, robustness, retrieval performance, hallucination rates, drift) to assess release readiness
Translate complex performance data into clear, structured insights and stakeholder reporting
Establish and track KPIs, thresholds, and performance indicators to support evidence-based delivery decisions
Provide ongoing delivery risk analysis, escalating issues and performance concerns to senior stakeholders
Support QA and evaluation processes by ensuring performance, reliability, and quality standards are met and reflected in release decisions
Contribute to a data-driven delivery culture, where metrics and dashboards are central to planning and executionRequired Experience
Proven experience in a Software Delivery Manager (or similar) role, with ownership of end-to-end delivery in engineering-led environments
Strong track record of coordinating complex delivery programmes, managing dependencies, risks, and release cycles
Advanced data analysis capability, including experience with SQL, BI tools (e.g., Power BI), and performance reporting
Experience building or maintaining dashboards and metric frameworks to support delivery and product decisions
Ability to interpret technical or AI-related performance metrics and translate them into actionable insights
Experience working closely with cross-functional teams including engineering, data science, and productThis is a hands-on delivery role, not a people management position. The emphasis is on driving execution, ensuring alignment, and enabling data-informed decision-making across the AI product lifecycle. While the role includes oversight of QA and testing activities, the primary focus is on delivery ownership and performance insight ensuring that AI model evaluation metrics and system performance data are clearly understood, accurately reported, and effectively used to guide release decisions.
This is a high-impact opportunity to shape how delivery, performance metrics, and AI evaluation are integrated within a fast-scaling organisation. You will work closely with senior leaders to define how data-driven insights inform delivery strategy, with significant visibility and ownership in a business investing heavily in AI innovation.
INDAM
The Portfolio Group are acting on behalf of our client in recruiting for this position
As a Software Delivery Manager, you will own the end-to-end delivery of AI-driven software initiatives, ensuring releases are executed smoothly, on time, and with clear, data-backed performance insights. You will operate at the intersection of delivery, data analysis, and AI model performance - turning complex evaluation metrics into actionable delivery decisions and executive-level reporting.
Reporting to the Director of Generative AI, you will play a key role in coordinating delivery across software engineering, data science, and product teams, while building the dashboards and metrics frameworks that underpin release confidence and strategic decision-making
Key Responsibilities
Lead the end-to-end delivery lifecycle for AI products and software releases, from planning through to deployment and iteration
Own delivery planning, release cycles, dependencies, and cross-functional coordination across engineering, data science, product, and operations
Drive delivery execution at pace, proactively managing risks, sequencing work, and ensuring alignment to strategic milestones
Develop and maintain dashboard reporting (e.g., Power BI/ SQL ) to track delivery progress and AI model performance
Analyse and interpret AI evaluation metrics (e.g., latency, robustness, retrieval performance, hallucination rates, drift) to assess release readiness
Translate complex performance data into clear, structured insights and stakeholder reporting
Establish and track KPIs, thresholds, and performance indicators to support evidence-based delivery decisions
Provide ongoing delivery risk analysis, escalating issues and performance concerns to senior stakeholders
Support QA and evaluation processes by ensuring performance, reliability, and quality standards are met and reflected in release decisions
Contribute to a data-driven delivery culture, where metrics and dashboards are central to planning and executionRequired Experience
Proven experience in a Software Delivery Manager (or similar) role, with ownership of end-to-end delivery in engineering-led environments
Strong track record of coordinating complex delivery programmes, managing dependencies, risks, and release cycles
Advanced data analysis capability, including experience with SQL, BI tools (e.g., Power BI), and performance reporting
Experience building or maintaining dashboards and metric frameworks to support delivery and product decisions
Ability to interpret technical or AI-related performance metrics and translate them into actionable insights
Experience working closely with cross-functional teams including engineering, data science, and productThis is a hands-on delivery role, not a people management position. The emphasis is on driving execution, ensuring alignment, and enabling data-informed decision-making across the AI product lifecycle. While the role includes oversight of QA and testing activities, the primary focus is on delivery ownership and performance insight ensuring that AI model evaluation metrics and system performance data are clearly understood, accurately reported, and effectively used to guide release decisions.
This is a high-impact opportunity to shape how delivery, performance metrics, and AI evaluation are integrated within a fast-scaling organisation. You will work closely with senior leaders to define how data-driven insights inform delivery strategy, with significant visibility and ownership in a business investing heavily in AI innovation.
INDAM
The Portfolio Group are acting on behalf of our client in recruiting for this position