Dr Umair Ali Khan, 19.12.2024
Even with major advancements in artificial intelligence (AI), many companies find it hard to turn these innovations into real business benefits. A report by Boston Consulting Group (BCG) found that, out of over 1,000 companies surveyed worldwide, only 4% have developed strong AI capabilities across their operations and are consistently seeing significant value. Meanwhile, 74% have not achieved any clear benefits from AI, largely due to issues with people and processes rather than technology itself (BCG, 2024). Similarly, a McKinsey & Company survey indicates that while AI adoption has surged, many organizations remain in the early stages of implementation, often lacking a clear strategy to harness AI’s potential effectively (McKinsey & Company, 2024). Another recent study by Mindtree (Mindtree, 2024) found that although 85% of organizations have a data strategy and 77% have invested in AI-related technologies, only 31% have seen a return on their investment.
In our AI consultancy in the FAIR EDIH project (FAIR n.d), we found that most companies are inspired by the theoretical prospects of AI mentioned in scientific or technical studies. However, they face challenges in identifying and defining the gap between theory and practice. While most of the AI methods look plausible in academic studies, their practical application could be challenging. This gap between AI development and achieving business value indicates that companies often start AI projects without properly considering how they will benefit the business or aligning them with strategic goals, leading to disappointing returns on investment.
As AI becomes more integral to business operations, it is essential for all employees, including decision-makers and managers, to gain a basic understanding of AI concepts. However, many companies view AI adoption as purely a technical task, neglecting the importance of upskilling non-technical staff. This narrow focus often leads to projects driven by AI trends rather than strategic business goals, resulting in a superficial approach that overlooks thorough evaluations of business impact and return on investment (ROI). Consequently, companies also have tendency to concentrate on Proof of Concept (PoC) projects without fully understanding their purpose, mistakenly equating them with assessments of business value.
A PoC is a preliminary implementation designed to verify the technical feasibility and functionality of a proposed solution. In the context of AI, a PoC involves developing a prototype to assess whether an AI solution can effectively address a specific problem. Initiating a PoC is advisable when exploring new ideas that lack prior technical validation.
For instance, if a company considers developing an AI system that can predict patient’s waiting time in a healthcare facility – a concept studied in the literature with varying parameters and performance – a PoC can demonstrate feasibility to stakeholders within a limited timeframe. This approach is particularly useful when there is uncertainty about the implementation’s viability, because this system may depend on several factors including the availability and adequacy of data, analyzing the impact of different combinations of predictors, and other regional aspects.
On the other hand, developing a PoC may be unnecessary if the proposed solution is well-documented and aligns with established industry practices. For example, deploying a chatbot for customer service with a company’s internal documents, a solution widely adopted and technically straightforward, might not require a PoC. In such cases, resources can be directed toward full-scale implementation rather than preliminary validation.
The benefits of conducting a PoC include early identification of potential challenges, allowing for adjustments before significant investments are made. This approach minimizes business risks by enabling the testing of new ideas incrementally, rather than committing to extensive projects without prior validation. Additionally, a successful PoC can attract investors and secure stakeholder support by demonstrating the solution’s potential. It also facilitates resource optimization by uncovering business or process-related issues early, providing an opportunity to address them before full-scale deployment. That said, PoC is more focused on demonstrating the technical feasibility of an idea and does not determine the business value.
According to the Boston Consulting Group (BCG, 2024), companies adopting AI can be grouped into four categories: inactive (25%), experimenters (49%), scalers (22%), and value drivers (4%). Inactive companies have little to no AI activity. Experimenters focus on Proof of Concept (PoC) projects to test the technical feasibility of AI without moving toward full implementation. Scalers expand AI applications to create measurable business value, while value drivers integrate AI as a core part of their operations, consistently delivering significant benefits such as improved productivity, increased revenue, and a competitive edge. Interestingly, over half of the scalers and value drivers are not “born-digital” companies but have advanced their AI capabilities to achieve meaningful results.
While PoCs are a critical step in testing whether an AI solution can work technically, they often fail to address key aspects like scalability, long-term value, or real-world impact. An AI model that performs well in a controlled test environment may not deliver the same results when scaled, leading to issues such as integration challenges and unmet expectations. This is the reason why many companies get stuck at the PoC stage, creating impressive demos and presentations about how AI works, but they fail to turn these efforts into real business results.
To successfully adopt AI, companies must move beyond PoCs and focus on Proof of Value (PoV), which evaluates both technical feasibility and tangible business benefits. PoV ensures that AI projects align with strategic goals and address real-world challenges. This approach shifts the emphasis from simply proving that AI works to demonstrating how it can create measurable value, helping businesses achieve meaningful and sustainable outcomes.
PoV is a process that extends beyond demonstrating technical feasibility to assess the tangible business benefits and ROI of a proposed solution. Unlike PoC, which focuses on validating whether a solution can be implemented, PoV emphasizes evaluating the measurable value the solution can deliver to an organization. This approach involves detailed business use cases to explore why an organization should adopt the PoC solution, helping to justify adoption and measure success. In many cases, PoV is followed by a successful PoC.
Consider a healthcare tech company developing an AI tool to detect early-stage Alzheimer’s disease by analyzing eye movements. While many studies show that AI models analyzing eye movement data can differentiate between individuals with Alzheimer’s and healthy controls (Liu et al., 2024), its real-life implementation in a healthcare setting is challenging. Informed by the literature review, the company should first develop an initial PoC that uses AI to identify unusual eye movement patterns associated with Alzheimer’s. This prototype is tested in a controlled setting to ensure it accurately detects these patterns and works well with existing medical imaging systems.
After confirming the technical feasibility, the company should move to the PoV stage, focusing on real-world benefits. They conduct pilot studies with healthcare providers to evaluate the tool’s effectiveness in clinical environments. Key metrics include diagnostic accuracy, time saved in diagnosing patients, and cost reductions compared to traditional methods. They also assess patient outcomes and satisfaction to ensure the tool improves overall care quality. By examining these factors, the company determines the AI tool’s ROI and its suitability for widespread clinical use.
From our experience in AI consultancy, we have noticed that companies starting their AI journey often overlook PoV. Many assume they already understand the business value of their AI projects and focus too much on PoC. However, figuring out business value is not just about assumptions. It requires careful planning and a clear approach. Here are some essential aspects of a PoV.
In conclusion, to ensure successful AI adoption, companies must go beyond PoC and focus on PoV to assess how the solution can deliver tangible benefits. Simply following AI trends or implementing AI without a clear purpose often leads to failed projects and wasted investments. A strategic approach that incorporates both PoC and PoV is essential for leveraging the true potential of AI and creating meaningful business impact.
Applied AI. (2021). Value assessment of AI products and applications. Available at https://aai.frb.io/assets/files/appliedAI_Value-Assessment-of-AI-Products-and-Applications.pdf. Read 27/11/2024.
BCG. (2024). Where’s the value in AI? Available at https://www.bcg.com/publications/2024/wheres-value-in-ai. Read 27/11/2024.
European Parliament and Council. (2024). Regulation (EU) 2024/1689 of 13 June 2024 laying down harmonised rules on artificial intelligence and amending certain Union legislative acts (Artificial Intelligence Act). Official Journal of the European Union, L 1689, 1–144. Available at https://eur-lex.europa.eu/eli/reg/2024/1689/oj. Read 27/11/2024.
Finnish AI Region (FAIR). (n.d.). Available at https://www.fairedih.fi/en/frontpage/. Read 27/11/2024.
Liu, Y., Zhang, W., Wang, S., Zuo, F., Jing, P., & Ji, Y. (2024). Depth-induced saliency comparison network for diagnosis of Alzheimer’s disease via jointly analysis of visual stimuli and eye movements. arXiv. Available at https://arxiv.org/abs/2403.10124. Read 27/11/2024.
McKinsey & Company. (2024). The state of AI in early 2024: Gen AI adoption spikes and starts to generate value. Available at https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai. Read 27/11/2024.
Mindtree. (2024). Gen AI adoption report: Unlock the power of generative AI platforms. Available at https://www.ltimindtree.info/gen-ai. Read 27/11/2024.
Finnish AI Region
2022-2025.
Media contacts