Data is choking AI. Here’s how to break free.

This article is part of a VB Lab Insights series on AI sponsored by Microsoft and Nvidia. Don’t miss additional articles in this series providing new industry insights, trends and analysis on how AI is transforming organizations. Find them all here.

AI is a voracious, data-hungry beast. Unfortunately, problems with that data — quality, quantity, velocity, availability and integration with production systems — continue to persist as a major obstacle to successful enterprise implementation of the technology.

The requirements are easy to understand, notoriously hard to execute: Deliver usable, high-quality inputs for AI applications and capabilities to the right place in a dependable, secure and timely (often real-time) way. Nearly a decade after the challenge became apparent, many enterprises continue to struggle with AI data: Too much, too little, too dirty, too slow and siloed from production systems. The result is a landscape of widespread bottlenecks in training, inference and wider deployment, and most seriously, poor ROI.

According to the latest industry studies, data-related issues underlie the low and stagnant rate of success (around 54%, according to Gartner) in moving enterprise AI proof of concepts (POCs) and pilots into production. Data issues are often behind related problems with regulatory compliance, privacy, scalability and cost overruns. These can have a chilling effect on AI initiatives — just as many organizations are counting on technology and business groups to quickly deliver meaningful business and competitive benefits from AI.

The key: Data availability and AI infrastructure

Given the rising expectations of CEOs and boards for double-digit gains in efficiencies and revenue from these initiatives, freeing data’s chokehold on AI expansion and industrialization must become a strategic priority for enterprises.

But how? The success of all types of AI depends heavily on availability, the ability to access usable and timely data. That in turn, depends on an AI infrastructure that can supply data and easily enable integration with production IT. Emphasizing data availability and fast, smooth meshing with enterprise systems will help organizations deliver more dependable, more useful AI applications and capabilities.

To see why this approach makes sense, before turning to solutions let’s look briefly at the data problems strangling AI, and the negative consequences that result.

Data is central to AI success — and failure

Many factors can torpedo or stall the success of AI development and expansion: lack of executive support and funding, poorly chosen projects, security and regulatory risks and staffing challenges, especially with data scientists. Yet in numerous reports over the last seven years, data-related problems remain at or near the top of AI challenges in every industry and geography. Unfortunately, the struggles continue.

A major new study by Deloitte, for example, found that 44% of global firms surveyed faced major challenges both in obtaining data and inputs for model training and in integrating AI with organizational IT systems (see chart below).

The seriousness and centrality of the problem is obvious. Data is both the raw fuel (input) and refined product (output) of AI. To be successful and useful, AI needs a reliable, available, high-quality source of data. Unfortunately, an array of obstacles plagues many enterprises.

Lack of data quality and observability. GIGO (garbage in/ garbage out) has been identified as a problem since the dawn of computing. The impact of this truism gets further amplified in AI, which is only as good as the inputs used to train algorithms and run it. One measure of the current impact: Gartner estimated in 2021 that poor data quality costs the typical organization an average $12.9 million a year, a loss that’s almost certainly higher today.

Data observability refers to the ability to understand the health of data and related systems across data, storage, compute and processing pipelines. It’s crucial for ensuring data quality and reliable flow for AI data that’s ingested, transformed or pushed downstream. Specialized tools can provide an end-to-end view needed to identify, fix and otherwise optimize problems with quality, infrastructure and processing. The task, however, becomes much more challenging with today’s larger and more complex AI models, which can be fed by hundreds of multi-layered data sources, both internal and external, and interconnected data pipelines.

Nearly 90% of respondents in the Gartner study say they have or plan to invest in data observability and other quality solutions. At the moment, both remain a big part of AI’s data problem.

Poor data governance. The ability to effectively manage the availability, usability, integrity and security of data used throughout the AI lifecycle is an important but under-recognized aspect of success. Failure to adhere to policies, procedures and guidelines that help ensure proper data management — crucial for safeguarding the integrity and authenticity of data sets — makes it much more difficult to align AI with corporate goals. It also opens the door to compliance, regulatory and security problems such as data corruption and poisoning, which can produce false or harmful AI outputs.

Lack of data availability. Accessing data for building and testing AI models is emerging as perhaps the most important data challenge to AI success. Recent studies by the McKinsey Global Institute and U.S. Government Accountability Office (GAO) both highlight the issue as a top obstacle for broader expansion and adoption of AI.

A study of enterprise AI published in the MIT Sloan Management Journal entitled “The Data Problem Stalling AI” concludes: “Although many people focus on the accuracy and completeness of data, … the degree to which it is accessible by machines — one of the dimensions of data quality — appears to be a bigger challenge in taking AI out of the lab and into the business.” 

Strategies for data success in AI

To help avoid these and other data-based showstoppers, enterprise business and technology leaders should consider two strategies:

Think about big-picture data availability from the start. Many accessibility problems result from how AI is typically developed in organizations today. Specifically, end-to-end availability and data delivery are seldom built into the process. Instead, at each step, different groups have varying requirements for data. Rarely does anyone look at the big picture of how data will be delivered and used in production systems. In most organizations, that means the problem gets kicked down the road to the IT department, where late-in-the-process fixes can be more costly and slow.

Focus on AI infrastructure that integrates data and models with production IT systems. The second crucial part of the accessibility/availability challenge involves delivering quality data in a timely fashion to the models and systems where it will be processed and used. An article in the Harvard Business Review, “The Dumb Reason Your AI Project Will Fail”, puts it this way:

“It’s very hard to integrate AI models into a company’s overall technology architecture. Doing so requires properly embedding the new technology into the larger IT systems and infrastructure — a top-notch AI won’t do you any good if you can’t connect it to your existing systems.

The authors go on to conclude: “You want a setting in which software and hardware can work seamlessly together, so a business can rely on it to run its daily real-time commercial operations… Putting well-considered processing and storage architectures in place can overcome throughput and latency issues.”

A cloud-based infrastructure optimized for AI provides a foundation for unifying development and deployment across the enterprise. Whether deployed on-premises or in a cloud-based data center, a “purpose-built” environment also helps with a crucial related function: enabling faster data access with less data movement.