Problem Misdefinition in Enterprise AI
The top-five-priorities filter asks whether a proposed AI problem is among the customer's top five priorities. If it is not, the source says the engagement will fail.
Why Strong Proposals Still Stall
Many AI engagements begin with a team that is confident in its technical plan. The model architecture is sound, the data pipeline is feasible, and the engineers can point to clear performance targets. Yet a surprising number of these engagements stall or are abandoned before they reach real users. This article examines one reason that happens and introduces a simple test that can catch the problem before any money or months are committed.
What do you think happens?
A team has a technically strong AI proposal. When the team checks the company's stated goals for the next year, the proposal does not match any of the top items. The team is eager to start. What should happen next?
Reveal answer
The engagement should not start. The choice is between a smaller exploratory scope and leaving.
The filter is applied early. When no top priority is addressed, the source says the engagement should not start, and it offers a small exploratory scope or leaving as the two options.
The intuition behind the problem is natural. If a project is technically elegant and clearly useful to the people building it, it seems reasonable to assume the organization will embrace it. Teams often judge a proposal by how interesting the problem is to them, how much better the model could be, or how much the solution would improve their own workflow. What they rarely check is whether the problem sits near the top of the organization's own list of concerns.
The Top-Five Question
The top-five-priorities filter asks whether a proposed AI problem is among the customer's top five priorities. If it is not, the source says the engagement will fail.
The question behind the filter is concrete. Ask what the company is trying to accomplish over the next four quarters, and look for the three to five items that lead the list. Then ask which of those items your project addresses. The filter is not satisfied by a project that touches a vaguely related goal. It needs a direct link to something leadership has ranked near the top.
The diagram shows only the decision itself. The important point is that the check happens early, before the engagement starts. The source describes the no branch in two ways. The polite version is to scope a smaller exploratory engagement that could open the door to a future project that is properly aligned. The honest version is to leave.
Why the Filter Is Organizational
Why does the filter matter so much? The source argues that the reason is organizational rather than technological. The term organizational physics refers to the idea that certain organizational changes follow underlying principles, much as physical systems follow laws. Getting an AI system into production is one such change, and it cannot happen by force of technical argument alone.
Production deployment needs sustained leadership attention, legal and compliance agreement, IT access, and workforce acceptance. Each of these requirements is costly for the people involved. Leaders must keep their attention on the effort for a long time. Compliance and IT teams must revise positions they have held for years. Workers must change habits. The source's central claim is that none of these changes happen for problems that are not high on leadership's list. A problem that leadership ranks low cannot generate enough sustained effort to overcome these frictions.
Stated Problem Versus Real Priority
RAND's August 2024 meta-analysis of sixty-five enterprise AI initiatives placed problem misdefinition at the top of its list of failure root causes. Problem misdefinition is the error of framing a problem misaligned with leadership's priorities. The source also states that most cases of misdefinition trace back to a single error: building against something the leadership cares about less than the team building it understood.
The mismatch is often invisible from inside the team, because the team's own understanding of the problem feels complete. The team is not failing to think. It is looking at a problem that is real and interesting to it, but that the organization has not ranked near the top. The comparison below shows the gap in its generic form.
Applying the Filter to a Proposal
Checking a proposal against the top five
A team proposes an AI system that improves the accuracy of an internal document-search model. The team has strong performance targets and wants to begin next month. Leadership's stated goals for the next four quarters list five items, and none mentions document search or search accuracy. Should the engagement start?
- 1Identify the proposed problem
The problem is improving search accuracy in an internal document tool.
- 2Ask the early question
Ask what the company is trying to accomplish over the next four quarters and list the three to five leading items.
- 3Look for a direct link
The filter needs a direct link to a top item. A vaguely related goal does not satisfy it. None of the five items names search accuracy or document search.
- 4Choose the branch
The proposal fails the filter. Per the source, the engagement should not start. The team chooses between a small exploratory scope and leaving.
The proposal does not pass. The team should not begin the full engagement. It can scope a smaller exploratory effort or leave.
Notice that the team's technical strength did not enter the decision. The filter does not evaluate how good the model could be. It evaluates whether the problem sits among leadership's top items. This is the reason the check comes first: once an engagement is underway, the team is committed to a problem the organization ranks low.
Mistakes When Using the Filter
Common mistake Judging a proposal by how interesting the technical problem is
What it looks likeA team argues that a model improvement is worth doing because the research is novel.
Why it failsThe source notes that teams often judge proposals by interest, model quality, or their own workflow benefit, while rarely checking whether the problem is near the top of the organization's list.
Do this insteadApply the top-five question first and ask which leading item the project directly addresses.
Common mistake Accepting a vaguely related goal as a match
What it looks likeA project is said to support 'efficiency', so it is treated as satisfying a top priority.
Why it failsThe filter is not satisfied by a project that touches a vaguely related goal. It needs a direct link to something ranked near the top.
Do this insteadName the specific top item and state how the project moves it.
Common mistake Asking the question late in the engagement
Why it failsThe source says the filter should be applied early, before the engagement starts. A late check finds the misalignment after resources are committed.
Do this insteadRun the check before any money or months are committed.
Common mistake Treating the team's own understanding as proof of alignment
Why it failsThe source notes the mismatch is often invisible from inside the team, because its understanding of the problem feels complete.
Do this insteadVerify alignment against leadership's stated goals, not against the team's own sense of the problem.
Practice: Run the Filter on a Proposal
A team proposes an AI tool that automatically drafts internal meeting summaries. The company's stated goals for the next four quarters are: expand into two new regions, reduce supply-chain delays, improve customer retention, complete a regulatory audit, and consolidate two legacy systems. Using the top-five-priorities filter, decide whether the engagement should start. If it fails, state whether the team should scope a small exploratory effort or leave, and explain which step of the filter led you there.
Hints
- Identify the three to five leading items first, then look for a direct link, not a vaguely related one.
- Remember that the filter is applied before the engagement starts, and the source describes two options when it fails.
Key Takeaways
- The top-five-priorities filter asks whether a proposed AI problem is among the customer's top five priorities; if it is not, the source says the engagement will fail.
- The reason is organizational rather than technological: production deployment needs sustained leadership attention, legal and compliance agreement, IT access, and workforce acceptance, and these do not happen for low-ranked problems.
- Problem misdefinition, framing a problem misaligned with leadership's priorities, sits at the top of RAND's list of AI failure root causes, and its mismatch is often invisible from inside the team.
- The filter must be applied early, before money or months are committed; when no top priority is addressed, the choice is between a small exploratory scope and leaving.