™AI
What is an AI application?
An AI application is ordinary software that uses a language model for one specific step. The model is rarely the hard part.
By Tomryn ·
The phrase covers a lot of ground, which is part of why it confuses people. In practice an AI application is a piece of software that does a defined job, and that uses a language model for one or two steps inside that job, usually the steps that involve reading unstructured text, writing a draft, or classifying something that does not fit neatly into rules.
Everything else about it is ordinary software: a place to enter information, a database, permissions, a way to review what happened.
What separates an application from a demo
A demo shows the model producing a good answer once. An application has to produce an acceptable answer repeatedly, for inputs nobody anticipated, in a way that someone is willing to rely on.
That difference is where most of the engineering effort goes.
- Access to the organisation's own information, rather than general knowledge.
- Handling for the cases where the model is unsure or wrong.
- A human review step wherever the output has consequences.
- A record of what was produced and on what basis.
- Permissions, so the application cannot surface information a user should not see.
Common shapes
- An assistant that answers questions from a defined body of internal material.
- A document processor that reads incoming files and extracts structured fields.
- A drafting tool that produces a first version of a routine reply or summary.
- A classifier that routes incoming work to the right person or queue.
When it is the wrong tool
If the task has clear rules, write the rules. A model introduces variability where none is wanted, and costs more to run. AI earns its place where the input is messy, the variation is genuine, and a rules engine would need hundreds of branches.
The other common mismatch is accuracy tolerance. If a wrong answer is unacceptable and cannot be caught by review, the honest answer is often not to automate that step.