GBCORP BLOG · AI

AI Application Development: Build the App Around the Model

Published March 9, 2022 · 6 min read

The model is the smallest part of an AI application. The screens, the data flows, the guardrails, the evaluation and the cost controls around it are what make it a product. This is how GBCORP builds AI-powered apps, and in what order.

AI Application Development: Build the App Around the Model

AI application development is often imagined as choosing a model and connecting it. In practice the model is a component, chosen late, and most of the engineering is ordinary application work done carefully: what the user sees, what the system may do on its own, how output is checked, and how much each request costs. Get those right and the model can change next year without the app noticing.

The parts around the model

PartWhat it decidesOutcome
InterfaceWhere the feature appears, how uncertainty is shown, how a person corrects itAdoption
GroundingYour documents and data as the source, with citationsTrust
GuardrailsWhat the AI may do alone, what needs a person, what is never doneSafety
EvaluationReal cases with known answers, run on every changeQuality as a number
Cost controlModel choice per task, caching, limits, analyticsA bill you can predict
IntegrationAPIs to the systems the output must reachUsefulness

The order of work

First, the use: one task, one queue, one measurable result. Second, the evaluation set: fifty to two hundred real examples with the answer a good employee would give. Third, the interface and the guardrails, built into the existing app or console. Fourth, the model, chosen against the evaluation set for accuracy and cost. Fifth, analytics and a support plan, because quality drifts and someone must see it.

Why the app comes first

An AI feature in a separate chat window is a demo. An AI feature inside the screen where the work happens is a product. GBCORP builds the mobile and web app and the AI layer with the same team, from one Flutter codebase with a cloud backend, so the assistant, the summary or the classification appears exactly where the user needs it and nowhere else.

Custom AI solutions and integration

Most businesses do not need a model of their own; they need the right model connected to their data and their systems through documented APIs. AI integration services cover that: hosted large models where quality justifies the cost, smaller open models run privately where data must stay in place, and classic machine learning where it is cheaper and more accurate. Nothing is locked to one vendor.

Checklist before an AI application project

  • The one task and its measurable result.
  • The evaluation examples, collected before design starts.
  • The rules for what must stay with a person.
  • Data location and privacy requirements, which decide the model options.
  • API access to the systems the output must reach.
  • The acceptable cost per request.

The numbers to expect

AI development and automation on the GBCORP e-shop starts at a flat price for the first release; a full AI-powered app is scoped in a week and quoted per release, with a first release in eight to twelve weeks. Every feature ships with its evaluation set and usage analytics, so accuracy and cost are visible weekly from day one.

A worked example

A services company receives several hundred enquiries a week by e-mail and form. The task: classify each by service and urgency, draft a reply in the company's tone, and create the record in the CRM. The evaluation set: two hundred past enquiries with the reply a senior colleague sent. The build: a classifier and a drafting step inside the existing console, with the draft shown beside the enquiry and one button to send or edit. Guardrails: anything mentioning a complaint, a contract or a refund is routed to a person with no draft. After four weeks the acceptance rate, edit distance and time per enquiry are numbers, and the second use is chosen from the same queue.

Keeping it working

AI features drift: the enquiries change, the model behind an API is updated, a new product is launched that the examples never mentioned. The evaluation set catches this because it runs on every change and its score is watched weekly under the support plan. New examples are added as the business changes. Cost per request is tracked beside accuracy, so a model upgrade that improves one and doubles the other is a decision rather than a surprise. This is ordinary application maintenance applied to a component that happens to be a model, and it is why GBCORP builds the AI layer with the same team that maintains the app.

Classic machine learning still earns its place

Not every AI feature needs a large language model. Demand forecasting, churn prediction, fraud scoring, product recommendation and image classification are usually cheaper and more accurate with classic machine learning trained on the business's own history, and they run for a fraction of the cost per request. GBCORP chooses the technique per task against the evaluation set, and it is common for a product to carry both: a forecasting model in the console and a drafting assistant in the inbox. The application around them, the interface, the guardrails, the analytics, is the same discipline either way.

Questions we hear first

Do we need our own data scientists?

No. You need the examples and the rules; GBCORP handles model choice, evaluation and integration.

Can the AI run on-device?

Where privacy or latency demands it, yes; smaller models run on the device or in a private cloud.

What happens when a better model appears?

The evaluation set tells you whether it is better for your task; swapping it is a release, not a rebuild.

Multilingual?

Yes, including right-to-left languages, with evaluation per language.

Where to start

The GBCORP AI development and machine learning hub lists every AI service; the GBCORP AI Development and Automation product is the priced starting point. For where generative features pay, read generative AI solutions for business.

GBCORP operates across 17 countries on 4 continents through six pillars: AI & IT, Innovation, Sustainability, Infrastructure, Business Lounge, and EV's & Solutions.