top of page

Microsoft Makes Prompt Columns Generally Available for Persisted AI Insights

Jul 30
14 min read

Microsoft has moved Dataverse prompt columns into general availability, turning generative AI output into persistent business data rather than temporary chat text. That distinction makes this google news item more consequential than another Copilot feature release.

Prompt columns let Power Apps makers connect a natural-language instruction to fields in a Dataverse record. Microsoft’s model processes those inputs, then stores the response in a new field for apps, workflows, reports, and queries.

The immediate comparison is not another chatbot. It is conventional business logic, where teams use formulas, rules, flows, or custom code to transform operational records. Microsoft is placing probabilistic AI beside those established tools, while presenting the result like ordinary application data.

That shift creates the central tension. Persisted AI insights are easier to reuse than disposable answers, but they also become harder to treat as casual suggestions. Once generated text enters a database, downstream users and automations can mistake interpretation for fact.

Microsoft Has Turned an AI Prompt Into a Dataverse Data Type

The important change is persistence: Microsoft now lets generated output live inside a business record and participate in normal application workflows.

Microsoft describes a prompt column as an AI-powered Dataverse data type. A maker writes a natural-language instruction and connects it to one or more permitted input columns from the same data source.

When a relevant record is created or updated, the platform can send its selected values to the AI model. The generated response is stored in the prompt column instead of disappearing when a chat session ends.

Microsoft’s release plan lists July 30, 2025, for public preview and May 4, 2026, for general availability. The related documentation was still receiving feature updates in June 2026, including asynchronous execution, conditional filters, and status tracking.

The feature supports familiar generative tasks. A prompt column can summarize customer feedback, classify an inquiry, detect sentiment, extract details, or draft a response based on record data.

Consider a customer-support table with fields for the complaint, product, account type, and recent interaction. A maker could add fields for sentiment, issue category, escalation priority, and a proposed reply.

Those outputs can appear in a model-driven Power App. A Power Automate flow could route a case according to the stored category. A report could group complaints by AI-assigned theme.

This is materially different from asking Copilot to summarize one record on demand. The result becomes part of the operational dataset and remains available after the original model call.

Prompt columns can use more than one input field, but Microsoft excludes formula columns, files, images, and other prompt columns as direct inputs. The restriction prevents makers from chaining prompt outputs into opaque cascades inside one table.

Microsoft also limits each table to five prompt columns. That boundary makes early deployments easier to inspect, although it does not settle how organizations should govern many tables across an environment.

Existing records are not automatically backfilled. Prompt analysis runs when a new record arrives or when a referenced input field changes. Updating the prompt definition alone does not recalculate stored results.

This behavior matters for reporting. Two records with identical source data could contain outputs generated under different prompt versions unless an organization deliberately triggers recomputation.

Microsoft’s documentation also says on-demand execution is not currently supported. Makers cannot simply press a platform control to recalculate every stored response after changing an instruction.

The result resembles a calculated field in presentation, but not in behavior. A conventional calculation should return the same output for the same valid inputs. A generative model can produce language that varies, omits context, or assigns the wrong category.

That is the bigger story beneath the google news headline. Microsoft is not only bringing AI into an app. It is giving generated interpretation a durable place in the system of record.

Why Persisted AI Insights Matter More Than Another Copilot Chat

A stored answer can influence every user and process that trusts the record, giving one model response a longer operational life.

Chat assistants keep a person in the interaction. A user asks a question, sees an answer, and decides whether to accept it. The answer usually remains visibly associated with an AI conversation.

A prompt column changes that context. The output can appear beside manually entered fields, imported values, calculated fields, and system metadata. Unless an app clearly labels it, users may not know which values came from a model.

Persistence also increases reuse. A classification generated once can support views, reports, dashboards, search, notifications, and routing rules without another inference call.

That can reduce repetitive processing. A service team does not need every agent to summarize the same case history. A product team can filter feedback using a stored theme instead of repeatedly reading raw comments.

The approach also reduces integration work. Before prompt columns, a maker might build a flow that collected field values, called an AI prompt, handled the response, and wrote it into another field.

That design remains useful for complicated processes. However, Microsoft has now packaged the common pattern as part of table design. The maker selects Prompt as a data type and configures the instruction within the Power Apps experience.

This lowers the distance between an idea and a deployed AI field. It also lowers the distance between an experimental prompt and a production dependency.

A useful prompt column can become embedded in several processes. A sentiment label may control a queue, while a summary appears in an app and feeds a weekly report.

If the prompt changes, the organization must decide whether older results remain valid. If the model behavior changes, teams need a way to detect differences. If the output fails, dependent processes require a fallback.

These questions are familiar to data engineers and machine-learning teams. Prompt columns bring them to low-code makers who may have little experience managing model outputs as governed data.

The feature therefore pressures two existing operating models. It challenges IT teams that centralize AI development, and it challenges business teams that treat low-code applications as simple departmental tools.

Centralized AI projects move slowly because specialists manage models, integrations, testing, security, and monitoring. Low-code development moves faster because business experts can encode their requirements directly.

Prompt columns attempt to combine those advantages. They let makers define the interpretation while Microsoft manages much of the underlying AI execution.

Yet the organizational boundary remains. Someone must decide which records qualify, who can change a prompt, how results are reviewed, and what happens when a stored output is wrong.

This is where a searchable knowledge base provides a useful comparison. Retrieved knowledge remains connected to source documents, while a prompt column stores a generated interpretation inside an operational record.

Both approaches can reduce reading time. However, persisted fields demand clearer provenance because another user may encounter the output without seeing the original evidence.

google news Frames a Feature Release, but the Real Contest Is Rules Versus Models

Microsoft is asking businesses to decide when probabilistic interpretation belongs beside deterministic rules in production applications.

Traditional business apps depend on predictable logic. A formula calculates an amount. A validation rule rejects incomplete input. A workflow routes a record when defined conditions match.

Prompt columns address tasks that resist those methods. Sentiment, free-text classification, summarization, and draft generation require interpretation rather than fixed arithmetic.

A company could create hundreds of keyword rules to classify feedback. Those rules would still struggle with context, sarcasm, unusual wording, and emerging product names.

Generative AI offers broader language handling through a shorter instruction. A maker can describe the desired category scheme and test the model against sample records.

That flexibility is the feature’s appeal. It is also why prompt columns should not replace every rule.

A tax calculation should remain deterministic. A compliance deadline should come from a verified date and an approved policy. A customer’s legal status should not depend on open-ended language generation.

The dividing line is not whether AI can produce an answer. It is whether the organization can tolerate ambiguity, review errors, and explain the output’s role.

Microsoft has added filter-based execution to help makers draw that line. A filter can prevent the prompt from running unless defined conditions are satisfied.

For example, a support table might generate an escalation summary only for unresolved cases marked high priority. That design avoids spending Copilot credits on records where the output adds little value.

Asynchronous computation provides another boundary. Microsoft says prompt columns process outside the real-time transaction, preserving responsiveness for critical workflows.

The app does not need to wait for model generation before completing the record update. However, downstream logic must account for a period when the field remains unfinished.

Microsoft creates corresponding Status and Details fields for each prompt column. Status values distinguish records that have not started, remain in progress, completed successfully, were skipped, or failed.

Skipped records can reflect unmet filter conditions or unchanged inputs. Failed execution can result from missing permissions or insufficient Copilot entitlements and credits.

These states prevent a blank field from carrying only one meaning. A developer can distinguish “not eligible” from “generation failed,” then design the app around that difference.

The pattern brings prompt columns closer to managed data processing than a visual AI flourish. Status tracking, filtering, and asynchronous execution all acknowledge that model calls can fail or arrive late.

Conventional logic still wins when correctness must be reproducible. Prompt columns become useful when language understanding produces enough value to justify review and uncertainty.

The competitive context reinforces that direction. Salesforce offers field generation templates that connect prompts to record fields in Lightning pages.

Salesforce’s documented workflow lets a user trigger an assigned template and return generated content to a selected field. Microsoft’s Dataverse design emphasizes automatic generation after relevant record changes, plus persistence as a dedicated column type.

The products differ in implementation and surrounding platforms. Still, both point toward the same enterprise pattern: AI will increasingly enrich records inside business applications rather than remain confined to separate chat windows.

That is the pressure Microsoft creates for rival low-code, CRM, and workflow vendors. A general AI assistant is no longer enough if customers expect model output to participate directly in their operational data model.

Stored Model Output Creates a Governance Gap

Prompt columns make AI output easier to consume, but Microsoft’s current controls do not remove the need for human review, provenance, and change management.

The first concern is factual reliability. A model can summarize a complaint incorrectly, overlook a qualification, or assign an inappropriate category.

A mistaken chat response affects one conversation. A mistaken stored field can appear in multiple apps and influence later automation.

The second concern is provenance. Microsoft’s documentation provides execution status and timing details, but prompt columns are not themselves audited, according to the product FAQ.

Dataverse supports broader record auditing for enabled tables and columns. Administrators can track record changes, configure retention, and retrieve change histories.

However, the prompt-column documentation’s statement that prompt columns are not audited deserves attention. Organizations should not assume normal change history provides a complete explanation of how every generated value was produced.

A stored output should ideally be traceable to the source record version, prompt version, model configuration, execution time, and reviewer decision. Without that context, investigating a bad outcome becomes harder.

The third concern is stale interpretation. When a maker edits a prompt, existing records do not recalculate automatically. Their generated fields can reflect several generations of business logic.

This creates a silent consistency problem. A report may group recent records using the latest instruction while older records retain classifications from an earlier version.

Organizations can deliberately update an input field to trigger new analysis. Yet a production-scale backfill requires planning, testing, capacity, and safeguards against overwriting reviewed values.

The fourth concern is automation authority. A generated summary is relatively low risk when a human reads it before acting. An AI-assigned category becomes more consequential when it routes a customer, triggers an alert, or changes service priority.

Teams should separate advisory outputs from decision fields. The AI can suggest a classification, while a person or deterministic rule confirms decisions with financial, legal, employment, or safety consequences.

A practical application can store the model’s suggestion, reviewer status, approved value, and correction reason separately. That structure preserves efficiency without hiding disagreement.

The fifth concern is permission design. AI Builder relies on Dataverse roles and privileges to control creation and use of models and prompts.

Microsoft’s AI Builder security documentation says environment makers can create models and prompts. Basic users can use properly shared models through embedded applications.

System administrators and system customizers can access all models and prompts in an environment. Custom roles require comparable privileges when an organization delegates creation more selectively.

Prompt inputs also respect field access. Microsoft lists insufficient permission to one or more referenced input columns as a potential execution failure.

That safeguard is important, but it does not answer every exposure question. An app could display a generated summary that indirectly reveals information drawn from a restricted input field.

Security review must therefore cover both inputs and outputs. Teams should ask whether generated text can reproduce sensitive details for users who cannot open the original field.

Microsoft says its AI Builder architecture isolates customer data between tenants. It also says inputs, outputs, embeddings, and training data are not made available to OpenAI or used to improve foundation models.

The company says data stays within the Azure Trust Boundary. Where Azure OpenAI is available, customer data remains inside the applicable geographic boundary, according to the documentation.

Those commitments address model training and platform processing. They do not eliminate risks created by an organization’s own prompts, permissions, retention policies, reports, and downstream automations.

Microsoft also states that AI Builder communicates with Azure AI Content Safety. Content filtering can reduce certain harmful outputs, but it cannot guarantee that a business summary is complete or accurate.

The right skeptical reading is therefore specific. Prompt columns are not inherently unsafe, and persistence is not inherently undesirable.

The risk appears when a convenient field is treated as verified truth without the controls normally applied to derived business data. General availability signals product readiness, not universal suitability for every decision.

Prompt Columns Will Change How Business Apps Are Designed

The most valuable deployments will treat AI fields as observable processing stages, not magical replacements for schemas, rules, or accountable decisions.

Application designers traditionally decide which data users enter and which values the system calculates. Prompt columns introduce a third category: fields the system interprets.

That category needs a visible identity. Apps should label generated values, show when processing occurred, and provide access to the underlying source text when permissions allow.

Designers should also expose the execution state. A user needs to know whether a blank summary means no analysis was needed, processing remains underway, or generation failed.

The Status and Details fields provide the raw mechanism. The application must turn those codes into understandable interface states.

A customer-support scenario illustrates the full pattern. An incoming case includes a subject, description, account, product, and customer history.

One prompt column summarizes the issue. A second proposes a category. A third drafts an internal next-step recommendation.

A filter runs those prompts only when the description contains enough information and the case remains open. The app shows the generated outputs as suggestions, while the agent confirms the final category.

A workflow can route the case after confirmation. If generation fails, the record enters a manual triage queue rather than remaining invisible.

The system also captures correction data. When an agent changes the proposed category, that correction becomes evidence for prompt evaluation and future refinement.

This structure produces more than convenience. It creates an operational feedback loop without allowing the model to hide inside the record.

Product-feedback analysis offers another useful scenario. A prompt column can classify comments as bugs, feature requests, praise, or usability concerns.

Another field can extract the referenced product area. A product manager can then review grouped records before using the trends in planning.

The stored outputs make filtering and reporting easier. However, the raw feedback should remain available because generated categories compress nuance.

Sales teams could use prompt columns to summarize meeting notes or flag missing qualification details. Marketing teams could classify inbound responses. Operations teams could extract structured details from free-text requests.

Each use case should start with a measurable burden. The question is not where AI might fit. It is which repeated interpretation currently consumes time or blocks a downstream process.

Teams should then define an acceptable error pattern. A slightly imperfect internal summary carries different consequences from an incorrect escalation decision.

A production design should include sample testing across routine, ambiguous, adversarial, incomplete, and sensitive records. Makers should compare model output with human judgment before connecting the field to automation.

They should also test prompt injection, where text inside an input record attempts to redirect the model’s instruction. Customer messages, imported notes, and web form submissions can contain such content.

Microsoft says AI Builder includes protections for AI-focused risks, including prompt injection. Organizations still need scenario-specific testing because content safeguards cannot understand every internal policy.

Generated outputs should use constrained formats when possible. A short list of permitted categories is easier to validate than unrestricted prose.

Filters should exclude records where inference adds no value. Fewer executions reduce credit consumption and limit unnecessary processing of sensitive content.

The five-column limit per table can encourage restraint. Teams should prioritize fields with clear users, defined review paths, and measurable effects.

It also prevents one table from becoming an uncontrolled layer of model-generated metadata. Organizations can still spread prompts across tables, so environment-level inventory remains necessary.

A useful inventory should record the owner, prompt purpose, input fields, output consumers, filters, review process, risk level, and retirement plan.

Change management deserves equal attention. Editing a prompt is similar to changing application logic because it can alter the meaning of future stored values.

Makers should test revisions in a nonproduction environment. They should compare old and new outputs against representative records, then decide whether historical results require recalculation.

They should avoid silently overwriting a human-approved value. Separating generated and approved fields makes that policy easier to enforce.

This design discipline preserves what makes prompt columns attractive. Business experts can encode useful interpretation close to the data while administrators retain visibility over operational consequences.

What to Watch After Microsoft’s Prompt Columns GA Release

The next test is not whether makers can create prompt columns, but whether organizations can operate them reliably across changing prompts, records, and business rules.

The first signal is adoption inside real production apps. Microsoft’s documentation already supports automatic triggers, filters, asynchronous execution, and failure statuses.

Customer examples should reveal whether teams use prompt columns mainly for summaries or connect them to routing, reporting, and approvals. Broader downstream use would strengthen Microsoft’s claim that AI belongs inside the data layer.

Limited use as a display-only assistant would suggest that enterprises remain cautious about treating generated content as operational data.

The second signal is lifecycle tooling. Organizations need clearer ways to version prompts, compare outputs, backfill records, test regressions, and trace stored values to their generation context.

Native controls for those tasks would strengthen the persisted-insight model. They would show that Microsoft recognizes prompt columns as governed production logic rather than a maker convenience.

If customers must build every lifecycle control themselves, adoption may concentrate among advanced Power Platform teams. Less experienced makers could keep the feature within low-risk prototypes.

The third signal is how Microsoft and competitors handle oversight. Salesforce already connects prompt templates with record fields, while enterprise software vendors continue embedding generation into CRM and workflow products.

The competitive advantage will not come from placing an AI button beside a field. It will come from making generated data observable, secure, correctable, and safe for automation.

Microsoft has already supplied useful foundations through Dataverse permissions, status fields, filters, and asynchronous processing. The missing proof lies in large deployments where prompts change and records pass through several downstream systems.

Enterprise buyers should ask direct questions before approving a rollout:

  • Which fields contain AI-generated interpretation?

  • Which users can create or edit the prompt?

  • Which input fields can the model access?

  • Can the output expose restricted information?

  • What happens when generation fails?

  • Which workflows consume the result?

  • How are prompt changes tested?

  • How are older records reconciled?

  • Which decisions require human approval?

  • How are corrections captured and reviewed?

These questions turn a product demo into an operating model. They also help distinguish a useful AI field from an undocumented source of business risk.

For makers, the most sensible first deployment is a high-volume, reviewable task with low irreversible impact. Feedback classification, internal summaries, and draft responses fit that profile.

For administrators, the priority is visibility. Maintain an inventory, restrict creation rights appropriately, monitor failures, and require explicit ownership for every production prompt.

For application users, generated fields should remain identifiable. People need a route to inspect source data, reject a suggestion, and record a correction.

Microsoft’s general-availability milestone makes prompt columns a credible production option, but it does not make every model response dependable. The value comes from storing useful interpretation where work already happens.

The danger comes from forgetting that the stored value began as an inference. That distinction will matter long after this google news result leaves the headlines.

Start by identifying one repeated interpretation inside a business process, then map every person and automation that would consume its output. If the team cannot explain the review and failure paths, the field is not ready for production.

If those paths are clear, prompt columns offer a practical test of persisted AI insights. The coming months will show whether Microsoft can make that pattern manageable at enterprise scale.

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page