The Intelligible World of Agents
The Role of World Representation in Agentic AI Systems
Imagine the same detective working two different cases. In the first, every piece of evidence arrives as a disconnected fragment—names without relationships, events without timelines, motives without context. In the second, the connections among people, events, and evidence are already established before the detective walks in.
Which case does the detective solve faster?
The detective solves the second case much faster than the first, but not because the detective is more intelligent. Instead, the world is more intelligible. The difference is not reasoning ability; it is the organization of knowledge that represents the world and enables action.
Now, imagine two cybersecurity AI agents built on the same frontier language model, with the objective of defending against attacks. Both share a general understanding of vulnerabilities, attackers, and defensive techniques. One, however, operates over fragmented alerts, disconnected data sources, and inconsistent identifiers. The other agent reasons over a structured representation that captures relationships among assets, vulnerabilities, threat actors, detections, and organizational context. Similar to detectives, the difference in performance stems not from greater intelligence but from a more intelligible environment or even a living enterprise model.
This is my primary argument: Agentic intelligence is about constructing a representation of the operational world in which correct decisions become the expected outcome rather than a matter of chance. As agents begin taking actions rather than merely producing answers, the quality of those actions depends mostly on the context the agents inherit and whether it’s structured, current, and backed by trustworthy evidence.
To understand how this works for machines, it helps to examine human learning. Human progress has never depended on information alone. It has depended on organizing that information—deciding which sources to trust, connecting related facts, preserving context, and passing that knowledge forward. We inherit this structure through education, language, institutions, and shared practice. Remove it, and even sophisticated reasoning becomes little more than educated guesswork.
Intelligence doesn’t emerge in isolation. It depends on the quality of the representations we think with. The quality of reasoning depends not only on our ability to draw conclusions, but also on how well the world has been made intelligible before we begin. Trustworthy agents do not emerge from better prompts. They emerge from better operational world models. Humans develop reasoning by building increasingly rich mental models of the world through observation, interaction, and experience. Modern language models follow a different path. They learn statistical representations from vast amounts of data rather than through direct interaction with the environment. As a result, they possess broad knowledge but lack direct access to the current operational state of the world in which they must act.
This distinction is particularly important in cybersecurity. Human analysts continuously integrate observations, institutional knowledge, and information about operational state into a coherent mental model of their environment. AI agents must instead be provided with that operational model. Assets, identities, vulnerabilities, dependencies, relationships, policies, and evolving evidence cannot be inferred reliably from language alone—they must be represented explicitly in the world the agent reasons over. Foundation models are increasingly capable of planning, selecting tools, interpreting observations, and adapting their behavior. Their effectiveness, therefore, depends less on reasoning in isolation than on the quality of the representations they can access and the actions they can take. Those representations encompass not only organizational knowledge, like entities, relationships, provenance, policies, governance, and evolving state, but also the tools available to observe and change that state. Again, general models generate general answers.
During the development of enterprise AI agents at Recorded Future, we encountered many instructive examples. The first lesson came immediately. Early versions of our agents treated open-source information and Recorded Future’s proprietary intelligence with roughly equal weight. The result was generic, internet-scale responses rather than the expert-level analysis we intended. Through repeated experimentation, we changed the architecture so that the agent reasoned primarily over the Recorded Future Intelligence Graph®1—a structured representation of the cyber threat landscape built from years of analyst research, enriched relationships, and investigative decisions. The agent learned to prioritize high-confidence analytical artifacts, such as Insikt Notes2 and curated graph relationships, over weaker signals derived from open sources. The language model itself had not become more intelligent. What changed was the quality of the world it was given to reason about. The result was an agent that produced more authoritative analyses and acted with substantially greater consistency and confidence.
Frontier models are becoming easier to access every month. That means model choice is becoming a weaker source of competitive advantage than many organizations assume. What’s much harder to copy is a trustworthy representation of an organization’s operational knowledge. While production-grade orchestration remains challenging, it is unlikely to provide a durable moat for agentic systems in cybersecurity as frameworks, tooling, and implementation patterns continue to converge. What cannot be commoditized is a trusted operational representation of the organization. Agents struggle wherever knowledge remains implicit—in institutional expertise, undocumented conventions, or relationships no system has captured. Their performance ultimately reflects the quality of the world they can access.
Consider a seemingly simple Priority Intelligence Requirement (PIR): “What is a threat to our organization?” The answer is rarely explicit or universally agreed upon. It emerges from understanding the external threat landscape together with the organization’s own high-value assets, priorities, and risk posture. Constructing that representation is a deliberate analytical exercise, not a by-product of deploying an AI model. Once made explicit, however, it provides the foundation on which agents can reason consistently and act effectively. The differentiating question is therefore not, “Which agent framework do we use?” but, “What operational world do our agents reason over?” Organizations that invest in making their knowledge explicit, structured, and trustworthy will consistently derive more value from AI than those that deploy increasingly sophisticated models against fragmented operational knowledge. In this case, intelligence is truly an architecture rather than computation. To build a structured world for cybersecurity agents to operate in, enterprises should align with the following principles:
Structure before reasoning. An effective AI system does more than retrieve facts. Too many systems repeatedly reconstruct knowledge from unstructured information, wasting computational resources while producing inconsistent results. Instead, intelligent and trusted agents should inherit an organized representation of the world: relationships between entities, events, organizations, and evidence should already exist within a structured living knowledge system. The agent's responsibility is to reason over this established structure, not rediscover it with every interaction. The result can be greater consistency and reliable outcomes, particularly for tasks that depend on relationships across multiple sources. Whether it also lowers total cost depends on how the representation is constructed, maintained, and reused3.
We observed the same pattern when building an autonomous threat hunting capability in our Autonomous Threat Operations (ATO)4. The language model already understood cybersecurity concepts—it knew what YARA rules, Sigma rules, MITRE ATT&CK techniques, and behavioral indicators were. The breakthrough did not come from teaching more cybersecurity data. It came from explicitly representing investigations: translating detection rules into behavioral hunts, preserving relationships between evidence, maintaining provenance, and carrying forward prior investigative decisions. An investigation that once required analysts to repeatedly reconstruct context became dramatically faster because the context itself had become part of the system. Before the change, each run reconstructed the relationship between the rule, the relevant behavior, and prior investigative findings. After those relationships became a durable system state, the agent could begin from the current investigative position rather than restarting from the source material. As a result, the agent could act effectively around the clock at greater speed.
Provenance is inseparable from intelligence. Human experts are trained to question sources, recognize outdated information, and detect uncertainty. AI systems cannot make these judgments unless every piece of information carries evidence of its origin, relevance, and reliability. Provenance is what transforms data into trustworthy intelligence5. For operational intelligence, provenance should include the source; the precise evidence used and its freshness, confidence, and known contradictions; and the relationship between that evidence and the resulting claim. Without provenance, even sophisticated reasoning is reasoning built on assumptions rather than verified knowledge.
A major pain point for cyber threat intelligence (CTI) teams is that, on any given day, thousands of articles, social media posts, blog entries, and automated alerts may mention an entity of interest to them. Most are operationally irrelevant: news commentary, recycled reporting, speculative claims, or duplicate coverage. The intelligence value lies not in the volume of mentions but in understanding their provenance. Is the information derived from a trusted government advisory, firsthand reporting from an intrusion, or direct observations from a darknet forum? Or is it simply another outlet repeating yesterday’s story? Provenance enables an AI agent to distinguish original evidence from repetition, assess freshness and credibility, and focus attention on developments that materially change the threat landscape rather than amplifying noise.
Verification must be easier than investigation. Trust matters more than raw capability. An AI system that produces impressive answers but cannot explain how it reached them creates uncertainty rather than confidence. Every recommendation should be accompanied by sufficient evidence to make verification substantially easier than reproducing the investigation itself. This includes the observations used, material assumptions, uncertainty, contradictory evidence considered, and the conditions under which the recommendation should not be followed. If it doesn't, the technology has merely shifted labor instead of reducing it.
Transparency is the foundation on which trust is built. This principle increasingly aligns with emerging thinking in frontier AI governance, where trust depends not only on model capability but on rigorous verification of the evidence, processes, and claims underlying AI systems6.
A CISO, good friend, operating under significant resource constraints, once asked whether an AI agent could reliably recommend isolating compromised production servers. My answer was yes—but only under one condition. A threat analyst should never have to reconstruct the entire investigation just to decide whether to trust a recommendation coming from an AI agent (it is also very costly). Instead, the AI agent should present the evidence for the underlying conclusion, like the suspicious process it observed, the connection to known malicious infrastructure, the behavioral detections that fired, the supporting threat intelligence, the confidence of each finding, and any contradictory evidence it considered, but also the reasoning that connects those observations. Evidence alone is insufficient; the same facts can often support multiple competing hypotheses.
The goal is not for analysts to reconstruct every investigation from first principles, but to quickly assess whether the agent’s chain of reasoning is sound and whether the recommended action is proportionate to the available evidence. This becomes even more important as agents transition from advisory to autonomous roles. Defensive agents offered by the industry will increasingly be expected to isolate hosts, revoke credentials, or block communications before a human can intervene. In those settings, trust cannot depend on manual verification of every decision. It must be earned through consistently reliable reasoning, calibrated confidence, transparent evidence, and well-defined operational guardrails. Verifying the recommendation should take minutes; reconstructing it from raw telemetry could take hours. Otherwise, the AI has not reduced the workload—it has merely shifted it from investigation to verification.
Efficiency is an intellectual discipline. Many assume that more reasoning necessarily produces better intelligence, yet excessive computation often reflects poor system design rather than greater capability. Efficient intelligence is not about thinking longer; it is about thinking more precisely. A well-designed agent retrieves only what is relevant, avoids unnecessary repetition, and allocates computational effort where it genuinely adds value. Efficiency is not merely an economic concern—it is a measure of intellectual discipline7.
In my ongoing conversations with security leaders, one concern has surfaced repeatedly: Organizations cannot afford to reproduce the inefficiencies of alert fatigue with AI agents. Replacing thousands of alerts with thousands of autonomous actions would simply automate the noise. Agents are only as effective as the intelligence, policies, and evidence they operate upon. If the underlying representations contain duplicates, false positives, stale context, or conflicting evidence, autonomous systems will amplify those weaknesses at machine speed. The goal is therefore not to maximize agent activity but to maximize decision quality. The most valuable agent consistently performs the right actions while knowing when not to act.
Reasoning must be preserved, not just data. As organizations deploy multiple intelligent agents, preserving reasoning becomes as important as preserving data. What must persist is not an unrestricted transcript of prior reasoning, but a governed record of evidence examined, hypotheses considered, assumptions made, decisions taken, unresolved questions, confidence levels, and conclusions that have subsequently become stale or invalid. Intelligence is cumulative. Human collaboration succeeds because people exchange not only conclusions but also assumptions, uncertainties, confidence levels, and unresolved questions. Intelligent agents should communicate in the same manner: Each agent should inherit the complete investigative state rather than merely a final answer. This enables cumulative reasoning—each participant building on prior understanding rather than restarting the thinking process—and creates consistency, transparency, and trust across increasingly complex systems.
One of the most common cyber cases I encounter is a ransomware investigation involving multiple analysts, shifts, and, increasingly, specialized AI agents. Whether the next participant is human or machine, they should not begin with only the latest conclusion. They need to inherit the investigative state: the evidence already examined, assumptions made, confidence assigned, competing hypotheses, unresolved questions, and conclusions that have since been revised as new evidence emerged. Without that shared state, every handoff requires reconstructing why earlier decisions were made and which lines of inquiry were already explored. With it, the investigation progresses cumulatively rather than repeatedly restarting, reducing duplication while improving consistency, auditability, and decision quality.
Intelligence must outlive the interface. Technology platforms, user interfaces, and AI models will inevitably evolve, but high-quality intelligence should remain portable, structured, and universally accessible. Organizations should not become dependent on a single application or agent. Intelligence should function as a foundational layer that supports any workflow, regardless of where or how it is consumed.
Threat intelligence organizations have spent years enriching adversary profiles, linking infrastructure, documenting investigative decisions, and building behavioral knowledge—not to mention identifying all the IT debt organizations have. If that intelligence exists only inside one vendor’s application or is encoded in prompts for a single AI assistant, every platform migration forces the organization to rebuild years of accumulated knowledge. By contrast, when intelligence is represented independently (as structured entities, relationships, evidence, and provenance), it can support any analyst, detection engine, hunting agent, or future AI model without having to be recreated. Customer relationships, business policies, operational knowledge, and historical decisions should not be lost when an organization replaces its CRM, SIEM, or AI provider. The applications may change; the intelligence they rely upon should not. Durable intelligence becomes a shared asset that every future system can inherit. Every major platform migration exposes the same problem: Organizations have preserved their applications better than their intelligence.
None of this diminishes the human role; in fact, it centers it. Rather than forcing analysts to build every investigation from scratch, intelligent systems should prepare a structured foundation upon which human expertise can operate. AI becomes a collaborator rather than a substitute. The highest value of an intelligent agent is not that it thinks independently, but that it enables humans to think more effectively.
For decades, we have treated intelligence as something people consume: reports, recommendations, indicators, documents. Agentic systems are forcing us to take a different view. Intelligence has become part of the environment in which reasoning occurs. The competitive advantage will not belong to organizations possessing the largest models. It will belong to those who build trustworthy systems where knowledge is structured, evidence is transparent, reasoning is efficient, and human judgment remains central.
Models will change. Interfaces will disappear. Workflows will evolve. What remains is the architecture of enterprise intelligence itself.
This essay was written in collaboration with AI tools. The observations, arguments, and reflections are my own; AI helped me test, ground, and structure them as an essay. It seemed only honest to say so in a piece arguing that the value of AI lies in helping humans think more effectively, not in thinking for them. And English is my second language.
Human Credits: Aron Lagerberg, David Lange, Megan Keeling, Joseph Rooke
AI Credits: Recorded Future AI, ChatGPT, Claude
Footnotes:
1 Recorded Future Intelligence Graph is an AI-driven graph that indexes, structures, and connects data from more than one million sources, including open web, dark web, technical feeds, customer telemetry, and analyst research, to create a structured representation of the cyber threat landscape.
Source: Recorded Future, Intelligence Graph,https://www.recordedfuture.com/platform/intelligence-graph (accessed July 31, 2026).
2 Recorded Future’s Insikt Group produces research that creates action to disrupt adversaries.
Source: Recorded Future Insikt Group Research. Research Library. https://www.recordedfuture.com/research (accessed July 31, 2026).
3 Recent work from Google DeepMind suggests that improving reasoning efficiency is not solely a matter of scaling models, but also of understanding the structure of the reasoning process. Although the work examines reasoning within the model rather than knowledge graphs, it supports the broader view that better structure—not just larger models—can produce more efficient and reliable reasoning.
Source: Zhang, X. F., et al. “Do LLMs Really Need 10+ Thoughts for ‘Find the Time 1000 Days Later’? Towards Structural Understanding of LLM Overthinking.” ACL 2026, Google DeepMind, 2026. https://aclanthology.org/2026.acl-long.773/.
4 Recorded Future. Autonomous Threat Operations. The platform combines AI-powered autonomous threat hunting with multi-source correlation over the Intelligence Graph®, enabling continuous detection and response across connected security tools.
Source: https://www.recordedfuture.com/products/autonomous-threat-operations (accessed July 31, 2026).
5 Recent research also shows why attaching a citation is not enough. Work presented at ACL 2026 distinguishes between evidence that is quoted, compressed, or used to support an inference, linking each generated sentence to the precise source passage behind it. The evaluated models handled direct quotation far better than inference-based provenance. A system may therefore cite the right document while still failing to demonstrate that the document supports the conclusion it produced.
Source: Wei, J., Wang, X., Liao, Y., Dong, J., Liu, Y., Jia, C., Yu, B. and Zhu, J. (2026), “GenProve: Learning to Generate Text with Fine-Grained Provenance,” Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics, pp. 5027–5048.
6 Recent work on frontier AI auditing argues that trust in advanced AI systems cannot rest on model capability alone, but requires verifiable evidence and rigorous assurance mechanisms. This essay extends that principle into an operational design rule for enterprise AI: the cost of verifying an AI recommendation should be substantially lower than the cost of producing that recommendation manually. If verification requires reconstructing the entire investigation, the system has shifted work rather than reduced it.
Source: Miles Brundage, Noemi Dreksler, Aidan Homewood, et al., "Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and Security Practices at Leading AI Companies", arXiv:2601.11699, January 2026. The authors argue that trustworthy frontier AI requires rigorous third-party verification of developers’ claims and emphasize that transparency alone is insufficient without evidence-based assurance.
7 Recent work on context engineering suggests that agent failures often originate in the quality of the context they inherit rather than deficiencies in the underlying model, reinforcing the importance of structured representations before reasoning begins.
Source: Fouad Bousetouane, AI Agents Do Not Fail Alone: The Context Fails First, arXiv:2607.14275, July 2026. The paper argues that the quality of an agent’s operating context—including instructions, tools, memory, retrieved knowledge, and guardrails—is an independent predictor of reliability, even when the underlying frontier model remains unchanged.