Breadcrumb

  1. Home
  2. News
  3. Don’t Just Ask a Chatbot. Have It Push Useful Info Right When It’s Needed.

Don’t just ask a chatbot. Have it push useful info right when it’s needed.

Novel tools automatically capture and effectively disseminate workflow knowledge

Four men staring at a laptop and television screen
DARPA Service Chiefs Fellows (in uniform) and a DARPA technical advisor view a demo by a member of the University of Southern California team on the Knowledge Management at Scale and Speed (KMASS) program. Source: DARPA | Paul Flacks (This photo has been altered for security purposes by blurring out identification badges)

Aug 25, 2025

Asking a chatbot for help on any number of issues has become part of daily life for many. But today’s query-based AI tools built on large language models (LLMs) are limited to responding to questions users ask. 

These tools can pull queried info from a database, but they can’t automatically push insightful and contextualized knowledge to help a user complete a task without being asked.

DARPA’s Knowledge Management at Scale and Speed (KMASS) program, which kicked off in 2022 and recently held its final principle investigator meeting, has developed a variety of new tools that can automatically ingest knowledge sources and disseminate specific “nuggets” of info relevant to a workflow — whether the user requests the knowledge or not — exactly when needed, while avoiding irrelevant or already known information. This personalized knowledge sharing concept is a core tenet of KMASS referred to as “JustINs” — i.e., just in time, just enough, and just for me.1 

Knowledge gaps created by frequent military turnover

A challenge for the military, whose members change duty stations and deploy regularly, is ensuring efficient and effective knowledge handover during transitions. 

Currently, the transfer of key organizational task information and understanding of unique local issues is largely ad hoc: onboarding briefings, “right-seat/left-seat” mission rides, conversations, knowledge management (KM) databases, lessons learned reports, turnover folders, emails, and even handwritten notes – all of which require time-consuming manual collection, maintenance, and dissemination that are prone to gaps. And when someone who’s been with an organization for years or decades retires, a treasure trove of local organizational knowledge and best practices is lost.

KMASS aims to prevent vital knowledge from falling through the cracks or being filed away where no one knows to look for it. KMASS research teams and commercial companies over the past several years have developed underlying technologies to effectively organize, preserve, and manage background knowledge at the “nugget” level; seamlessly capture new local knowledge in real time as part of regular workflows (i.e., no extra documentation step required from the user); and disseminate contextualized knowledge in an easily understood format that is useful, appropriate, and on time.

Don’t make me ask…

“Using LLMs is like casting a magical spell; you need to find the right words to get the model to do what you want. Popular LLMs give you a haystack of info to search through when you ask a question, whereas KMASS will push the needle in the haystack to you as you’re working on a task, even if you don’t know the right question to ask,” said Matthew Marge, a leading AI expert at DARPA and KMASS program manager. “KMASS overcomes the input/output knowledge bottleneck, which occurs when knowledge producers don’t have easy ways to document knowledge and knowledge consumers don’t have easy ways to get at that knowledge."


KM input/output bottleneck

KMASS pushes a contextualized knowledge nugget directly to users, avoiding the multiple search steps currently required.

Legend
SOA: State-of-the-Art
KM: Knowledge Management
LLM: Large Language Model

Objective: Acquire and provide knowledge in real time before losing it to retirement, rotation, and replacement

  • Create tools that can capture and disseminate contextualized, nuanced knowledge that usually gets lost
  • Allow our troops to focus on and improve what they’re doing and learn from others

Core hypothesis: Tools that capture and push knowledge can give more actionable insights than querying with SOA KM tools

Approach: Address knowledge capture and push bottlenecks

  • Develop “lightweight” knowledge representations that support human-to-human transfers of knowledge
  • Apply machine learning to the challenge of understanding what knowledge is most relevant for a given context

Transition: Create tools to disrupt human-based KM workflows


Most commonly, when people start a task that requires some nuanced organizational knowledge to complete, they begin by querying a search engine or LLM, then search local organizational knowledge databases, then hopefully glean some applicable nugget of knowledge from these searches, and, finally — if they remember to — document what was learned and store it in a place where people will know to find it later.

“KMASS eliminates all these middle steps and takes a user straight from task start to task completion by automatically pushing the appropriate contextualized knowledge nugget needed,” Marge said.

Most commercial LLMs are geared toward novices, whereas KMASS is aimed at military and technical experts who need domain-specific, locally contextualized, timely knowledge that a general LLM can’t provide. LLMs also don’t explicitly capture new knowledge, which is a key element of KMASS.

“Delivering the right knowledge at the right time requires context,” said Robert Lazar, a DARPA technical advisor to the program since its inception. “The dissemination challenge is intrinsically linked to the capture challenge; Context links knowledge from the knowledge producer to the knowledge consumer, which is the key to helping people who don’t know what they don’t know get their knowledge nugget.”

Three KMASS research teams, two KMASS-related small business innovation research (SBIR) teams, and one independent verification and validation (IV&V) team recently demonstrated their systems at DARPA to representatives from DOD and other government organizations to spur further KM tech development and speed adoption across the DOD and U.S. government. 

Since KMASS was a fundamental research effort, the teams demonstrated their tools on easily accessible data in the following domains: Oil and gas; analysis; university management; civilian aviation; contract management (other transactions – OTs); and document understanding.



[1] Rosenberg, M. J. (2001). E-learning: Strategies for delivering knowledge in the digital age. New York: McGraw-Hill
 

The KMASS teams and their demos
 

Johns Hopkins University Applied Physics Lab (JHUAPL): JHUAPL served as the KMASS IV&V team that developed an advanced LLM knowledge management baseline system representing a technological “bleeding edge” LLM that the other KMASS performers were compared to. JHUAPL demonstrated their pipeline KM tool showing how they built an advanced LLM tuned to specific domains.

SRI International (SRI): SRI built a domain-adaptive intelligent tool for technical knowledge management. SRI demonstrated the ability of their system to proactively aggregate multiple sources and disseminate tailored content to the user’s expertise and task context in the highly technical oil and gas domain, which is rife with semantic colloquialisms and daily “knowledge dumps” of well data.

Monash University (Monash): Monash built a lightweight process model-based KM tool. Monash demonstrated the ability of their system, which sits on top of any website, to capture knowledge in-the-flow and immediately proactively disseminate that knowledge to another user in need. They demonstrated their tool using their universities learning management system, Moodle, and a mockup of DARPA’s Distribution Statement A Request (DISTAR) online system.

University of Southern California (USC): USC built a digital KM apprentice that learns through asking good questions. USC demonstrated the ability of their system, which integrates with Jupyter notebook, to capture and disseminate task graphs, which are step-by-step human interpretable instructions. They demonstrated their tool in the data science domain, showing that the system can quickly capture knowledge from expert software developers and accurately contextualize a developer’s tasks based on the organization’s code repository.

Dynamic Object Language Labs (DOLL): Under a SBIR project associated with the KMASS program, DOLL demonstrated the ability of their system, which they call First Officer, to provide timely, situation-specific guidance to general aviation pilots. In one case, the First Officer talks a pilot through procedures after losing an engine, and in another case it guides a passenger through the process of making a Mayday call, an undocumented assumed skill, should the pilot(s) become incapacitated.

InferLink: Under the Context Management for Effective Transitions (COMET) SBIR project related to the KMASS program, InferLink demonstrated their deep data extraction tool, which is a customizable AI platform that extracts entities, data and relationships from research articles, contracts, tables and other documents.

 

Contact