Brief

From recurring question to durable control

Designing a compliance knowledge system

Claire FausettPublished Last reviewed 7 min read

Bottom line

Most compliance knowledge bases are run as document repositories, which is too passive a job for them. A useful knowledge system captures recurring decisions, makes their authority and ownership visible, and helps the organization work out why the same question keeps arriving. The goal is a shorter path to a defensible answer with judgment intact, rather than a larger pile of pages.

1. Treat the question queue as data

A repeated question is evidence before it is a task. It is evidence of unclear policy, thin training, missing data, awkward product design, scattered documentation, or an escalation path still waiting to be formalized. Reading a month of questions as a dataset — grouped by root cause rather than by topic — turns a support burden into a diagnosis.

Recurring issue Likely intervention
The rule is genuinely ambiguous Formal interpretation or decision record
Policy is clear but hard to locate Searchable guidance and better information architecture
Teams interpret the same language differently Clarification, examples, and training
Required information goes uncaptured Product or data-field change
The process creates avoidable exceptions Workflow redesign
The issue is a genuine edge case Clear escalation ownership and precedent tracking
Guidance becomes stale quickly Review dates and change-management ownership

The middle rows matter most, because they are the ones a knowledge base answers badly. Writing another page for a problem whose cause is a missing data field adds a page and keeps the problem.

2. Organize knowledge around decisions

A weak knowledge base is organized around departments and document names, which are facts about the organization. A stronger one is organized around the operator’s question, which is a fact about the work:

  1. Trigger
  2. Decision required
  3. Governing source
  4. Evidence needed
  5. Available paths
  6. Exception criteria
  7. Escalation owner
  8. Review date

Somebody arriving at that page arrives mid-task. They already know what happened; they want to know what to do about it. A page that opens with the regulation and reaches the action in its fourth section is serving the author’s sense of order rather than the reader’s problem.

3. Establish provenance and governance

Every consequential page should show, on its face: source or authority, owner, approval status, effective date, last review date, related decisions, applicable products or jurisdictions, escalation path, and change history.

Each of those has a specific failure attached to its absence. Missing authority produces guidance that gets argued with instead of followed. Missing ownership produces a page that ages until an audit finds it wrong. A missing review date makes every page permanent by default. A missing change history leaves an operator who followed last month’s version with no way to demonstrate it, which converts a documentation gap into that operator’s personal problem — the fastest way to teach a team to stop consulting the knowledge base at all.

4. Build a feedback loop

  1. Recurring question
  2. Root-cause classification
  3. Decision or process improvement
  4. Published guidance
  5. Usage and recurrence monitoring
  6. Revision

The step organizations skip is the second, and skipping it is what produces a knowledge base measured by page count. The step they skip next is the fifth: publication feels like completion, and recurrence after publication is the only evidence that it was.

5. Measure system quality

  • Time to locate an answer, measured from the operator’s side
  • Share of questions resolved by existing guidance
  • Recurrence of questions already addressed
  • Stale or ownerless pages, as a share of the whole
  • Escalation volume, and its trend after each publication
  • Search terms returning nothing useful
  • Quality defects traced to unclear guidance
  • Elapsed time between a decision and the published instruction reflecting it

Search terms returning nothing useful is the cheapest of these and the least read. It is a list, written by the people doing the work, of what the system failed to say — in their vocabulary rather than in the policy’s.

6. Connect documentation to product and process changes

Documentation should stay a record of a good workflow rather than a substitute for repairing a bad one. Where the root cause sits in the process, the right response is often something other than a page:

  • A required field
  • A validation rule
  • A clearer queue assignment
  • A revised control
  • A policy clarification
  • A new escalation threshold
  • A removed step

A knowledge system that can recommend deleting a step has standing. One that can only add pages will keep adding them.

A worked hypothetical

The following scenario is hypothetical and is included only to illustrate the framework.

Over one month, an operations queue receives the same question four times from three teams: a business customer has changed its registered address to a different country, and the team is unsure whether that requires a refreshed review.

Classification. Reading the four tickets together shows the policy is clear, and says so in one sentence. Three of the four arrived because the address change came through a self-service profile edit, which fired no review event; the fourth came out of a periodic review, where the trigger worked exactly as designed. The root cause is a product event with no control attached, rather than an ambiguous policy.

Response. The team writes one decision record stating the position and its authority, adds a required field capturing the country of the new address, and configures a trigger that opens a review when that country changes. The queue receiving those cases gets a named owner. One page of guidance goes up, and it is short, because most of it points at the decision record.

Result. The question stops arriving. The evidence of success is a quiet queue and a trigger with a firing rate, and a review that used to depend on somebody noticing now happens by construction.

Documentation would have answered the question. The trigger removed it.

What this changes operationally

A compliance team classifies its inbox by root cause monthly and reports the classification, so recurring questions become a diagnosis with owners rather than a workload that grows.

An operations lead treats a third occurrence of one question as a defect with a ticket, rather than as something to answer patiently for a fourth time.

A product manager receives a specific, sourced request — this event needs a trigger, this field needs to exist — with the tickets that motivated it attached.

A knowledge owner measures recurrence and stale pages rather than page count, and retires content on a schedule with the same seriousness applied to publishing it.

Limitations

A knowledge system organizes settled decisions. It has nothing to offer an unsettled one, and the moment it appears to, it has begun substituting for judgment. Novel facts, contested requirements, and cases near the edge of a policy belong with a person holding the authority to decide them; the system’s job there is narrow, and it is to route the case quickly and record what was decided.

It also depends on something outside its own scope. Where decisions get made and stay unrecorded, a knowledge system documents the fraction that reached it and presents that fraction as the whole, which is worse than an empty shelf.

Primary sources

  • FFIEC. Bank Secrecy Act/Anti-Money Laundering Examination Manual. Internal controls, training, and the expectation that written procedures reflect what an institution actually does.
  • FinCEN. The Anti-Money Laundering Act of 2020, Section 6101, and the program requirements built on it: effective, risk-based, and reasonably designed programs.
  • Board of Governors of the Federal Reserve System and OCC. Supervisory Guidance on Model Risk Management, SR 11-7 / OCC Bulletin 2011-12 (2011). Documentation as a control, and the standard of a record a third party can follow.
  • COSO. Internal Control — Integrated Framework (2013), the Information and Communication component.
  • ISO. ISO 30401:2018, Knowledge management systems — Requirements. Provenance, ownership, and lifecycle treated as requirements rather than as good practice.
  • Institute of Internal Auditors. The IIA’s Three Lines Model (2020). Where ownership of a control sits, and who assesses it.