Context

A governance review needs more than a summary of a long document. Reviewers need to see which evidence supports a finding, where material is missing, and what deserves further examination. Gilles developed and delivered a production LLM-based compliance analysis capability. Its outputs included structured strengths, gaps, recommendations, scores, and supporting-document references. The engineering contribution concerned analysis and evidence presentation; it does not establish a legal determination, certification, or a guarantee that an organization meets its obligations.

Approach

Nickel precision square on a rectangular checking base

The work connected document processing and retrieval with structured analysis across governance topics and compliance frameworks. A general approach separates the material being reviewed from the criteria used to interpret it. That separation helps explain whether a weak result comes from missing evidence or from an unsupported interpretation. Enterprise RAG describes the related retrieval problem. A source can establish that a policy exists while leaving its application or completeness unresolved; the interpretation needs to preserve that distinction.

Quality controls

Annotation-based validation and agreement analysis supported governance classification work. Good and bad ratings, with optional comments, provided user feedback for refining compliance analysis and retrieval answers. These confirmed practices are distinct from formal approval procedures or audit trails, which are not claimed. Evaluating structured outputs explains the general reason a complete-looking response still needs semantic checks: a filled field or score can be unsupported by the cited material.

Outcomes

Mahogany document stand holding a blank cream sheet

The delivered system produced structured document-grounded findings in production and collected user feedback. Its useful capability was organizing interpretations alongside supporting references. Responsibility for accepting an interpretation and deciding what action follows remains with qualified reviewers and the organization using the analysis.

  • Delivered production structured analysis with document references.
  • Collected ratings and comments to guide refinement.