Diamant

Needs you

  • Inbox
  • Decisions
  • Plans
  • Code

Pipeline

  • Activity
  • Graph
Sign in
Plans/

Process documents differently based on confidence

Brain review
ADO work item#340363Product Backlog Item

Process documents differently based on confidence

Synced just nowOpen in ADO
State
New
Assigned
Not set
Area
Diamant Entwicklung\Produkt\Projektteams\Cross Functional Services\Mathildenhoehe\ITP
Project
Diamant Entwicklung
Freshness
Synced just now

ADO description

As an accountant (Kai — "Isn't there an easier way?") I want the system to handle documents differently based on the overall confidence — straight through, quick confirm, or targeted clarification — so that I dispatch routine cases with no effort and only touch the exceptions. TODO (2026-05-29): Story not yet round. Open strategic questions: How do we build customer trust to allow STP in the first place? Are 1-click postings the precursor to STP (ramp-up mechanism per instruction/vendor)? Will the pilot put us in a sustained state where many 1-click postings happen before STP kicks in? The story cut becomes final only after this is clarified — it touches the pilot activation strategy, pricing telemetry, and customer success accompaniment.

ADO acceptance criteria

With a high overall confidence the document runs all the way to posting automatically (STP, straight-through processing) — no user intervention needed With medium overall confidence the document receives status "AI suggestion" per affected value or line item; the accountant can confirm the values with a single click (see #340367 ) With low overall confidence or individual low-confidence values the document receives status "clarification required" per affected value or line item, with a structured handling instruction in the detail view The counter metric "correction rate after posting" is calculated continuously per client; if it exceeds the threshold the system automatically holds back the activation of new client-specific instructions The system action "confidence evaluation and routing" is recorded in the log with who, what, and when Out of scope for MVP Customer-side configuration of the confidence thresholds — phase 3 (linked to #340359 ) Cross-client threshold recommendations — phase 3 Learning the thresholds from correction patterns — phase 3

Parent

  • #340339NEW: Restructuring of requirements(Implementing)

Children

No child work items.

Siblings

  • #340357Automatically assign an incoming invoice to the correct "Mandant"(New)
  • #341611Bearbeitung eine Geschäftsvorfalls ohne User-Kontext(New)
  • #340996

Linked PRs

No linked pull requests.

Plan review. The agent proposed a plan. Review it below, then approve so it can start coding — or request changes.

Azure DevOps
  1. Human review

Implement the approved work packet "Add structured logging to the preprocessing document-processing pipeline" with a scoped branch and human-reviewed PR.

medium risk

The implementation agent can change source code and open a PR, so dashboard approval is required before coding and before PR creation.

Expected files

None listed.

Implementation steps

  • 1.Inspect the work packet evidence, parent work item context, and linked pull request/code context before editing.
  • 2.Locate the owning repository and smallest set of files needed for the requested behavior.
  • 3.Make a narrow implementation change on an ai/work-packet branch.
  • 4.Run the focused test/typecheck command for the touched package or application.
  • 5.Collect the diff and test output for dashboard review before opening a PR.

Test plan

Geschäftsvorfall buchen
(New)
  • #343305Migrate and rebuild existing code (Backend-Technologiestack)(New)
  • #343677Detect duplicates of incoming invoices — Cockpit UI (ITP-Public-Facing-Interface)(New)
  • #343253Umbau auf Basis der neuen Architektur-Conversion based on the new architecture(New)
  • #340364View Geschäftsvorfälle in the overview(Committed)
  • #340359Automatically assign "Kontierung" to invoice line items(New)
  • #340352Detect duplicates of incoming invoices(Approved)
  • #340355Automatically check mandatory information per §14 UStG(New)
  • #341608Session von Dia/4 übernehmen(New)
  • #340369Create a client-specific instruction from the detail view(New)
  • #340367Manually correct data in the detail view(New)
  • #340349Open and process an unclassified transaction(New)
  • #340362Automatically suggest an approver(New)
  • #340361Match incoming invoice against purchase order and delivery(New)
  • #341933Document requirements and select an LLMOps platform for prompt management, tracing, and evaluation(Committed)
  • #340351Automatically extract document contents and show them in the detail view(Committed)
  • #340358Automatically assign an incoming invoice to the correct "Kreditor"(New)
  • #340356Automatically flag suspicious documents(New)
  • #340997Bearbeitung eines Geschäftsvorfalls nachvollziehen(New)
  • #340371Learn from corrections so future suggestions get better(New)
  • #340340Upload a PDF incoming document and create a transaction(Committed)
  • #343302manual editing of the Mandant(New)
    • ·Run the most focused unit test or typecheck for the touched package.
    • ·Run the repository-level validation command if the focused test does not cover the changed surface.

    Repositories

    • ·ITP-Agent-Runtime