Skip to content
All free practice

LockedIn FDE Training field practice · Free and open

Test the answer against changing evidence

Choose the right context and evaluate behavior when the source changes.

Read the concept. Explore two decisions. Leave with a test you would run next.

Go to the decisions

The working model

Understand the boundary.

A context window bounds the information available to a model in a request. Adding more text does not establish that it found the relevant, current evidence. Define the behavior you need, then test it on representative cases, including stale and missing information.

  1. Retrieve

    Find relevant, scoped sources

  2. Resolve

    Check version and applicability

  3. Evaluate

    Test the answer and its evidence

A worked example

A fictional policy assistant receives an old policy and a newer replacement. A useful answer identifies the applicable version and cites the supporting section. If the system cannot establish which version applies, it should surface that uncertainty instead of inventing a definitive answer.

Claude: define success criteria and build evaluations

Primary reading checked 2026-10-10. Provider learning stays with its issuer.

Practice deskDecision 1 of 2

Make a decision

Your assistant gives a plausible answer and cites an old policy. A newer version changes the rule. Both documents fit in its context window.

What is the most useful next investigation?

Choose one response before comparing the reasoning.

Another concept

Separate a proposal from permission

Open the next free exercise

For teams

Build evidence through real work.

Advanced lessons, labs, mentoring and qualification workflows sit behind provisioned internal or licensed seats. Public practice does not unlock them.

Explore the private training pathway