Conditions
Version the robot, objects, site and people.
Deployment evaluation · 13
Task-definition protocol
Fix start state, completion, time, damage, assistance, reset and exclusion rules before testing.
Evidence statusEngineering evidence framework · task and site validation requiredLast reviewed: 14 August 2026
13
FUURAA thesis
A result becomes comparable only when the protocol makes success and failure reproducible.
Engineering map
Turn the title into engineering objects that can be observed, measured and reviewed.
Each layer states the boundary to establish and the evidence needed for the next decision.
Scoring
Define completion, quality, failure and intervention.
Repetition
Randomise relevant variation and preserve every run.
Verification questions
Write the questions first, then decide whether a demo, test, pilot or operating record can answer them.
Each question needs an object, conditions, denominator, threshold and accountable decision owner.
- 01
Can another team run the same protocol?
- 02
Are resets and retries counted?
- 03
Does scoring reward unsafe speed?
- 04
Are exclusions decided before results?
Evidence to preserve
Enable the next reader to reconstruct conditions, results, failures and the decision.
A conclusion alone loses reviewability; raw records, configuration and exclusions matter too.
- 01
Evidence package 1
Versioned test protocol
- 02
Evidence package 2
Complete trial-level dataset
- 03
Evidence package 3
Predefined scoring and exclusions
Scope boundary
State what this evidence still cannot be generalised to.
- 01
A best run, edited video or unspecified trial count is not a reliability result.
- 02
This is an engineering reading and decision framework; it does not replace application-specific risk assessment, conformity work, procurement acceptance or professional advice.
Sources and evidence status
Read standards scope, measurement evidence and application conclusions separately.
Source dates and review status remain visible; external sources open in a new tab.
01
NIST · Updated 2024-08-16 · verified 2026-08-14
↗02Standard test methods for response robots
Develops repeatable measures for mobility, manipulation, sensing, endurance, communications, operator proficiency, logistics and safety.
ISO · Published 2026-07-24
↗ISO 18646-5:2026 — Locomotion performance for legged robots
Defines methods for specifying and evaluating locomotion performance of complete legged robots.