Understand
Know intended use, limits and known errors.
delta-sierra.com
David Salvan | Books, Public Policy and Mars Colonization
Validation is not a formality: the responsible person must understand, control, challenge and remain accountable.
Measure 4.09 requires human intervention for any adverse decision. Human presence is meaningless if the person lacks time, information, competence or power to disagree with the system. The law must therefore define effective human oversight.
Know intended use, limits and known errors.
Access the case file and underlying sources.
Disregard the output without automatic penalty.
Stop the tool when risk or incident appears.
Give independent reasons for the final decision.
Be identifiable and legally responsible.
| Example | Why validation is required |
|---|---|
| Rejection or inadmissibility | The person may lose access to a claim. |
| Penalty or aggravation | The legal position is worsened. |
| Refusal of a right | A negative legal effect follows. |
| More burdensome procedure | The output increases delay or constraint. |
| Risk flag | A score may trigger enhanced scrutiny. |
The EU AI Act requires human oversight for high-risk systems, proportionate to risk and context. Oversight personnel must have competence, training and authority. The proposed French clauses apply those principles to judicial use.