Human Judgment as a Specification

▤ Summary

This article explains how teams can use human judgment to improve AI-generated formal specifications. It introduces PICK, a workflow that presents concrete examples to users so they can accept or reject candidate outputs from an LLM. The approach now extends beyond regular expressions to linear temporal logic and attribute-based access control. The piece argues that this human-in-the-loop method helps uncover vague or implicit intent and can fail safely when no candidate matches the user’s commitments. It also points readers to an ECOOP 2026 paper and a VS Code tool for trying the system.

▦ Linked Companies