# Government CIOs Develop AI Evaluations

The signal urges government CIOs to define what acceptable AI performance looks like for real agency work and use those agency-specific evaluations to test vendors’ AI systems. It describes a recommended approach, not an announced solicitation or mandate; no agency, contract, evaluation criteria, or deadline is identified.

- Procurement teams can use the approach to develop task-specific evaluation criteria for future AI acquisitions and assess systems against agency work before selection or acceptance.
- AI contractors can prepare to demonstrate performance on realistic agency tasks; the signal does not specify a required testing method or threshold.

**Jurisdictions:** federal
**Industries:** Information Technology
**Topics:** Artificial Intelligence
**Published:** November 02, 2026

### Key Quotes
> Government CIOs should be building evals of what 'right' looks like for real work happening in their agencies, and then making vendor's AIs take the test.

### Sources
- [Government CIOs should be building evals of what 'right' looks like for real work happening in their agencies, and then making vendor's AIs take the test. https://t.co/hvK6IEAVWV](https://x.com/alexcohenof1/status/2117291713429442577) - twitter-fed-procurement