what are the exact steps to test an ai resume screening tool to make sure it is not being biased before we roll it out
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
what are the exact steps to test an ai resume screening tool to make sure it is not being biased before we roll it out
3 real searches · 1 real-search pass
EEOC employment selection procedures AI hiring software adverse impact guidance four fifths rule officialGoogle ↗
OBSERVEDReason
NIST AI Risk Management Framework measure validity reliability fairness bias testing officialGoogle ↗
OBSERVEDReason
NYC Local Law 144 automated employment decision tools bias audit requirements official 2026Google ↗
OBSERVEDInstruction
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
ChatGPT real searches (3)
Classes come from the query-classifier (a local Laya model). 3 of 3 calls are low-confidence (under 50%) — hover a query in the table to see its confidence.
Searches and sources
ChatGPT3 real searches · gpt-6
EEOC employment selection procedures AI hiring software adverse impact guidance four fifths rule official Google ↗
NIST AI Risk Management Framework measure validity reliability fairness bias testing official Google ↗
NYC Local Law 144 automated employment decision tools bias audit requirements official 2026 Google ↗
- Employment Tests and Selection Procedures · eeoc.gov
- Microsoft Word - DCWP NOA for Use of Automated Employment Decisionmaking Tools · rules.cityofnewyork.us
- Automated Employment Decision Tools: Frequently Asked Questions · nyc.gov
- § 20-871 Requirements for automated employment decision tools. · codelibrary.amlegal.com
Queries
3 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
EEOC employment selection procedures AI hiring software adverse impact guidance four fifths rule official OBSERVED | Google ↗ AI Mode ↗ | — | Reason | — | — | 1x of 1 | |
NIST AI Risk Management Framework measure validity reliability fairness bias testing official OBSERVED | Google ↗ AI Mode ↗ | — | Reason | — | — | 1x of 1 | |
NYC Local Law 144 automated employment decision tools bias audit requirements official 2026 OBSERVED | Google ↗ AI Mode ↗ | — | Instruction | — | — | 1x of 1 |