What are the best methods being used right now in 2024 to accurately measure productivity gains from deploying AI writing tools across a small office?
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
What are the best methods being used right now in 2024 to accurately measure productivity gains from deploying AI writing tools across a small office?
3 real searches · 1 real-search pass
2024 measuring generative AI productivity workplace randomized controlled trial writing tasks time quality field experiment methodologyGoogle ↗
OBSERVEDReason
NBER generative AI productivity customer support workers 14 percent 2023 study methodologyGoogle ↗
OBSERVEDReason
2024 generative AI workplace productivity measurement time saved quality rework framework studyGoogle ↗
OBSERVEDReason
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
ChatGPT real searches (3)
Classes come from the query-classifier (a local Laya model). 2 of 3 calls are low-confidence (under 50%) — hover a query in the table to see its confidence.
Searches and sources
ChatGPT3 real searches · gpt-6
2024 measuring generative AI productivity workplace randomized controlled trial writing tasks time quality field experiment methodology Google ↗
NBER generative AI productivity customer support workers 14 percent 2023 study methodology Google ↗
2024 generative AI workplace productivity measurement time saved quality rework framework study Google ↗
- Experimental evidence on the productivity effects of generative artificial intelligence · pubmed.ncbi.nlm.nih.gov
- Generative AI in Real-World Workplaces · microsoft.com
- Generative AI at Work · nber.org
- Measuring the Productivity Impact of Generative AI · nber.org
Queries
3 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
2024 measuring generative AI productivity workplace randomized controlled trial writing tasks time quality field experiment methodology OBSERVED | Google ↗ AI Mode ↗ | — | Reason | — | — | 1x of 1 | |
NBER generative AI productivity customer support workers 14 percent 2023 study methodology OBSERVED | Google ↗ AI Mode ↗ | — | Reason | — | — | 1x of 1 | |
2024 generative AI workplace productivity measurement time saved quality rework framework study OBSERVED | Google ↗ AI Mode ↗ | — | Reason | — | — | 1x of 1 |