AI use case
Let AI models play a 1988 detective gamebook 646 times to see what helps them win
A developer advocate ran 13 models, including Claude models, through a gamebook and its sequel using a TypeScript engine on the GitHub Copilot SDK. Every first attempt lost, and giving models more retries helped more than a bigger model or more reasoning effort.
- Copilot
- Claude
- Games
- Research
- Fun
- Paid tool
Source: Blog ·