Starcast
Join the waitlist
#53 - John Schultz - Why Google Made ChatGPT, Gemini & Claude Play 900,000 hands of Poker...
Coming soon to iPhone. Already have it? “Listen in Starcast” takes you straight there.
On this episode
About this episode
Which LLM is best at POKER? What about the social deception game Werewolf? This week I'm collaborating with @googledeepmind and @kaggle to explain their new “AI Game Arena” project, designed to test all the top LLMs at various games. The Game Arena is a massive research project to create new AI benchmarks, and understand what really makes these general-purpose AIs tick. It also helps us evaluate how far along the path to true AGI we are, NBD.So who better to speak to than Deepmind research engineer John Schultz, one of the main brains behind the project. We discuss why some LLMs are so much better than others, their internal understanding of the games (or lack of it!) and why games…