Poker Coverage: Poker Tournaments U.S. Poker Markets Sports Betting Poker Strategy

Poker Pros Win Contest Against World's Top Bot

Humans Win By 732,700, But CMU Says It's A 'Statistical Tie'

Print-icon
 

Doug Polk

On Friday, a team of some of the world’s top heads-up no-limit players finished off a two-week long match against Carnegie Mellon University’s poker bot named “Claudico.”

Bjorn Li, Doug Polk, Dong Kim and Jason Les each played 20,000 hands against the machine and were up a combined 732,700 chips, which was more than 7,300 big blinds.

Despite the win, researchers at Carnegie Mellon don’t believe it proves Claudico is inferior to the humans, given the variance in poker, the relatively small sample size and the margin of victory.

“We knew Claudico was the strongest computer poker program in the world, but we had no idea before this competition how it would fare against four top 10 poker players,” Tuomas Sandholm, the Carnegie Mellon professor of computer science who directed development of Claudico, said in a statement. “It would have been no shame for Claudico to lose to a set of such talented pros, so even pulling off a statistical tie with them is a tremendous achievement.”

However, Polk doesn’t believe the bot is all that good compared to human players, according to the press release. “There are spots where it plays well and others where I just don’t understand it,” Polk said, adding that the machine’s massive over-bets just didn’t make much sense.

Fortunately for Claudico, or the new versions of it, artificial intelligence researchers are going to use the 80,000 hands it played against the top poker pros as a way to improve it.

Heads-up no-limit hold’em, Sandholm said, has 10^161 situations, or information sets, that a player may face—vastly more than all of the atoms in the universe. By contrast, the game of limit hold’em, has only 10^13 information sets. Claudico used two terabytes of data.

In the final chip tally, Li had an individual chip total of 529,000, Polk had 213,700 and Kim was up 70,500. Les was down to Claudico by 80,500.

“We know theoretically that artificial intelligence is going to overtake us one day,” Li said. “But at the end of the day, the most important thing is that the humans remain on top for now.”

The match was held at Rivers Casino Pittsburgh and was sponsored by Microsoft. Each player received $100,000 for beating the machine. Real money wasn’t used during the match.

Image via the BBC.

 
 
Tags: Doug Polk,   Poker Bot
 
 

Comments

Zack2
almost 6 years ago

You need to balance both math and having a mind. Glad they took it seriously to prove that a computer will never beat this game

 
Reply
 

KGBeard
almost 6 years ago

It doesn't mean it can't beat average high/mid stakes reg. And if we do not understand something it doesn't mean it's bad.

I just don't understand why top regs want to do this, as they are just giving free info to programmers to adjust their bot and point out leaks. It's not that getting paid means anything for them, as they are crushing high stakes and helping someone to develop unbeatable bot that could potentially crush lower stakes and totally kill game... ffs look what happened to chess and backgammon?

What sites should do is ban scripts and bots, ban huds, work on new variations of holdem that will move game in specific direction that will loose it up, and top regs should ignore happenings like this one as there is just no good thing that can happen for game of poker by solving it or making GTO bot.

 
Reply
 

KGBeard
almost 6 years ago

also something to add is that this was rakeless game with not so much pressure as you ain't playing for your own money over 4-6 hu tables (or w-e they usually play)

 
Reply
 

KGBeard
almost 6 years ago

and btw.. don't get me wrong I'm on team brains side and I hope we crush AI for our life time :)

and also GJ guys , I really liked Doug Pork :P looks like a cool guy that you would like to drink a beer with

 
Reply
 

Joseph19
almost 6 years ago

Well Duh! Looks like they'll have some extra dough for Erotic Monkey.

 
Reply
 

Fl_Skygod
almost 6 years ago

Unless I'm mistaken, part of the seventh paragraph of the story (above) should read "By contrast, the game of HEADS-UP limit hold'em has only 10^13 information sets." Adding a full ring games' compliment of players would vastly increase the information sets, though I'm not good enough at math to say by how much.

 
Reply