However, ReBeL can compute a policy for arbitrary stack sizes and arbitrary bet sizes in seconds. Retraining the algorithms to account for arbitrary chip stacks or unanticipated bet sizes requires more computation than is feasible in real time. “While AI algorithms already exist that can achieve superhuman performance in poker, these algorithms generally assume that participants have a certain number of chips or use certain bet sizes. “The most immediate risk posed by this work is its potential for cheating in recreational games such as poker,” the researchers wrote. This apparently makes ReBeL an even greater threat to the integrity of online poker games because players buy in and play with arbitrary amounts, which also fluctuate over the course of the game as chips are won and lost. ReBeL was “trained on all stack sizes between 5,000 and 25,000 chips, rather than just the standard 20,000,” stated the paper. The speed of ReBeL allows it to be versatile across various stack sizes. It also beat Kim more convincingly than previous AI had, over a sample size of 7,500 hands.
#UNBEATABLE CHESS AI PRO#
In a match against poker pro Dong Kim, ReBeL “played faster than 2 seconds per hand and never needed more than 5 seconds for a decision,” the paper said.
#UNBEATABLE CHESS AI HOW TO#
It learned to play poker without pre-computed shortcuts or bundled information on how to play poker without being exploitable. The paper made numerous references to ReBeL being fast - really fast. Previous bots have, but ReBeL apparently marks an enhancement to computer science’s mastery over poker, according to the paper. While ReBeL achieved so-called “superhuman” performance in heads-up no-limit hold’em, it’s not the first poker AI to reach that level. It appears that ReBeL could also raise the bar for poker, albeit in a way that is apparently indistinguishable to human players.
![unbeatable chess ai unbeatable chess ai](https://i.ytimg.com/vi/QidSByYazjs/hqdefault.jpg)
Google’s AlphaZero, which is similar to ReBeL, not long ago set the chess world on fire with its relentlessly attacking style of play, which implied a deeper understanding of that game.
#UNBEATABLE CHESS AI PROFESSIONAL#
Experimental results show that despite its simplicity, ReBeL is effective in large-scale two-player zero-sum imperfect-information games and defeats a top human professional with statistical significance in the benchmark game of heads-up no-limit Texas hold’em poker while using far less expert domain knowledge than any previous poker AI.”
![unbeatable chess ai unbeatable chess ai](https://content.instructables.com/ORIG/FDN/P5H9/KD1O0U6E/FDNP5H9KD1O0U6E.jpg)
“Instead, our goal is to develop a simple, flexible, effective algorithm that leverages as little expert domain knowledge as possible. “Our goal in this paper is not to chase state-of-the-art performance by any means necessary,” they wrote. The work comes from Noam Brown, Anton Bakhtin, Adam Lerer, and Qucheng Gong at Facebook. Poker is considered “an imperfect-information game.” According to the paper, previous self-learning AI had trouble with games like poker. Unlike chess, poker is a game where players don’t have access to all the important information.
![unbeatable chess ai unbeatable chess ai](https://content.instructables.com/ORIG/FVP/W9SG/JACTVNPI/FVPW9SGJACTVNPI.jpg)
Versions of poker AI have been able to beat top human players in heads-up no-limit hold’em since 2017, when one called Libratus took down a group of elite poker pros. The bot is apparently even stronger than the 2019 poker AI called Pluribus.
![unbeatable chess ai unbeatable chess ai](https://i.imgur.com/QHmfzbh.png)
Similar to the AlphaZero program that has revolutionized the chess world to some extent, the new bot called ReBeL (short for Recursive Belief-based Learning) can achieve superhuman performance in heads-up no-limit hold’em through “self-play reinforcement learning.” Researchers at Facebook published a paper last week on a new poker AI that is apparently the most sophisticated to date and one that poses the greatest risk yet involving online poker play.