![]() It would crush Stockfish 8 alright, but not Stockfish Dev. Leela, playing against Stockfish Dev (which is even better than Stockfish 10 - the engine is continuously updated) and not Stockfish 8, could be as good as AlphaZero yet fail to crush Stockfish. On the other hand Stockfish 10 is better than Stockfish 8 by ~100 elo. Both these versions of Stockfish are old, and significantly inferior to the latest version of Stockfish.ĪlphaZero beat Stockfish 8 by +155 -6 =839. If you read the paper, AlphaZero beat Stockfish 8 (it also played a series against Stockfish 9 - same logic applies however). This is happening because AlphaZero and Leela aren't playing against the same Stockfish. More like double the time, really, if the training games are being diverted towards two separate runs. But at this speed, it'll still take a month to achieve what DeepMind achieved in 9 hours. As of January 14, 2019, it looks like the project is generating about 1.5 million games per day. These days, the self-play generation speed is much faster than it was at the beginning. It may be more comparable to AlphaZero, as AlphaZero operated on 4.8 million nodes per move, whereas a conventional setup only gets a small fraction of that. "Leela Max" is Leela's theoretical maximum performance when given hardware and/or time to the point of absolute diminished returns. For example, here's the graph from the first old main run (under the "Graphs" tab):įrom that link, an explanation of what "Leela Max" is: There are lots of calculations and graphs in this spreadsheet here that compares lc0's performance with AlphaZero. There were also a number of bootstrap mini-resets during the original main run to fix some critical bugs, and there was also a temporary test35 to test the newly revealed configuration settings from the December 2018 AlphaGo paper. Here's what the graph looks like for the entire Lc0 project as of Janu(note that this is self-play Elo, which is inflated compared to actual Elo):Īs you can see, they've reset the training run many times. To get a sense of how well Lc0 is doing compared to AlphaZero, it's more useful to look at the Elo with respect to total number of games generated, not time elapsed. As of January 14, 2019, the best net was ID40202.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |