Stockfish 13 vs Lc0 0.27.0 Net 69104 (TC= 30m+30s) (48 Games)

Stockfish 13 vs Lc0 0.27.0 Net 69104 (TC= 30m+30s) (48 Games)

Hardware Threadripper 2950x, RTX 2080 TI, SSD 2 TB Evo 970 Plus.
Perfect Book 2021 to 6 Moves.

7 Man Table bases.
8 GB Hash
32 Threads For Stockfish.
Lc0 NN = 69104

Current results. Stockfish 13 has not lost a game in the last 2 weeks of testing. Except when testing SF vs SF. Amazing run of games for Stockfish 13. Stockfish 13 was able to snag a game away for Lc0 with the latest net. Now +1 after 13 games played.

Score of Stockfish 13 vs Lc0 0.27.0: 1 - 0 - 12 [0.538]
... Stockfish 13 playing White: 0 - 0 - 7 [0.500] 7
... Stockfish 13 playing Black: 1 - 0 - 5 [0.583] 6
... White vs Black: 0 - 1 - 12 [0.462] 13
Elo difference: 26.8 +/- 50.9, LOS: 84.1 %, DrawRatio: 92.3 %
13 of 48 games finished.

And SF13 probably would have a higher rating in rating lists if it had not to play many of its derivatives.

Current results after 32 games.

Score of Stockfish 13 vs Lc0 0.27.0: 1 - 0 - 31 [0.516]
... Stockfish 13 playing White: 0 - 0 - 16 [0.500] 16
... Stockfish 13 playing Black: 1 - 0 - 15 [0.531] 16
... White vs Black: 0 - 1 - 31 [0.484] 32
Elo difference: 10.9 +/- 21.0, LOS: 84.1 %, DrawRatio: 96.9 %
32 of 48 games finished.

mwyoung wrote:

Current results after 32 games.

Score of Stockfish 13  vs Lc0 0.27.0: 1 - 0 - 31 [0.516]
...      Stockfish 13  playing White: 0 - 0 - 16  [0.500] 16
...      Stockfish 13  playing Black: 1 - 0 - 15  [0.531] 16
...      White vs Black: 0 - 1 - 31  [0.484] 32
Elo difference: 10.9 +/- 21.0, LOS: 84.1 %, DrawRatio: 96.9 %
32 of 48 games finished.

Why not use the 50 gambit positions?

Just to be consistent. And this is how I always test. And I do not believe in using sub par openings to drop the draw ratio. If a engine is close in strength, and very strong it will draw, as chess is "drawish".

Stockfish will crush other engines with these exact openings. So it is not a opening issue. Lc0 is just close to Stockfish 13 in strength again.

End of match. Time to test new improved Stockfish net.

Score of Stockfish 13  vs Lc0 0.27.0: 1 - 0 - 36 [0.514]
...      Stockfish 13  playing White: 0 - 0 - 19  [0.500] 19
...      Stockfish 13  playing Black: 1 - 0 - 17  [0.528] 18
...      White vs Black: 0 - 1 - 36  [0.486] 37
Elo difference: 9.4 +/- 18.2, LOS: 84.1 %, DrawRatio: 97.3 %
37 of 48 games finished.

Info on the NNUE Stockfish Net.

New NNUE architecture and net

Introduces a new NNUE network architecture and associated network parameters,
as obtained by a new pytorch trainer.

The network is already very strong at short TC, without regression at longer TC,
and has potential for further improvements.

https://tests.stockfishchess.org/tests/view/60a159c65085663412d0921d
TC: 10s+0.1s, 1 thread
ELO: 21.74 +-3.4 (95%) LOS: 100.0%
Total: 10000 W: 1559 L: 934 D: 7507 Elo +21.74
Ptnml(0-2): 38, 701, 2972, 1176, 113

https://tests.stockfishchess.org/tests/view/60a187005085663412d0925b
TC: 60s+0.6s, 1 thread
ELO: 5.85 +-1.7 (95%) LOS: 100.0%
Total: 20000 W: 1381 L: 1044 D: 17575 Elo +5.85
Ptnml(0-2): 27, 885, 7864, 1172, 52

https://tests.stockfishchess.org/tests/view/60a2beede229097940a03806
TC: 20s+0.2s, 8 threads
LLR: 2.93 (-2.94,2.94) <0.50,3.50>
Total: 34272 W: 1610 L: 1452 D: 31210 Elo +1.60
Ptnml(0-2): 30, 1285, 14350, 1439, 32