Release Rebel 15

1. New and stronger neural network made from 1.87 billion positions.

2. Estimated strength increase over Rebel 14.2 emulating CCRL 40/2 testing in the range of 80-130 elo.

3. See the Rebel 15 development diary for details.

4. NNUE tuner parameter in Engine Settings. Default setting now 70%.

5. For the moment Rebel 15 is only available as AVX2 engine. It has to be seen if we are still able to provide a weaker SSE version for older computers. NNUE evaluation strongly relies on the AVX2 instruction set and there might come a moment older computers become an obstacle to progress.

....

http://rebel13.nl/windows/rebel-15.html

current tests for CEGT 40/4:

Rebel 15.0NN x64 1CPU

LC0 0.28.2 DX12 Vega11 771721  3500  00,0  xxxx [W.B.]
SlowChess Blitz 2.6NN x64      3435  34,0  3320 [W.B.]
Komodo 13.02 x64 1CPU          3340  42,0  3284 [W.B.]
Clover 3.1NN x64 1CPU          3300  49,5  3297 [W.B.]
Wasp 5.50NN x64 1CPU           3263  47,5  3246 [W.B.]
Velvet 3.3.0NN x64 1CPU        3203  60,5  3275 [W.B.]
Weiss 2.0 x64 1CPU             3175  58,0  3231 [W.B.]
Combusken 2.0.0NN x64 1CPU     3174  57,0  3222 [W.B.]
Black Marlin 5.0NN x64 1CPU    3155  69,0  3294 [W.B.]
Ginkgo 2.18 x64 1CPU           3152  00,0  xxxx [W.B.]
Fritz 18NN x64 1CPU            3255  47,0  3234 [J.B.]
Tucano 10.00NN x64 1CPU        3282  52,5  3299 [J.B.]
Arasan 23.3NN x64 1CPU         3344  40,0  3274 [J.B.]
Hiarcs 15 x64 1CPU             3174  61,0  3252 [J.B.]
Booot 6.5 x64 1CPU             3224  52,0  3238 [J.B.]
Komodo 12.1.1 x64 1CPU         3335  00,0  xxxx [J.B.]
.
running...

Performance = ca. 3266 / 1300 games => +75 to v14.2 (3191 / 3300 games)

Thanks for info. I was hoping for more. But as with the words of Mick Jagger, you can't always get what you want  

Of course, the test is not over, it continues, Rebel 15 will be tested by us in the future. Especially against nominally much stronger engines, Rebel 15 looks much stronger. The test opponents include many absolutely current versions, but I also take Booot 6.5 and Komodo 12.1.1, which have already played a lot of games in this list, as "anchor engines" in the test run to get as correct a result as possible.

Ratinglist-testrun of Rebel 15 finished.


https://www.sp-cc.de


See also my EAS-Ratinglist (The world's first engine-ratinglist not measuring strength of engines but engines's style of play):
https://www.sp-cc.de/eas-ratinglist.htm
IMO, Rebel plays not yet as aggressive, as Ed wants Rebel to play...The EAS-Score is not real bad, but definitly not very impressive.

(Perhaps you have to clear your browsercache or reload the website)

pohl4711 wrote:

Ratinglist-testrun of Rebel 15 finished.


https://www.sp-cc.de


See also my EAS-Ratinglist (The world's first engine-ratinglist not measuring strength of engines but engines's style of play):
https://www.sp-cc.de/eas-ratinglist.htm
IMO, Rebel plays not yet as aggressive, as Ed wants Rebel to play...The EAS-Score is not real bad, but definitly not very impressive.

(Perhaps you have to clear your browsercache or reload the website)

Hi Stephan,

Tried the aggressiveness tool just now with Chess System Tal (download and operation was very easy, thanks!)

using 5000 games at 40/120 Frank Quisinsky openings and cutechess, it produced the below, in maybe 20 seconds or so. Not sure if this is good or bad result, but it occurred that perhaps the stats for very short won games are dependent on game termination conditions given to CuteChess?

Rank EAS-Score sacs shorts Engine/player
-----------------------------------------------------------------------------
001 011130 19.02% 20.73% "Chess-System-Tal-NNUE-1.31-TEST"
002 004549 05.34% 08.39% "Stockfish_11"
003 003775 14.49% 04.34% "SlowChess_2.8"
004 001856 09.27% 06.18% "Stockfish_10"
005 000978 07.99% 01.33% "Koivisto_7.0"
006 000234 01.81% 01.81% "Berserk_7"

Also appended the 'shorts and sacs' file for reference.

Code:

*****************************************************************************
*** Engine Aggressiveness Tool V1.7 Score points Ratinglist
*****************************************************************************
Score is: (percent*10) of the percent-values of the sacs (1-5+ pawnunits)
calculated out of the won games by the engine, only.
So, a weak engine (with a small number of won games) can get
a high EAS-scoring, too, when the percent of sac-games in the won games
is high (and the number of short wins). Higher pawnunits-sacs give bonus-points:
1 pawnsac = 3x points  *** 2 pawnsac  = 10x points *** 3 pawnsac = 25x points
4 pawnsac = 50x points *** 5+ pawnsac = 100x points
Additionally, very short won games (percent*10) give bonus-points, when they
ended before endgame (a check for low material is done):
60 moves= 3x points  *** 55 moves= 10x points *** 50 moves= 25x points
45 moves= 50x points *** 40 moves= 100x points.  
*****************************************************************************
*** Evaluated file: all.pgn ***
*****************************************************************************
Rank   EAS-Score   sacs  shorts   Engine/player
-----------------------------------------------------------------------------
001     011130    19.02% 20.73%  "Chess-System-Tal-NNUE-1.31-TEST"
002     004549    05.34% 08.39%  "Stockfish_11"
003     003775    14.49% 04.34%  "SlowChess_2.8"
004     001856    09.27% 06.18%  "Stockfish_10"
005     000978    07.99% 01.33%  "Koivisto_7.0"
006     000234    01.81% 01.81%  "Berserk_7"
*****************************************************************************
*****************************************************************************
*****************************************************************************
*** 2nd Ratinglist with all stat-values (wins/sacs/short-wins before endgame)
*****************************************************************************
Rank   EAS-Score  Number of wins/sacs/short-wins
-----------------------------------------------------------------------------
001     011130    wins:1109 ** sacs5+:2 sacs4:8 sacs3:10 sacs2:59 sacs1:132 ** short40:59 short45:60 short50:55 short55:32 short60:24 "Chess-System-Tal-NNUE-1.31-TEST"
002     004549    wins:131 ** sacs5+:0 sacs4:0 sacs3:0 sacs2:0 sacs1:7 ** short40:4 short45:3 short50:1 short55:1 short60:2 "Stockfish_11"
003     003775    wins:69 ** sacs5+:0 sacs4:0 sacs3:0 sacs2:2 sacs1:8 ** short40:2 short45:0 short50:1 short55:0 short60:0 "SlowChess_2.8"
004     001856    wins:97 ** sacs5+:0 sacs4:0 sacs3:0 sacs2:1 sacs1:8 ** short40:1 short45:0 short50:1 short55:2 short60:2 "Stockfish_10"
005     000978    wins:75 ** sacs5+:0 sacs4:1 sacs3:0 sacs2:0 sacs1:5 ** short40:0 short45:0 short50:0 short55:1 short60:0 "Koivisto_7.0"
006     000234    wins:55 ** sacs5+:0 sacs4:0 sacs3:0 sacs2:0 sacs1:1 ** short40:0 short45:0 short50:0 short55:1 short60:0 "Berserk_7"
****************************************************
*** EAS-tool (C) 2022 Stefan Pohl (www.sp-cc.de) ***
****************************************************

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "439"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Berserk_7"]
[Result "0-1"]
[ECO "D00"]
[Opening "Levitsky attack (Queen's Bishop attack)"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "101"]
[GameDuration "00"]
[GameEndTime "2022-05-04T07.837 W. Europe Summer Time"]
[GameStartTime "2022-05-04T07.577 W. Europe Summer Time"]

1. d4 d5 2. Bg5 Nf6 3. Nc3 Bf5 4. f3 Nbd7 5. Qd2 e6 6. e3 Be7 7. g4 Bg6 8.
Bf4 O-O 9. O-O-O c5 10. h4 h5 11. Kb1 Rc8 12. Bd3 Bxd3 13. cxd3 cxd4 14.
exd4 Qb6 15. Nge2 hxg4 16. fxg4 Nxg4 17. Rdf1 f5 18. h5 Rf7 19. Bg5 Bb4 20.
Ka1 Nf8 21. Rhg1 Qc6 22. Qe1 b5 23. Qg3 Bd6 24. Bf4 Bxf4 25. Nxf4 b4 26.
Nce2 Qb6 27. Kb1 b3 28. a3 Rc2 29. Rc1 a5 30. Rge1 a4 31. Qh4 Rfc7 32. Ng6
Qd6 33. Rxc2 Rxc2 34. Nxf8 Qxf8 35. Qg3 Kh7 36. h6 Nxh6 37. Qe5 f4 38. Rf1
f3 39. Nc3 f2 40. Qe3 Qf5 41. Nd1 Ng4 42. Qh3+ Kg6 43. Qg3 Qg5 44. Nxf2
Nxf2 45. Qb8 Rxb2+ 46. Ka1 Ra2+ 47. Kb1 Qf5 48. Qg3+ Qg4 49. Qxg4+ Nxg4 50.
Rf3 Nf2 51. Re3 0-1

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "628"]
[White "Berserk_7"]
[Black "Chess-System-Tal-NNUE-1.31-TEST"]
[Result "1-0"]
[ECO "B33"]
[Opening "Sicilian defense"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "152"]
[GameDuration "00"]
[GameEndTime "2022-05-04T10.118 W. Europe Summer Time"]
[GameStartTime "2022-05-04T10.853 W. Europe Summer Time"]

1. e4 c5 2. Nf3 Nc6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 d6 6. Bg5 e6 7. Qd2 a6 8.
O-O-O Bd7 9. f3 Qa5 10. Be3 Be7 11. Kb1 b5 12. Nxc6 Bxc6 13. g4 Nd7 14. g5
Qc7 15. h4 Ne5 16. f4 Ng4 17. Bd4 b4 18. Nd5 exd5 19. Bxg7 Rg8 20. exd5 Bd7
21. Bd4 Qb7 22. Bd3 h5 23. Rhe1 Kd8 24. f5 Re8 25. g6 f6 26. Qf4 Rc8 27.
Be2 Ne5 28. Rg1 Bb5 29. Bxb5 Qxb5 30. Bxe5 dxe5 31. Qh6 Bc5 32. Rg2 Qb7 33.
Qxh5 Bf8 34. Qg4 e4 35. g7 Qxg7 36. Qxg7 Bxg7 37. Rxg7 e3 38. Rg6 Rc4 39.
Rxf6 Rxh4 40. Re1 Re5 41. Rxa6 Rf4 42. f6 e2 43. Kc1 Rf1 44. Kd2 Rxd5+ 45.
Kxe2 Rff5 46. Re6 Kd7 47. Re4 Rxf6 48. Rd1 Rxd1 49. Kxd1 Rb6 50. Kd2 Kd6
51. Rc4 Kd5 52. b3 Ke5 53. Kc1 Kd6 54. Kb2 Rb7 55. a3 bxa3+ 56. Kxa3 Ra7+
57. Kb4 Ra8 58. Kb5 Kd5 59. Kb6 Rb8+ 60. Ka7 Rb5 61. Rc8 Rb4 62. Ka6 Rf4
63. Ka5 Ke5 64. b4 Rf1 65. b5 Rb1 66. Ka6 Ra1+ 67. Kb7 Rb1 68. b6 Kd5 69.
c4+ Kd4 70. Rc6 Rg1 71. Ka7 Ra1+ 72. Kb8 Kc3 73. b7 Re1 74. Ka7 Ra1+ 75.
Kb6 Rb1+ 76. Kc7 Kc2 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "9"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Stockfish_10"]
[Result "1-0"]
[ECO "A45"]
[Opening "Queen's pawn game"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "90"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.722 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.116 W. Europe Summer Time"]

1. d4 Nf6 2. Nc3 c5 3. d5 d6 4. e4 g6 5. f4 Bg7 6. Bb5+ Nfd7 7. a4 Na6 8.
Nf3 Nc7 9. Be2 O-O 10. O-O a6 11. f5 Nf6 12. Qe1 gxf5 13. Qh4 Bd7 14. Bh6
Nce8 15. Ng5 Qb6 16. Rab1 Qb4 17. Kh1 Qd4 18. Rbd1 Qb4 19. Rd3 Nxe4 20.
Bxg7 Nxg5 21. Qxg5 Nxg7 22. Qh6 f4 23. Rxf4 Bf5 24. Rxb4 cxb4 25. Nd1 Bxd3
26. Bxd3 f5 27. g4 Rf6 28. Qh4 b5 29. a5 h5 30. gxf5 b3 31. c3 Rc8 32. Ne3
Rc7 33. Kg2 Rc8 34. Kf1 Rf7 35. Ke2 Rf6 36. Qe4 Rc7 37. Ng2 Kf7 38. Qh4 Rc8
39. Nf4 Rg8 40. Qh3 Ke8 41. Ne6 Kf7 42. Qf3 Ke8 43. Qg3 h4 44. Qg1 Kf7 45.
Ng5+ Ke8 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "11"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Koivisto_7.0"]
[Result "1-0"]
[ECO "D86"]
[Opening "Gruenfeld"]
[Variation "Exchange, Classical Variation"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "88"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.374 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.280 W. Europe Summer Time"]

1. d4 Nf6 2. c4 g6 3. Nc3 d5 4. cxd5 Nxd5 5. e4 Nxc3 6. bxc3 Bg7 7. Bc4 c5
8. Ne2 O-O 9. O-O Nc6 10. Be3 Qc7 11. Rc1 Rd8 12. Qa4 Bd7 13. Qa3 Bf8 14.
h4 a6 15. Qb2 b5 16. Bd3 e5 17. d5 Na5 18. f4 Bh6 19. Qd2 Nb7 20. h5 Rf8
21. f5 Bxe3+ 22. Qxe3 c4 23. Qh6 f6 24. hxg6 Bxf5 25. exf5 cxd3 26. Ng3 Qg7
27. Qh3 Nd6 28. Nh5 Qa7+ 29. Kh2 e4 30. Rce1 Qd7 31. Qg4 Qc7 32. Kh1 Ra7
33. Re3 hxg6 34. fxg6 f5 35. g7 Qxg7 36. Qf4 Qe7 37. Rg3+ Kh7 38. Rg7+ Qxg7
39. Nxg7 Kxg7 40. Qxd6 Raa8 41. Qe7+ Kh6 42. g4 f4 43. g5+ Kg6 44. Qe6+ Kg7
1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "11"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "SlowChess_2.8"]
[Result "1-0"]
[ECO "B20"]
[Opening "Sicilian"]
[Variation "Keres Variation (2.Ne2)"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "112"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.323 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.452 W. Europe Summer Time"]

1. e4 c5 2. Ne2 Nc6 3. Nbc3 e6 4. d4 cxd4 5. Nxd4 d6 6. Be3 Nf6 7. Bc4 Be7
8. Qe2 O-O 9. O-O-O Qc7 10. Rhg1 a6 11. g4 g6 12. g5 Nh5 13. a3 b5 14. Ba2
Nxd4 15. Rxd4 Re8 16. Qd3 Rb8 17. Rf1 Bf8 18. f4 Qb7 19. Rxd6 Bxd6 20. Qxd6
b4 21. axb4 Qxb4 22. Qxb4 Rxb4 23. Bc5 Rb7 24. e5 Bd7 25. Ne4 Ra8 26. Nd6
Rc7 27. Bb6 Rc6 28. Ba5 Rc5 29. Bd2 a5 30. b3 Ng7 31. c4 Rc7 32. Kb2 h6 33.
gxh6 Nf5 34. Bb1 Nxh6 35. Bd3 Bc6 36. Ra1 Rca7 37. Be3 Ra6 38. Bc5 Kg7 39.
h4 Bf3 40. Rf1 Bg4 41. Be4 Rb8 42. Ra1 Nf5 43. b4 Ng3 44. Bg2 Be2 45. Kb3
a4+ 46. Kc3 Bg4 47. b5 Ne2+ 48. Kc2 Ra5 49. Bb7 a3 50. Bb6 Raa8 51. Bxa8
Rxa8 52. Be3 Ng3 53. Kb3 Nf5 54. Nxf5+ Bxf5 55. Rxa3 Rb8 56. Kb4 Kh6 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "15"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Koivisto_7.0"]
[Result "1-0"]
[ECO "B43"]
[Opening "Sicilian"]
[Variation "Kan, 5.Nc3"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "72"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.392 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.482 W. Europe Summer Time"]

1. e4 c5 2. Nf3 e6 3. d4 cxd4 4. Nxd4 a6 5. Nc3 Qc7 6. Bd3 Nf6 7. O-O d6 8.
f4 Nbd7 9. a4 b6 10. Qe2 Bb7 11. g4 d5 12. e5 Bc5 13. Be3 Ne4 14. Qg2 Nxc3
15. bxc3 O-O 16. Rf3 g6 17. Raf1 Bc6 18. Qg3 Rfe8 19. Kh1 Bxa4 20. h4 Bb5
21. h5 Bxd3 22. cxd3 Rac8 23. hxg6 fxg6 24. Bd2 Bxd4 25. cxd4 Nf8 26. f5 a5
27. Qh4 Qd7 28. Qe1 Ra8 29. Bh6 a4 30. Qf2 exf5 31. gxf5 a3 32. e6 Qd6 33.
Re3 g5 34. Bxg5 Ra7 35. Bh6 Kh8 36. Bf4 Qd8 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "23"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Stockfish_11"]
[Result "1-0"]
[ECO "A10"]
[Opening "English Opening"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "86"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.950 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.450 W. Europe Summer Time"]

1. c4 g6 2. e4 Bg7 3. d4 d6 4. Nc3 Nf6 5. Be2 O-O 6. Nf3 e5 7. O-O Nc6 8.
d5 Ne7 9. b4 Nh5 10. c5 Nf4 11. Bxf4 exf4 12. Rc1 h6 13. h3 a6 14. a4 g5
15. Nd4 c6 16. Nb3 Re8 17. a5 Rb8 18. Bf3 Bd7 19. cxd6 Nc8 20. dxc6 Bxc6
21. e5 Rxe5 22. Bxc6 bxc6 23. d7 Ne7 24. Nc5 Rxb4 25. Re1 Rxe1+ 26. Qxe1
Kf8 27. N3e4 Rb5 28. Rd1 Be5 29. Nb7 Rxb7 30. Nc5 Bd4 31. Rxd4 Rb5 32. Qe5
Ng6 33. Qd6+ Kg7 34. Rd1 f3 35. Nxa6 Ne5 36. Nc7 Nxd7 37. Nxb5 Qxa5 38.
Qxd7 Qxb5 39. Qd4+ Kg6 40. Qh8 Qb4 41. Qg8+ Kf6 42. Qh7 Qf8 43. g4 Qc5 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "27"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Koivisto_7.0"]
[Result "1-0"]
[ECO "A56"]
[Opening "Benoni defense"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "66"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.777 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.676 W. Europe Summer Time"]

1. d4 Nf6 2. c4 c5 3. e3 cxd4 4. exd4 e6 5. Nc3 d5 6. a3 dxc4 7. Bxc4 Be7
8. Nf3 O-O 9. O-O Qc7 10. Bd3 Nc6 11. Bg5 Rd8 12. Rc1 a6 13. Bb1 h6 14. Be3
Bd7 15. Re1 Be8 16. Qd3 Rac8 17. h4 Qd6 18. Rcd1 Qc7 19. d5 Ra8 20. Qc2 Na7
21. Bd4 Nb5 22. Be5 Qa5 23. Bxf6 Bxf6 24. Qh7+ Kf8 25. Ne4 Bxb2 26. Ng3 Nd6
27. Ba2 Ba4 28. Rb1 Bc3 29. dxe6 fxe6 30. Rxe6 Nf7 31. h5 Rac8 32. Nh4 Bc2
33. Ng6+ Bxg6 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "29"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Berserk_7"]
[Result "1-0"]
[ECO "A00"]
[Opening "Benko's Opening"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "58"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.148 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.710 W. Europe Summer Time"]

1. g3 d5 2. f4 c6 3. Nf3 Bg4 4. Bg2 Nd7 5. O-O e6 6. d3 Ngf6 7. Kh1 Bb4 8.
a3 Ba5 9. Nbd2 O-O 10. Qe1 Bxf3 11. Bxf3 e5 12. e4 Re8 13. f5 h6 14. g4
dxe4 15. dxe4 Nh7 16. Qg3 Bb6 17. Be2 Rc8 18. h4 Nc5 19. b4 Na4 20. Rb1 Bd4
21. Rb3 Rc7 22. g5 hxg5 23. hxg5 Nxg5 24. f6 Ne6 25. Rbf3 Bb2 26. Bc4 g6
27. Qh4 Nf4 28. Rg3 Re6 29. Bxe6 Qd5 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "29"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "SlowChess_2.8"]
[Result "1-0"]
[ECO "A13"]
[Opening "English Opening"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "112"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.591 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.164 W. Europe Summer Time"]

1. c4 e6 2. Nc3 d5 3. e3 Nf6 4. Nf3 Bd6 5. b3 O-O 6. Bb2 b6 7. g3 c5 8. Bg2
Bb7 9. O-O dxc4 10. bxc4 Nc6 11. d3 Qd7 12. Qe2 Rad8 13. Rad1 Be7 14. h3 h6
15. Kh2 Qc7 16. Ne1 a6 17. f4 Ne8 18. Ba1 Nd6 19. Ne4 Ne8 20. Rb1 b5 21.
Rg1 f5 22. Nd2 b4 23. a3 a5 24. axb4 axb4 25. Nb3 Nf6 26. Bb2 Rb8 27. Ra1
Ra8 28. Rxa8 Bxa8 29. Nf3 Bb7 30. Nh4 Kh7 31. d4 g5 32. Nf3 g4 33. Nfd2 Na5
34. Nxa5 Bxg2 35. Qxg2 Qxa5 36. Qb7 Qd8 37. Ra1 Qd7 38. Qxd7 Nxd7 39. Ra7
Rd8 40. hxg4 Kg6 41. gxf5+ exf5 42. Nf3 Kf7 43. Ne5+ Ke8 44. Kg2 Bd6 45.
Ra6 Be7 46. d5 Nf6 47. Kf3 Rd6 48. Ra8+ Rd8 49. Ra7 Rd6 50. Nc6 Bd8 51.
Bxf6 Bxf6 52. Rb7 h5 53. Rb5 Bc3 54. Rxc5 b3 55. Rb5 b2 56. Ke2 Rg6 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "41"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Stockfish_10"]
[Result "1-0"]
[ECO "C16"]
[Opening "French"]
[Variation "Winawer, Advance Variation"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "72"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.849 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.856 W. Europe Summer Time"]

1. e4 e6 2. d4 d5 3. Nc3 Bb4 4. e5 b6 5. a3 Bf8 6. h4 Ne7 7. h5 h6 8. Nce2
c5 9. c3 Nbc6 10. Nf4 c4 11. Be2 Na5 12. Be3 Nf5 13. Ngh3 Be7 14. O-O Nb3
15. Rb1 O-O 16. g4 Nxe3 17. fxe3 Ba6 18. Qc2 Bb7 19. Bf3 a5 20. Qg2 b5 21.
Bd1 b4 22. Bc2 Kh8 23. Rf3 Bc6 24. Rbf1 Rg8 25. Bb1 Na1 26. Bg6 Be8 27.
Rxa1 fxg6 28. hxg6 bxa3 29. bxa3 Ra6 30. g5 Rf8 31. gxh6 Rf5 32. hxg7+ Kxg7
33. Kh1 Bd7 34. Nf2 Bh4 35. Rh3 Rxf4 36. exf4 Bc6 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "41"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "SlowChess_2.8"]
[Result "1-0"]
[ECO "A10"]
[Opening "English"]
[Variation "Anglo-Dutch defense"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "114"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.436 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.051 W. Europe Summer Time"]

1. c4 f5 2. Nf3 Nf6 3. Nc3 g6 4. g3 Bg7 5. Bg2 O-O 6. d4 d6 7. O-O c6 8.
Qb3 Na6 9. Rd1 Nc7 10. d5 c5 11. Re1 Bd7 12. a4 e6 13. dxe6 Nxe6 14. Ng5
Nd4 15. Qd1 h6 16. Nf3 Ne6 17. Nh4 Be8 18. Ra3 Nd4 19. e3 Ne6 20. e4 fxe4
21. Nxe4 Nd4 22. Be3 Bf7 23. Rd3 Nxe4 24. Bxe4 Qd7 25. b3 Rad8 26. Qd2 Kh7
27. Bxd4 Bxd4 28. Nf3 Bf6 29. h4 Kg7 30. Bd5 Rfe8 31. Rxe8 Bxe8 32. Re3 Bf7
33. Bxf7 Qxf7 34. Rd3 Qe6 35. Kg2 b6 36. Rd5 Rd7 37. h5 g5 38. Qd3 Qe8 39.
Qf5 Qf7 40. Nh2 Be5 41. Qg4 Bf6 42. Nf1 Kh8 43. Rf5 Re7 44. Ne3 Re5 45. Qf3
Re6 46. Nd5 Kg7 47. Qg4 Qe8 48. Rf3 Bd8 49. Re3 Rxe3 50. Nxe3 Kg8 51. Qc8
a6 52. Nf5 Qe4+ 53. Kh2 Qe8 54. Nxd6 Qe7 55. Nb7 Qf7 56. Kg2 Kg7 57. Nxd8
Qe7 1-0

[Event "?"]
[Site "?"]
[Date "2022.05.04"]
[Round "41"]
[White "Chess-System-Tal-NNUE-1.31-TEST"]
[Black "Stockfish_11"]
[Result "1-0"]
[ECO "E98"]
[Opening "King's Indian"]
[Variation "Orthodox, Aronin-Taimanov, 9.Ne1"]
[TimeControl "40/120"]
[Termination "adjudication"]
[PlyCount "106"]
[GameDuration "00"]
[GameEndTime "2022-05-04T02.872 W. Europe Summer Time"]
[GameStartTime "2022-05-04T02.988 W. Europe Summer Time"]

1. d4 Nf6 2. c4 g6 3. Nc3 Bg7 4. e4 d6 5. Nf3 O-O 6. Be2 e5 7. O-O Nc6 8.
d5 Ne7 9. Ne1 Nd7 10. Nd3 f5 11. Bd2 Nf6 12. f3 Kh8 13. a4 a5 14. b4 axb4
15. Nxb4 Nh5 16. Nd3 Nf4 17. a5 g5 18. Kh1 Rf6 19. Nf2 Rh6 20. Re1 Qe8 21.
exf5 Nxf5 22. Nce4 c6 23. Bf1 Nd4 24. Rb1 Qf8 25. dxc6 bxc6 26. Nxg5 Rg6
27. Nge4 Be6 28. Rb6 Qe7 29. a6 d5 30. cxd5 cxd5 31. Ng3 Qh4 32. Qb1 Rf8
33. Ng4 Bxg4 34. fxg4 Qxg4 35. Rb8 Rh6 36. Re3 Nc6 37. Rxf8+ Bxf8 38. a7
Nxa7 39. Qb8 Kg8 40. Qxa7 Qh4 41. h3 Re6 42. Rf3 Qe7 43. Qa8 Qe8 44. Qa2
Kh8 45. Qb2 Ng6 46. Be2 Qc6 47. Nh5 Qb6 48. Qa1 Qb8 49. Bg5 Qb7 50. Rf1 h6
51. Bg4 Ra6 52. Bf6+ Kh7 53. Qd1 Bd6 1-0

Update after 1900 games:

Rebel 15.0NN x64 1CPU

LC0 0.28.2 DX12 Vega11 771721  3500  00,0  xxxx [W.B.]
SlowChess Blitz 2.6NN x64      3435  34,0  3320 [W.B.]
Komodo 13.02 x64 1CPU          3344  42,0  3288 [W.B.]
Clover 3.1NN x64 1CPU          3300  49,5  3297 [W.B.]
Wasp 5.50NN x64 1CPU           3263  47,5  3246 [W.B.]
Velvet 3.3.0NN x64 1CPU        3203  60,5  3275 [W.B.]
Weiss 2.0 x64 1CPU             3175  58,0  3231 [W.B.]
Combusken 2.0.0NN x64 1CPU     3174  57,0  3222 [W.B.]
Black Marlin 5.0NN x64 1CPU    3155  69,0  3294 [W.B.]
Ginkgo 2.18 x64 1CPU           3152  00,0  xxxx [W.B.]
Fritz 18NN x64 1CPU            3255  47,0  3234 [J.B.]
Tucano 10.00NN x64 1CPU        3282  52,5  3299 [J.B.]
Arasan 23.3NN x64 1CPU         3344  40,0  3274 [J.B.]
Hiarcs 15 x64 1CPU             3174  61,0  3252 [J.B.]
Booot 6.5 x64 1CPU             3224  52,0  3238 [J.B.]
Komodo 12.1.1 x64 1CPU         3335  42,0  3279 [J.B.]
Xiphos 0.6 x64 1CPU            3234  51,0  3241 [J.B.]
Ethereal 12.75 x64 1CPU        3324  42,0  3268 [J.B.]
Revenge 1.0NN x64 1CPU         3367  40,5  3300 [J.B.]
Rubichess 20220223NN x64 1CPU  3437  27,5  3269 [J.B.]
LCZero 0.28.2 771721 DNNL CPU  3214  57,0  3263 [J.B.]
.
running...

Performance = ca. 3267 / 1900 games => +76 to v14.2 (3191 / 3300 games)

Thanks for testing Stefan.

Regarding your new rating list, lots of fun BTW, I did some tests myself and noticed that a comparison only makes sense between engines of similar strength, or with a margin of say ~50 elo. Consider Stockfish playing Fruit 2.1 and it will be obvious Stockfish will score high and Fruit scores zero because Fruit is out-searched.

How did you tackle this problem?

Admin wrote:

Thanks for testing Stefan.

Regarding your new rating list, lots of fun BTW, I did some tests myself and noticed that a comparison only makes sense between engines of similar strength, or with a margin of say ~50 elo. Consider Stockfish playing Fruit 2.1 and it will be obvious Stockfish will score high and Fruit scores zero because Fruit is out-searched.

How did you tackle this problem?

In my SPCC ratinglist, I test all engines only versus engines, which are not too much weaker or too much stronger. Testing with too big strength-differences never makes sense, IMO.
So, the EAS-ratinglist, which is build out of the SPCC-ratinglist games do not have this problem. And mention this from the description: "Because a weaker player can be playing aggressive, too, the EAS-Score (= Engine Aggressivenes Score, see explanation below) and all other statistics are build on percents from the won games of an engine/player. So, if an engine has won more games, it must win more short games or win games with sacrifices. A weaker engine, which has won less games, need less wins of short games or win games with sacrifices."
This works fine. As you can see, Danasah (for example) has a very high EAS-score (ranking 2) and it is a weak engine in my SPCC-ratinglist (ranking 36).

The best way to use the EAS-ratinglist-tool, would be (of course) a RoundRobin of engines, with all engines playing the same number of games vs. all other engines.

Chris Whittington wrote:

Hi Stephan,

Tried the aggressiveness tool just now with Chess System Tal (download and operation was very easy, thanks!)
using 5000 games at 40/120 Frank Quisinsky openings and cutechess, it produced the below, in maybe 20 seconds or so. Not sure if this is good or bad result, but it occurred that perhaps the stats for very short won games are dependent on game termination conditions given to CuteChess?

Yes, of course. The tool looks for the length of the games (and considers, they ended in the middlegame (material-limit-check)). So, comparing results of different tests makes no sense, if one test contains games until mate and the other contains games ended by GUI, when a bad eval of -8.00 or so is reached...In this case, you should look on the sacrifice-statistics, only.

For an engine developer, the EAS tool for one engine is recommended. The engine in development can play gauntlets vs. other engines. Then you use the EAS tool for one engine on the results. Then test the next dev-version of your engine vs. the same opponents (and with the same resign-rules, time etc.) and then you can compare the sacs-statistics and the short-game stats. The stats are more detailed in the one engine EAS tool. So, progress (or regress) of the engine (or nnue-net) in development in the aggressiveness can be measured easily...

I have run Rebel15 on the ERET test and I think the endgame-settings are wortwhile investigate further because Rebel15 tries hard but misses a lot solutions. This could be an indication for a weakness in tournament play.