Stockfish handicap match - PART II -

Subject: Stockfish handicap match - PART II - Fri May 14, 2021 11:26 am

About a year ago I did the Stockfish 11 handicap match on time control with stunning results. Times have changed, NNUE is the new normal. Time to give Stockfish 13 an even harder time, a handicap match based on material. We feed the beast with 7 positions down in material, invite 10 engines in the elo range ~2400-3200 and watch the slaughter.

Code:: . Stockfish 13 : Handicap Match

. Tournament : Gauntlet
. Time Control : 40 moves in 10 minutes repeating
. Games : 7 games each engine

. Opponents : elo range ~2400-3200
. Arasan 2.22
. Cheng 4.41
. Fruit 2.1
. Ethereal 12.75
. Foxsee 7.8
. Komodo 3
. ProDeo 3.1
. Senpai 1.0
. Texel 1.7
. Vajolet2 2.8
[code][/code]
. Software : Arena 3.0
. Hash table : Default setting engines

. Openings : handicap.epd
. rnbqkbnr/pppppppp/8/8/8/8/PPPP1PPP/RNBQKBNR w KQkq - c0 "-wpe2";
. rnbqkbnr/pppppppp/8/8/8/8/PPP2PPP/RNBQKBNR w KQkq - c0 "-wpe2 | wpd2";
. rnbqkbnr/pppppppp/8/8/8/8/PP3PPP/RNBQKBNR w KQkq - c0 "-wpe2 | wpd2 | wpc2";
. rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RN1QKBNR w KQkq - c0 "-wbc1";
. rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/R1BQKBNR w KQkq - c0 "-wnb1";
. rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/1NBQKBNR w Kkq - c0 "-wra1";
. rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNB1KBNR w KQkq - c0 "-wqd1"'

Live broadcast at - http://rebel13.nl/pgn4web-3.05/live-test.html

Last edited by Admin on Fri May 14, 2021 5:16 pm; edited 1 time in total

[pgn]
[puzzle]
[Setup "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPP1PPP/RNBQKBNR w KQkq -"]
[/puzzle]
[/pgn]

First 10 games, 8 - 2 for Stockfish

Code:: Name Gms : Win : Draw : Lose : Pts : S-B
SF13 10 : 6+ : 4= : 0- : 8.0 : 1.00
Arasan_2.22 1 : 0+ : 1= : 0- : 0.5 : 4.00
Cheng_4.41 1 : 0+ : 1= : 0- : 0.5 : 4.00
Ethereal_12.75 1 : 0+ : 1= : 0- : 0.5 : 4.00
Vajolet2_2.8 1 : 0+ : 1= : 0- : 0.5 : 4.00
Foxsee_7.8 1 : 0+ : 0= : 1- : 0.0 : 0.00
Fruit 2.1 1 : 0+ : 0= : 1- : 0.0 : 0.00
K3 1 : 0+ : 0= : 1- : 0.0 : 0.00
ProDeo 3.1 1 : 0+ : 0= : 1- : 0.0 : 0.00
Senpai_1 1 : 0+ : 0= : 1- : 0.0 : 0.00
Texel_1.7 1 : 0+ : 0= : 1- : 0.0 : 0.00

Games played 10, games to go 60

Subject: Re: Stockfish handicap match - PART II - Fri May 14, 2021 4:40 pm

[pgn]
[puzzle]
[Setup "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPP2PPP/RNBQKBNR w KQkq -"]
[/puzzle]
[/pgn]

Round-2 : 5-5

Total : 13 - 7

SF13 : 65%

Code:: SF13 10 : 3+ : 4= : 3- : 5.0 : 1.00
Ethereal_12.75 1 : 1+ : 0= : 0- : 1.0 : 5.00
Senpai_1 1 : 1+ : 0= : 0- : 1.0 : 5.00
Texel_1.7 1 : 1+ : 0= : 0- : 1.0 : 5.00
Arasan_2.22 1 : 0+ : 1= : 0- : 0.5 : 2.50
Cheng_4.41 1 : 0+ : 1= : 0- : 0.5 : 2.50
ProDeo 3.1 1 : 0+ : 1= : 0- : 0.5 : 2.50
Vajolet2_2.8 1 : 0+ : 1= : 0- : 0.5 : 2.50
Foxsee_7.8 1 : 0+ : 0= : 1- : 0.0 : 0.00
Fruit 2.1 1 : 0+ : 0= : 1- : 0.0 : 0.00
K3 1 : 0+ : 0= : 1- : 0.0 : 0.00

Subject: Re: Stockfish handicap match - PART II - Fri May 14, 2021 4:54 pm

[pgn]
[puzzle]
[Setup "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PP3PPP/RNBQKBNR w KQkq -"]
[/puzzle]
[/pgn]

Round 3

SF managed to survive with 5-5.

Total : 18 - 12

SF13 : 66%

I noticed the choice of Foxee was a bad one, it plays an illegal move as first one and loses, probably it doesn't support positions correctly.

Code:: SF13 10 : 4+ : 2= : 4- : 5.0 : 0.50
Cheng_4.41 1 : 1+ : 0= : 0- : 1.0 : 5.00
Fruit 2.1 1 : 1+ : 0= : 0- : 1.0 : 5.00
K3 1 : 1+ : 0= : 0- : 1.0 : 5.00
ProDeo 3.1 1 : 1+ : 0= : 0- : 1.0 : 5.00
Ethereal_12.75 1 : 0+ : 1= : 0- : 0.5 : 2.50
Vajolet2_2.8 1 : 0+ : 1= : 0- : 0.5 : 2.50
Arasan_2.22 1 : 0+ : 0= : 1- : 0.0 : 0.00
Foxsee_7.8 1 : 0+ : 0= : 1- : 0.0 : 0.00
Senpai_1 1 : 0+ : 0= : 1- : 0.0 : 0.00
Texel_1.7 1 : 0+ : 0= : 1- : 0.0 : 0.00

One spectatular game....

[pgn][Event "Round3"]
[Date "2021.05.14"]
[Round "1"]
[White "SF13"]
[Black "Ethereal_12.75"]
[Result "1/2-1/2"]
[BlackElo "2200"]
[Time "23"]
[WhiteElo "2200"]
[TimeControl "40/600:40/600:40/600"]
[SetUp "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PP3PPP/RNBQKBNR w KQkq - 0 1"]
[Termination "adjudication"]
[PlyCount "166"]
[WhiteType "program"]
[BlackType "program"]
[Comment "c0 \"-wpe2 | wpd2 | wpc2\";"]

1. Bd3 {-4.80/31 70} Nf6 {+3.56/25 33} 2. Nf3 {-4.85/27 4} e6 {+3.61/23 10}
3. Nc3 {-4.63/25 7} c5 {+3.51/24 15} 4. O-O {-4.51/26 16} d5 {+3.65/24 20}
5. Bg5 {-4.36/26 11} Be7 {+3.63/23 9} 6. Re1 {-4.38/25 4} Nc6 {+3.65/24 18}
7. Rc1 {-4.27/25 6} a6 {+3.59/27 38} 8. Bb1 {-4.32/24 8} b6 {+3.62/25 11}
9. a3 {-4.48/26 34} Bb7 {+3.79/24 15} 10. h3 {-4.55/29 64} Nb8 {+3.79/25
15} 11. b4 {-5.03/28 56} c4 {+4.23/25 16} 12. Qd4 {-4.36/25 15} a5
{+4.42/25 13} 13. Qh4 {-4.21/21 4} axb4 {+4.62/25 18} 14. axb4 {-4.05/23 6}
Bxb4 {+3.84/26 11} 15. Nd4 {-3.52/21 5} Nbd7 {+3.86/28 26} 16. Ncb5
{-2.87/23 5} Bxe1 {+3.95/28 22} 17. Rxe1 {-2.79/27 10} Kf8 {+3.85/27 12}
18. Rxe6 {-1.28/24 7} Kg8 {+4.03/28 19} 19. Rd6 {-0.85/23 5} Qe8 {+3.24/28
41} 20. Kh2 {-1.26/26 13} h6 {+2.81/25 15} 21. Bd2 {-1.27/28 21} Ra1
{+3.45/26 15} 22. Bf5 {-1.52/27 9} Nc5 {+3.65/25 23} 23. f3 {-1.54/26 5}
Qe7 {+2.70/28 42} 24. Bc3 {-1.32/27 6} Ra8 {+2.04/28 8} 25. Nc6 {-1.16/29
16} Bxc6 {+2.44/28 11} 26. Rxc6 {-1.02/27 5} Kf8 {+2.85/25 11} 27. Rxf6
{-0.84/31 21} h5 {+2.97/28 24} 28. Bc2 {-0.52/30 8} gxf6 {+3.37/28 8} 29.
Bxf6 {-1.35/30 14} Qd7 {+3.44/26 4} 30. Bxh8 {-2.03/32 39} Qxb5 {+3.22/23
3} 31. Qxh5 {-1.86/26 8} Qc6 {+3.30/25 4} 32. Be5 {-1.87/26 8} Nd3
{+3.69/24 6} 33. Bg3 {-2.07/28 11} Ra2 {+4.02/25 6} 34. Bb1 {-2.72/27 25}
Re2 {+3.92/28 9} 35. Qh7 {-2.68/23 2} Qg6 {+4.63/28 6} 36. Qh8+ {-1.71/24
4} Ke7 {+4.80/26 4} 37. Qa8 {-1.15/27 5} Qf5 {+4.28/27 14} 38. Qa3+
{-1.48/30 10} Kf6 {+5.42/24 2} 39. Qf8 {-1.06/30 8} Qh5 {+5.42/20 0} 40.
Bc7 {-0.62/24 1} Qxf3 {+7.40/21 1} 41. Qh8+ {-0.42/31 8} Kf5 {+2.22/32 58}
42. Bxd3+ {-0.46/33 8} Qxd3 {+1.43/30 48} 43. Qc8+ {-0.30/31 9} Re6
{+1.44/33 36} 44. Qg8 {-0.40/33 16} Re7 {+1.02/32 51} 45. Qc8+ {-0.32/30
10} Kg6 {+1.06/30 27} 46. Qg8+ {-0.21/32 9} Kf5 {+0.68/30 24} 47. Qc8+
{-0.28/33 13} Kf6 {+0.95/33 40} 48. Qh8+ {-0.28/34 19} Kg5 {+0.45/31 42}
49. Bd8 {-0.21/32 10} Qe4 {+0.52/30 42} 50. Qf8 {-0.31/34 13} Qe5+
{+1.34/28 14} 51. Kh1 {-0.21/32 9} Qe1+ {+2.16/28 6} 52. Kh2 {-0.21/30 1}
Kf6 {+1.31/25 7} 53. Qh6+ {-0.19/31 14} Kf5 {+0.52/28 14} 54. g4+ {-0.13/31
13} Ke4 {+1.43/27 11} 55. Bxe7 {-0.13/32 11} Qf2+ {+0.54/23 8} 56. Kh1
{-0.13/32 13} b5 {+0.63/29 27} 57. Qd6 {-0.15/33 23} d4 {+0.38/25 10} 58.
Bg5 {-0.13/33 13} Kd3 {+1.93/29 33} 59. Qb4 {0.00/35 12} f6 {+1.43/25 7}
60. Bh6 {-0.13/35 21} Qg3 {+0.81/25 11} 61. Qb1+ {0.00/36 12} Kc3 {+0.84/25
4} 62. Qa1+ {0.00/40 13} Kb3 {+1.56/23 5} 63. Qd1+ {0.00/40 17} Kb4
{+0.94/28 16} 64. Qb1+ {0.00/40 15} Ka4 {+1.12/21 2} 65. Qa1+ {0.00/38 34}
Qa3 {+0.55/24 6} 66. Qd1+ {0.00/37 14} Ka5 {+0.34/24 4} 67. Bf4 {0.00/39
16} Qc5 {+2.26/25 9} 68. h4 {0.00/41 26} b4 {+1.64/22 3} 69. h5 {0.00/41
11} Qd5+ {+0.41/20 1} 70. Kg1 {0.00/43 25} Qe4 {+1.30/20 3} 71. Bc1
{0.00/44 19} f5 {+0.11/21 4} 72. gxf5 {0.00/37 18} d3 {+0.01/21 0} 73. f6
{0.00/37 24} Qd4+ {+0.01/21 0} 74. Kg2 {0.00/36 12} c3 {+0.01/23 1} 75. h6
{0.00/39 17} d2 {+0.01/24 1} 76. Bxd2 {0.00/38 16} cxd2 {+0.01/24 0} 77.
Qh5+ {0.00/40 39} Ka4 {+0.01/24 2} 78. f7 {0.00/36 2} Qe4+ {+0.01/24 1} 79.
Kg3 {0.00/38 6} Qe1+ {+0.01/23 0} 80. Kg2 {0.00/38 0} d1=Q {+0.01/23 0} 81.
Qxd1+ {0.00/40 13} Qxd1 {0.00/29 13} 82. f8=Q {0.00/40 16} Qg4+ {0.00/30 9}
83. Kf2 {0.00/43 13} Qh4 {0.00/30 10 Arena Adjudication} 1/2-1/2[/pgn]

Last edited by Admin on Sat May 15, 2021 2:42 pm; edited 2 times in total

[pgn]
[puzzle]
[Setup "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RN1QKBNR w KQkq -"]
[/puzzle]
[/pgn]

Round 4

Stockfish lost with 2-8

Total : 20 - 20

SF13 : 50%

Code:: Name Gms : Win : Draw : Lose : Pts : S-B
SF13 10 : 2+ : 0= : 8- : 2.0 : 0.00
Arasan_2.22 1 : 1+ : 0= : 0- : 1.0 : 2.00
Cheng_4.41 1 : 1+ : 0= : 0- : 1.0 : 2.00
Ethereal_12.75 1 : 1+ : 0= : 0- : 1.0 : 2.00
Fruit 2.1 1 : 1+ : 0= : 0- : 1.0 : 2.00
K3 1 : 1+ : 0= : 0- : 1.0 : 2.00
ProDeo 3.1 1 : 1+ : 0= : 0- : 1.0 : 2.00
Senpai_1 1 : 1+ : 0= : 0- : 1.0 : 2.00
Vajolet2_2.8 1 : 1+ : 0= : 0- : 1.0 : 2.00
Foxsee_7.8 1 : 0+ : 0= : 1- : 0.0 : 0.00
Texel_1.7 1 : 0+ : 0= : 1- : 0.0 : 0.00

Last edited by Admin on Sat May 15, 2021 6:59 pm; edited 2 times in total

[pgn]
[puzzle]
[Setup "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/R1BQKBNR w KQkq -"]
[/puzzle]
[/pgn]

Round 5

Stockfish lost with 1-9

Total : 21 - 29

SF13 : 42%

Code:: Name Gms : Win : Draw : Lose : Pts : S-B

Arasan_2.22 1 : 1+ : 0= : 0- : 1.0 : 1.00
Cheng_4.41 1 : 1+ : 0= : 0- : 1.0 : 1.00
Ethereal_12.75 1 : 1+ : 0= : 0- : 1.0 : 1.00
Fruit 2.1 1 : 1+ : 0= : 0- : 1.0 : 1.00
K3 1 : 1+ : 0= : 0- : 1.0 : 1.00
ProDeo 3.1 1 : 1+ : 0= : 0- : 1.0 : 1.00
Senpai_1 1 : 1+ : 0= : 0- : 1.0 : 1.00
Texel_1.7 1 : 1+ : 0= : 0- : 1.0 : 1.00
Vajolet2_2.8 1 : 1+ : 0= : 0- : 1.0 : 1.00
SF13 10 : 1+ : 0= : 9- : 1.0 : 0.00
Foxsee_7.8 1 : 0+ : 0= : 1- : 0.0 : 0.00

Apparently a full piece behind is needed to get Stockfish on its knees.

No further interest to continue the testing.

Last edited by Admin on Sat May 15, 2021 7:00 pm; edited 1 time in total

[pgn]
[puzzle]
[Setup "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/1NBQKBNR w Kkq -"]
[/puzzle]
[/pgn]

Round 6

Cancelled.

Last edited by Admin on Sat May 15, 2021 7:00 pm; edited 1 time in total

[pgn]
[puzzle]
[Setup "1"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNB1KBNR w KQkq -"]
[/puzzle]
[/pgn]

Last Round 7

Cancelled.

Posts : 880 Join date : 2020-11-25 Location : USA

Great match! I would like to know after Stockfish wins Very Happy

. If like the human GM Nakamura in their handicap match. If Dragon 2 MCTS would score even better then Stockfish 13 playing the other engines with a handicap.

And the great chess engine programmer. Has become the great chess engine tester. Nice!

Subject: Re: Stockfish handicap match - PART II - Sat May 15, 2021 7:17 pm

Cross table

Code:: No. Engine 1 2 3 4 5 6 7 8 9 10 11 Score Games Perc Moves
-----------------------------------------------------------------------------------------------------------------
1 SF13 xxxx 1.0 1.0 1.5 1.5 2.0 2.0 2.0 2.0 3.0 5.0 21.0 / 50 (42.00%) 45.6
2 Cheng 4.41 4.0 xxxx 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 / 5 (80.00%) 46.1
3 Ethereal 12.75 4.0 0.0 xxxx 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 / 5 (80.00%) 53.9
4 ProDeo 3.1 3.5 0.0 0.0 xxxx 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 / 5 (70.00%) 54.9
5 Vajolet2 2.8 3.5 0.0 0.0 0.0 xxxx 0.0 0.0 0.0 0.0 0.0 0.0 3.5 / 5 (70.00%) 61.0
6 Fruit 2.1 3.0 0.0 0.0 0.0 0.0 xxxx 0.0 0.0 0.0 0.0 0.0 3.0 / 5 (60.00%) 51.1
7 Arasan 2.22 3.0 0.0 0.0 0.0 0.0 0.0 xxxx 0.0 0.0 0.0 0.0 3.0 / 5 (60.00%) 50.4
8 Komodo 3 3.0 0.0 0.0 0.0 0.0 0.0 0.0 xxxx 0.0 0.0 0.0 3.0 / 5 (60.00%) 42.5
9 Senpai 1 3.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 xxxx 0.0 0.0 3.0 / 5 (60.00%) 42.9
10 Texel 1.7 2.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 xxxx 0.0 2.0 / 5 (40.00%) 53.0
11 Foxsee 7.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 xxxx 0.0 / 5 (0.00%) 0.5

Games - http://rebel13.nl/dump/sf-handicap.zip

Subject: Re: Stockfish handicap match - PART II - Sat May 15, 2021 7:24 pm

mwyoung wrote:: Great match! I would like to know after Stockfish wins . If like the human GM Nakamura in their handicap match. If Dragon 2 MCTS would score even better then Stockfish 13 playing the other engines with a handicap.

And the great chess engine programmer. Has become the great chess engine tester. Nice!

Why the MCTS version and not the standard?

I could try the Dragon with Bishop c1 and Night b1 handicap and see if it does better than SF.

Posts : 880 Join date : 2020-11-25 Location : USA

Admin wrote:

mwyoung wrote:: Great match! I would like to know after Stockfish wins . If like the human GM Nakamura in their handicap match. If Dragon 2 MCTS would score even better then Stockfish 13 playing the other engines with a handicap.

And the great chess engine programmer. Has become the great chess engine tester. Nice!

Why the MCTS version and not the standard?

I could try the Dragon with Bishop c1 and Night b1 handicap and see if it does better than SF.

In the GM Nakamura vs Dragon handicap match. LK switched from NNUE to MCTS on day 2. LK said it plays stronger then NNUE in material handicap games. And MCTS just crushed GM Nakamura on day 2. GM Nakamura said he could tell something changed on day 2. And the program played stronger on day 2.

LK made this claim for human players. I was wondering if this also holds true in a computer vs computer handicap match.

» Komodo Dragon : Knight Odds Handicap Match
» The Only Competition for Stockfish is Stockfish Match.
» queen handicap weakness of stockfish
» Live Chess 960 Match Stockfish 051220 x2 Power vs Stockfish 051220 (TC=90m+30s)(32 Threads)
» For the Glory Match. Stockfish 09/10/21(5m+5s) vs. Lc0 0.28.0 (20m+20s)