Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: REBEL-EAS Mon Aug 21, 2023 7:22 pm
REBEL-EAS is an in between version based on the same, but more, neural net data as REBEL-16.2 but heavily modified during the last 5 months in order to make REBEL to play more aggressive and runs as a module under Chess System Tal 2.0
. REBEL 16.2 gains an EAS score of : 80.258 . REBEL-EAS gets an EAS score of : 160.569
As a cherish on the cake the playing strength of the neural net has increased with 20-25 elo using balanced positions. Using the TCEC positions composed by Jeroen Noomen and GM Matthew Sadler adds another 26 elo points while the draw rate dropped with almost 20%.
Posts : 160 Join date : 2022-03-01 Location : Berlin
Subject: Re: REBEL-EAS Tue Aug 22, 2023 7:45 am
Admin wrote:
REBEL-EAS is an in between version based on the same, but more, neural net data as REBEL-16.2 but heavily modified during the last 5 months in order to make REBEL to play more aggressive and runs as a module under Chess System Tal 2.0
. REBEL 16.2 gains an EAS score of : 80.258 . REBEL-EAS gets an EAS score of : 160.569
I started my testruns (SPCC-Ratinglist and UHO-Top10-Ratinglist). Will take 4 days (10000 games UHO-Top10 Testrun and 16000 games SPCC-Ratinglist testrun). Then we will see, what the EAS-scoring of Rebel-EAS really is - in my EAS-Ratinglist (calculated out of my SPCC-Ratinglist gamebase)...
Dio likes this post
TigreNegro
Posts : 9 Join date : 2021-07-02
Subject: Re: REBEL-EAS Tue Aug 22, 2023 8:23 am
Admin wrote:
REBEL-EAS is an in between version based on the same, but more, neural net data as REBEL-16.2 but heavily modified during the last 5 months in order to make REBEL to play more aggressive and runs as a module under Chess System Tal 2.0
. REBEL 16.2 gains an EAS score of : 80.258 . REBEL-EAS gets an EAS score of : 160.569
As a cherish on the cake the playing strength of the neural net has increased with 20-25 elo using balanced positions. Using the TCEC positions composed by Jeroen Noomen and GM Matthew Sadler adds another 26 elo points while the draw rate dropped with almost 20%.
Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: Re: REBEL-EAS Tue Aug 22, 2023 9:22 am
pohl4711 wrote:
Admin wrote:
REBEL-EAS is an in between version based on the same, but more, neural net data as REBEL-16.2 but heavily modified during the last 5 months in order to make REBEL to play more aggressive and runs as a module under Chess System Tal 2.0
. REBEL 16.2 gains an EAS score of : 80.258 . REBEL-EAS gets an EAS score of : 160.569
I started my testruns (SPCC-Ratinglist and UHO-Top10-Ratinglist). Will take 4 days (10000 games UHO-Top10 Testrun and 16000 games SPCC-Ratinglist testrun). Then we will see, what the EAS-scoring of Rebel-EAS really is - in my EAS-Ratinglist (calculated out of my SPCC-Ratinglist gamebase)...
Cool....
I don't hold my breath about the really, EAS scores fluctuate on 1) the engine mix, different opponents gives different EAS, 2) used opening sets, REBEL-EAS does best on balanced positions as I found out and 3) of course a valid elo pool.
For my testing I use 10 fixed opponents within a range of -30|+30 elo using balanced positions. During a training run of ~400 epochs I play about 15-20 matches of 2000 games and calculate the EAS which (for REBEL-EAS) fluctuate between 100.000 and 200.000. Lumping them together (at least 20.000 games) gives a reliable EAS score, but..... 1) for that particular elo pool and 2) that particular opening set.
And so I was able to make a comparison between REBEL-16 and REBEL-EAS but only for that particular elo pool and that particular (balanced) opening set.
I tried other sets, randomly picked one of your UHO opening sets, tried my gambit positions and the EAS score dropped significantly. And what to say about the TCEC positions, REBEL-EAS gained 26 elo [!] more than all other sets but the EAS was not so great, but in all cases always better than REBEL-16.2
Adding all things together I managed to create a more aggressive engine and that's hard enough with NNUE and your EAS tool was very helpful, actually the best what is available, but to say and I quote "Then we will see, what the EAS-scoring of Rebel-EAS really is" as a sort of absolute truth are a couple of bridges too far as I stipulated in the above, best summarized as, it depends.
Nezhman likes this post
Admin Admin
Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: Re: REBEL-EAS Tue Aug 22, 2023 9:48 am
TigreNegro wrote:
Admin wrote:
REBEL-EAS is an in between version based on the same, but more, neural net data as REBEL-16.2 but heavily modified during the last 5 months in order to make REBEL to play more aggressive and runs as a module under Chess System Tal 2.0
. REBEL 16.2 gains an EAS score of : 80.258 . REBEL-EAS gets an EAS score of : 160.569
As a cherish on the cake the playing strength of the neural net has increased with 20-25 elo using balanced positions. Using the TCEC positions composed by Jeroen Noomen and GM Matthew Sadler adds another 26 elo points while the draw rate dropped with almost 20%.
a first small tournament with fast TC, 40/4-test are also running..
Fast
Rank
Engine
Score
%
St
Ko
Be
Cl
CS
Et
Re
Re
Re
Ca
De
Ur
Ro
Wa
Po
S-B
01
Stockfish 16
540.5/700
77.2
· ·· ·· ·
11-0-39
19-1-30
21-0-29
22-1-27
25-1-24
27-0-23
24-0-26
30-0-20
27-0-23
33-0-17
33-0-17
36-0-14
37-0-13
39-0-11
177837,50
02
Komodo Dragon 3.2
469.5/700
67.0
0-11-39
· ·· ·· ·
7-5-38
8-8-34
16-1-33
17-1-32
17-0-33
17-0-33
15-0-35
18-3-29
28-0-22
28-2-20
32-0-18
31-0-19
39-3-8
152877,30
03
Berserk 11.1
443.5/700
63.3
1-19-30
5-7-38
· ·· ·· ·
17-4-29
11-3-36
10-4-36
18-3-29
9-4-37
14-0-36
20-0-30
19-1-30
26-0-24
28-1-21
32-1-17
25-1-24
144981,30
04
Clover 6.0
394.5/700
56.3
0-21-29
8-8-34
4-17-29
· ·· ·· ·
8-8-34
3-8-39
10-4-36
5-1-44
11-5-34
6-2-42
18-1-31
19-1-30
18-0-32
28-0-22
27-0-23
128510,30
05
CSTal 2.00
380.5/700
54.3
1-22-27
1-16-33
3-11-36
8-8-34
· ·· ·· ·
9-8-33
4-3-43
9-1-40
5-4-41
13-4-33
11-4-35
16-2-32
23-2-25
21-3-26
26-1-23
124353,30
06
Ethereal 14.00
371.5/700
53.0
1-25-24
1-17-32
4-10-36
8-3-39
8-9-33
· ·· ·· ·
10-5-35
8-7-35
6-2-42
9-4-37
13-6-31
11-5-34
13-2-35
20-1-29
27-0-23
121821,80
07
Revenge 3.0
363.5/700
51.9
0-27-23
0-17-33
3-18-29
4-10-36
3-4-43
5-10-35
· ·· ·· ·
3-9-38
4-6-40
10-4-36
10-0-40
19-1-30
23-1-26
22-1-27
30-1-19
116833,00
08
Rebel EAS
353.5/700
50.5
0-24-26
0-17-33
4-9-37
1-5-44
1-9-40
7-8-35
9-3-38
· ·· ·· ·
2-2-46
4-3-43
12-2-36
11-4-35
11-7-32
21-2-27
22-3-25
116528,00
09
Rebel 16.2
347.0/700
49.5
0-30-20
0-15-35
0-14-36
5-11-34
4-5-41
2-6-42
6-4-40
2-2-46
· ·· ·· ·
6-3-41
7-1-42
12-1-37
14-4-32
19-0-31
17-4-29
113684,80
10
Caissa 1.11
333.5/700
47.6
0-27-23
3-18-29
0-20-30
2-6-42
4-13-33
4-9-37
4-10-36
3-4-43
3-6-41
· ·· ·· ·
7-3-40
10-3-37
12-4-34
19-1-30
21-1-28
108986,50
11
Deep Sjeng 3.6 a16
297.5/700
42.5
0-33-17
0-28-22
1-19-30
1-18-31
4-11-35
6-13-31
0-10-40
2-12-36
1-7-42
3-7-40
· ·· ·· ·
7-11-32
19-3-28
13-5-32
18-3-29
96865,25
12
Uralochka 3.39d
284.5/700
40.6
0-33-17
2-28-20
0-26-24
1-19-30
2-16-32
5-11-34
1-19-30
4-11-35
1-12-37
3-10-37
11-7-32
· ·· ·· ·
9-7-34
12-4-34
23-2-25
92213,50
13
RofChade 3.0
255.0/700
36.4
0-36-14
0-32-18
1-28-21
0-18-32
2-23-25
2-13-35
1-23-26
7-11-32
4-14-32
4-12-34
3-19-28
7-9-34
· ·· ·· ·
13-5-32
12-3-35
83378,00
14
Wasp 6.50
221.0/700
31.5
0-37-13
0-31-19
1-32-17
0-28-22
3-21-26
1-20-29
1-22-27
2-21-27
0-19-31
1-19-30
5-13-32
4-12-34
5-13-32
· ·· ·· ·
13-6-31
72957,25
15
PowerFritz 18
194.5/700
27.7
0-39-11
3-39-8
1-25-24
0-27-23
1-26-23
0-27-23
1-30-19
3-22-25
4-17-29
1-21-28
3-18-29
2-23-25
3-12-35
6-13-31
· ·· ·· ·
65618,50
5250 games played / Tournament finished
Tournament start: 2023.02.22, 17:59:20 Latest update: 2023.08.23, 13:46:03 Site/ Country: isle of Rügen, Germany Level: Blitz 0:01/0,5 Hardware: Intel(R) Core(TM) i3-7100 CPU @ 3.90GHz mit 7,9 GB Speicher Operating system: Windows 10 Enterprise Professional (Build 9200) 64 bit Table created with:Arena 3.5.1
Admin and Ipmanchess like this post
Admin Admin
Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: Re: REBEL-EAS Wed Aug 23, 2023 7:38 pm
Clover is going surprising fast.
Dio likes this post
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: REBEL-EAS Wed Aug 23, 2023 7:52 pm
Clover has tremendous potential. With a time control of 4 min + 2 sec, however, it is still weaker than CSTal 2.00. In the current TCEC tournament, Clover has qualified for the main tournament. The author is 18 years old and comes from Romania.
Also take a look at the EAS-Ratinglist, the world's first engine-ratinglist not measuring strength of engines but engines's style of play: https://www.sp-cc.de/eas-ratinglist.htm
(Perhaps you have to clear your browsercache (press STRG+SHIFT+DEL) or reload the website))
We see a clear progress in the EAS-Ratinglist: Number of sacs is quite good (25.64%) und much better than Rebel 16.1 (17.22%). Number of bad draws is clearly smaller, too (progress,too) for Rebel EAS. But the overall length of all won games is worse (84) compared to Rebel 16.1 (80) and the number of short wins is a little bit worse (no big deal, but 11.98% short wins is overall not a good value). So a lot of room for improvements for Rebel in the EAS-List: A new Rebel, which is winning games faster, will lower the overall length of all won games and will raise the number of short wins, too...both would mean a gain of EAS-points...
Code:
bad avg.win Rank EAS-Score sacs shorts draws moves Engine/player ------------------------------------------------------------------- 27 98215 25.64% 11.98% 20.41% 84 Rebel EAS avx2
(Number of sacs and bad draws is good for Rebel EAS, overall length of won games and number of short wins are bad. What we learn is, that the EAS-Tool produces very similar results (in the single statistics, compared to other engines (do not just look at the EAS-score!!!)) in different databases, if the number of played games is big enough).
Admin, Nezhman, Dio and peter like this post
Admin Admin
Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: Re: REBEL-EAS Sat Aug 26, 2023 10:06 am
Surprised by the elo gain, must be the longer time control.
Thanks for playing 16,000 games, that helps too.
Admin Admin
Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: Re: REBEL-EAS Sat Aug 26, 2023 10:18 am
Regarding EAS, I keep on saying that, in my test elo pool against 10 other engines the pool varies -30/+30 elo and then REBEL-EAS is clearly on top of the rest.
But nevermind, the next version (if ever) the focus will be on playing strength, the EAS version was just a fun exercise.
REBEL-EAS is an in between version based on the same, but more, neural net data as REBEL-16.2 but heavily modified during the last 5 months in order to make REBEL to play more aggressive and runs as a module under Chess System Tal 2.0
. REBEL 16.2 gains an EAS score of : 80.258 . REBEL-EAS gets an EAS score of : 160.569
As a cherish on the cake the playing strength of the neural net has increased with 20-25 elo using balanced positions. Using the TCEC positions composed by Jeroen Noomen and GM Matthew Sadler adds another 26 elo points while the draw rate dropped with almost 20%.