Posts : 2609 Join date : 2020-11-17 Location : Netherlands
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 9:09 pm
I wish I had new that, ProDeo plays much too fast on sudden depth levels and I never cared, tested.
Does CCRL also plays sudden depth?
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 9:14 pm
This I can not say, but I think that this is the case, at least some testers, I think that Graham can give an answer.
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 9:19 pm
This is the case with Ipman and Stefan Pohl, i.e. they test with time controls such as 3 minutes +1 second....
Mclane
Posts : 3024 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 9:27 pm
What gives more elo ? Pondering or better timing in blitz levels ? I would say ponder gives more elo in ANY time control, no matter if blitz , average or tournament.
Only test suite and testing with ponder OFF gives no better results.
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 9:39 pm
it's hard to say, most rating tests are done without Ponder. Ponder plays a role in official tournaments. A better time control is in any case a higher gain than maybe 5 percent speed advantage due to a better compilation...
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 9:44 pm
In a test with Ponder I think Lc0 should have a certain advantage, because it has the complete search tree in memory and just continues to calculate, but I am only a "prevented" Lc0 expert, i.e. I don't understand the MCTS search and the differences to the search of an AB engine until today... (why no quiescent search ?)
Last edited by Dio on Fri Dec 02, 2022 9:54 pm; edited 1 time in total
Chris Whittington
Posts : 1254 Join date : 2020-11-17 Location : France
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 9:52 pm
If the tests are on one PC (most are, I assume), then ponder is going to wreak havoc with the allocation of memory and cpu resources, such that one engine can unfairly gain against the other. I always assumed ponder=off to make even playing field.
Dio likes this post
Mclane
Posts : 3024 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 10:07 pm
When i have 8 cores each engine gets 4 cores. With the 16 core machine each engine 8 cores. I find pondering natural. Its what humans do too. Not pondering looks like wasting time. Only the very early dedicated chess computers of 1978-79 did not ponder. MkV (Broughton) pondered, mephisto 1 did (Nitsche+Henne) fidelity sensory 9 (Spracklen) did. Superchess3.5 did not ponder but clockchess89 did.
Dio likes this post
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 10:15 pm
for private tests Ponder makes sense, for tests for rating lists it makes more sense to use the existing threads for significantly more games in the same time....
texium
Posts : 125 Join date : 2022-07-19
Subject: Re: News about Rebel or Chess System Tal ? Fri Dec 02, 2022 10:19 pm
Peter Berger wrote:
Admin wrote:
Oh well, forgot to tell, PB still under construction.
Yes, use the Noomen book, no update needed.
Or don't .
Welcome Rebel16 on my computers.
My knowledge in this line is heavily outdated (like 19XX) , so for me 12. h3 is kind of a novelty. I didn't look things up, so who knows .
It is one game, but though Crafty loses some, even Stockfish rarely delivers such strong blows against it - impressive.
But what I want to give an applause for, is the release style-wise. We get an executable, we get one parameter, we can adjust threads. THAT's the spirit - just as in the old days where programmers were expected to work out optimal settings for themselves
yeah h3, is a rare move kinda, because Bg4 was a massive sideline, like +1 under stockfish
Wolfgang
Posts : 6 Join date : 2022-05-10
Subject: Re: News about Rebel or Chess System Tal ? Sat Dec 03, 2022 3:58 am
Dio wrote:
for private tests Ponder makes sense, for tests for rating lists it makes more sense to use the existing threads for significantly more games in the same time....
Subject: Re: News about Rebel or Chess System Tal ? Sat Dec 03, 2022 4:35 am
Chris Whittington wrote:
If the tests are on one PC (most are, I assume), then ponder is going to wreak havoc with the allocation of memory and cpu resources, such that one engine can unfairly gain against the other. I always assumed ponder=off to make even playing field.
With modern computers, modern GUI etc., I do not think this is an issue any more. Maybe on one or two core machines 15 or 20 years ago. I am - carefully worded - a bit shocked about some statements here concerning Ponder.
http://www.cegt.net/rating5plus3pbon.htm ~420.000 games ALL played on one PC. No one except SSDF plays with Ponder on two machines nowadays with Auto232 cable or other oldfashioned "solutions" from the Stone Age.
Currently most tests for this list are played on my Ryzen 9 3950x (16 Cores, 32 Threads) with 32GB RAM and BanksiaGUI. Concurrency is set to 6 or 7, i.e. 12 to 14 Cores are busy playing one tournament, gauntlet or match. Maybe one also could play with higher concurrency, but I don't like that. Results are quite consistant compared to our PonderOFF lists. Btw: Rebel 15.1 runs perfectly with Ponder. 1500 games, not a single problem/crash/time forfeit
Another example, much more extreme, was Ingo Bauers "IPON". Up to his retirement from computerchess he played hundredthousands of games with 5 or more Hexacore PCs simultaneousely over Network/LAN. Never heard about fundamental technical (!) problems. There were some discussions about his conditions, e.g. that he never published his opening suite. But this does not belong here.
It's of course up to you to implement ponder or not. I would appreciate it very much
Best Wolfgang CEGT Testing Group
Last edited by Wolfgang on Sat Dec 03, 2022 4:45 am; edited 2 times in total
Mclane, mwyoung and Dio like this post
Wolfgang
Posts : 6 Join date : 2022-05-10
Subject: Re: News about Rebel or Chess System Tal ? Sat Dec 03, 2022 4:37 am
Mclane wrote:
When i have 8 cores each engine gets 4 cores. With the 16 core machine each engine 8 cores. I find pondering natural. Its what humans do too. Not pondering looks like wasting time. ...
Agreed...
Mclane likes this post
texium
Posts : 125 Join date : 2022-07-19
Subject: Re: News about Rebel or Chess System Tal ? Sun Dec 04, 2022 4:03 am
Judging from the Rebel 16 release date, CSTal is going to be a whole Christmas present
mwyoung
Posts : 880 Join date : 2020-11-25 Location : USA
Subject: Re: News about Rebel or Chess System Tal ? Sun Dec 04, 2022 6:21 am
Chris Whittington wrote:
If the tests are on one PC (most are, I assume), then ponder is going to wreak havoc with the allocation of memory and cpu resources, such that one engine can unfairly gain against the other. I always assumed ponder=off to make even playing field.
At least on the computers I have built. This has never been a issue. And this is easily checked by the stats for each chess engine produced by the GUI. To see that ponder on is 100% ok if done correctly on a single computer.
Meaning you have to split the CPU cores between the 2 chess engines and the memory. And if you have at least 16 CPUs. This is my preferred way of testing. As most chess engines gain very little going from 8 to 16 cores.
This is not true for some chess engines like Dragon 3.1 using MCTS. As that search scales very well with more cores.
I could see if you have a prebuilt with 1 stick of memory as many do to save money. This could be a issue using ponder on. Using a single computer system.
SSDF has always used ponder on to generate their rating list. And that use to be the testing standard.
And if you have 2 computer systems with equal specs. Banksia GUI allows you to connect the computers together using wifi. And you can test like SSDF if you wish. As another testing option with ponder on.
And you could run many games at once with many chess engines. On my system I could play 16 chess engines using 1 core each with ponder on that also works just fine.
If you doubt this. Just try it. It works perfectly on a Threadripper CPU.
Last edited by mwyoung on Sun Dec 04, 2022 2:29 pm; edited 1 time in total
Admin Admin
Posts : 2609 Join date : 2020-11-17 Location : Netherlands
Subject: Re: News about Rebel or Chess System Tal ? Sun Dec 04, 2022 8:28 am
pohl4711 wrote:
I had no freezes, but something is definitly wrong with Rebel. Look at move 109 by Rebel 16 (black)... Drawn position, but a thinking depth of 1 after 1.2 seconds and a bogus evaluation: Rh6+ {-M124/1 1.2s} (This happens again and again in my testrun) (I use cutechess-cli)
We checked this, likely a display glitch, in any case without consequences for playing strength.
pohl4711 wrote:
(And Rebel 16a moves still too fast. Now, 7min 5secs per game in my testings (better than Rebel 16 (6min 50sec)) Normal average value in my ratinglist is 7min 45secs
Working on this.
Apparently the world has changed since we both retired during the -
Mclane and Dio like this post
Ipmanchess
Posts : 42 Join date : 2022-06-08
Subject: Re: News about Rebel or Chess System Tal ? Sun Dec 04, 2022 9:28 am
Rebel 16 avx2 added to list ,played 23.000games TC: 10s+1s ,more details on website.
Subject: Re: News about Rebel or Chess System Tal ? Sun Dec 04, 2022 3:00 pm
Dio wrote:
In a test with Ponder I think Lc0 should have a certain advantage, because it has the complete search tree in memory and just continues to calculate, but I am only a "prevented" Lc0 expert, i.e. I don't understand the MCTS search and the differences to the search of an AB engine until today... (why no quiescent search ?)
That is true for Lc0, and Dragon MCTS but what is also true for Lc0, and Dragon MCTS is that the tree is not lost with ponder off. And Lc0 and Dragon MCTS will use that data again on the next move. How much of that tree is left for Lc0 and Dragon MCTS to use depends on the move played by the other chess engine. But that is exactly the same for ponder on with Lc0 and Dragon MCTS.
And this video could answer your questions on the MCTS.
I just noticed that Larry agrees that using more then 8 cores with NNUE is pretty useless. Nice!
Last edited by mwyoung on Sun Dec 04, 2022 3:41 pm; edited 1 time in total
Dio likes this post
Chris Whittington
Posts : 1254 Join date : 2020-11-17 Location : France
Subject: Re: News about Rebel or Chess System Tal ? Sun Dec 04, 2022 3:10 pm
Status for Chess-System-Tal-1.51:
written new code for time control - being tuned and tested at the moment. Written code for ponder - awaits testing. Might have fixed -M124 weirdness - difficult to say, since I can't get it to repeat.
All needs porting back to Rebel-16a
Brendan, mwyoung, adminx, Dio, Ipmanchess and Holofernes like this post
Mclane
Posts : 3024 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area
Subject: Re: News about Rebel or Chess System Tal ? Sun Dec 04, 2022 7:10 pm
where are the test versions ?
Dio likes this post
Ipmanchess
Posts : 42 Join date : 2022-06-08
Subject: Re: News about Rebel or Chess System Tal ? Tue Dec 06, 2022 10:01 pm
Rebel 16 avx2 also added in other list ,played 1200games @5min+0s ,more details on website
+ 81 elo?? There is no need to retire Rebel just yet Ed... Maybe you can add another 80-100 elo so it can join the top 10 on the list?
stockfish and major engines see minimal elo gains of maybe 1 elo per patch, and they have things like FishTest where they can quick check patches and see if they're good, also they incorporate 960 games into the net which I'm guessing Rebel and CSTal don't because they don't support it ATM. I'm not en engine dev so I don't know how adding a couple hundred thousand 960 games would affect it in openings
Sponsored content
Subject: Re: News about Rebel or Chess System Tal ?