As far as i understand chris the major problem is not that we could have machines to help him, but that the data to generate the data is on his PC in france and internet is not a help even if we would have the big machines with the many terrabytes of HDD.
Admin Admin
Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sat Apr 16, 2022 10:06 am
Well, first of all, it is an unfortunate fact of computer chess life that engines baked in the oven of the programmer proudly posting their (hard fought) expected elo gain often is halved in real life by those pesky rating lists you can't do without. So 50 elo is not much.
Secondly, I am not happy yet, Chris created a new NNUE architecture and I haven't fully explored its possibilities, there is more to gain. I estimate I need at least another month before I can say, it's done. Now it feels unfinished. I never release something that is unfinished, there is no satisfaction in unfinished.
adminx, matejst and Dio like this post
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sat Apr 16, 2022 7:53 pm
I hope that Rebel and Chess System Tal will participate in today's online tournament. I wish you both much success. It is a pity that it is not possible to follow this interesting tournament online.
Mclane likes this post
Admin Admin
Posts : 2608 Join date : 2020-11-17 Location : Netherlands
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sat Apr 16, 2022 8:14 pm
Dio wrote:
I hope that Rebel and Chess System Tal will participate in today's online tournament. I wish you both much success. It is a pity that it is not possible to follow this interesting tournament online.
Chris will play, not me. But PM Joost Buijs, he will give you access as spectator.
Mclane likes this post
Mclane
Posts : 3022 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sat Apr 16, 2022 8:24 pm
Easter tournament?
Dio
Posts : 222 Join date : 2021-08-28
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sat Apr 16, 2022 8:26 pm
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sun Apr 17, 2022 9:53 am
Congrats, Chris! Excellent result with no losses, shared second place.
Admin, Chris Whittington, Mclane, TheSelfImprover and Dio like this post
mwyoung
Posts : 880 Join date : 2020-11-25 Location : USA
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sun Apr 17, 2022 8:57 pm
Chris Whittington wrote:
matejst wrote:
Thanks, Chris.
I have a spare laptop we could use, but it is a AMD A8 with Radeon graphics, I think. So it is not much, but if I can help, I will gladly do it. Just tell me what.
Laptops are probably not advised for this type of NN training because the training software is so thoroughly optimised (we are using PyTorch) that it continuously hammers both the GPU and CPU and that generates a lot of heat. training can last several days. Heat dissipation in laptops is not terribly good, in general. There’s quite possibly issues with farming out the training elsewhere, for example, I am currently working with 12 billion training positions and that is targeted to grow plenty more. That’s roughly 500 or 600 Gb of data, it can be compressed and I guess we could change data format and use the SF data format (I think that’s 2-3 bytes per position) but even so that’s ~30Gb for 12B positions. Completely impractical for me on rural French internet and probably not much better in practice with any “home” internet.
I have been using a cooler for my Laptop. And it as worked very well. I have been using my laptop to mine crypto for months without stopping. Hammering both the CPU and GPU at full load. And the temps for both the GPU and CPU stay below the 70c range for both the GPU and CPU. Instead of the 90c+ range without this cooler. My laptop is high end, Running a Ryzen 9 5900HX, and a RTX 3070.
Here is the cooler that will solve any laptop heating issues. All other Laptop coolers I have used are junk.
matejst and Tibono like this post
Mclane
Posts : 3022 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sun Apr 17, 2022 9:00 pm
Isnt the electricity bill higher then the money you make out of crypto mining ?
mwyoung
Posts : 880 Join date : 2020-11-25 Location : USA
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sun Apr 17, 2022 9:03 pm
Mclane wrote:
Isnt the electricity bill higher then the money you make out of crypto mining ?
No, not even close. I pay 9.3 cents per KWH. And the laptop is very efficient.
Mclane
Posts : 3022 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sun Apr 17, 2022 9:14 pm
Admin wrote:
Well, first of all, it is an unfortunate fact of computer chess life that engines baked in the oven of the programmer proudly posting their (hard fought) expected elo gain often is halved in real life by those pesky rating lists you can't do without. So 50 elo is not much.
Secondly, I am not happy yet, Chris created a new NNUE architecture and I haven't fully explored its possibilities, there is more to gain. I estimate I need at least another month before I can say, it's done. Now it feels unfinished. I never release something that is unfinished, there is no satisfaction in unfinished.
What is the difference between the old net and the new net ?
mwyoung
Posts : 880 Join date : 2020-11-25 Location : USA
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Sun Apr 17, 2022 11:44 pm
Mclane wrote:
Isnt the electricity bill higher then the money you make out of crypto mining ?
Here is my current todays stats for mining crypto with my laptop. It is very profitable. I have made over $400 per month in the past. It just depends on the price of crypto I am mining for that day, week, and month.
Tibono
Posts : 30 Join date : 2020-11-27 Location : France
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Mon Apr 18, 2022 9:47 am
... this is my own cooling system:
Left: this is where the hot air flows out from the internal fan system. Check the black plastic deflector to guide the hot air upside, and the metal convector set down on the edge of the keyboard (as this area is getting hot due to the internal air flow). Front: awsome smart system to enhance fresh air circulation under the laptop. Plastic bottle tops (€0) Right: former impact printer professional fan. Recovered from a bin (€0).
Details of the convector: just glued metal plates from my unused hardware stock (€0). The radiating surface is 5 times the bottom contact surface.
The printer fan. Actually it was cooling a soundproof box muffling an office impact printer (back in the 90's). That is why it is definitely silent by design. The soundproof box was no more any useful once the impact printer has be replaced by a laser printer. 30 years later, still working fine. That's a fan!
Total price: €0
Admin and TheSelfImprover like this post
Mclane
Posts : 3022 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area
Subject: Re: Update on Rebel-15-with-ChrisW-NNUE dev-v2.2 Mon Apr 18, 2022 10:03 am
And what do you cool inside this laptop ? Nvidia ?
Tibono
Posts : 30 Join date : 2020-11-27 Location : France
No Nvidia, no GPU... just an Intel Graphics Media Accelerator (GMA) 4500M (64Mb dedicated memory, 400Mhz). This does not heat. My sophisticated cooling system is essentially for hot summer time , two chess programs playing each other, using 1 core each (and ponder on). Thus the CPU is stuck at 100% (Pentium Dual-Core CPU T4500 @ 2.30GHz).
Mclane likes this post
Mclane
Posts : 3022 Join date : 2020-11-17 Age : 57 Location : United States of Europe, Germany, Ruhr area