A colleague of mine started running Folding@Home on a few PCs in his office last summer. When a load of powerful servers were freed up after a cancellation at the end of last year, I figured that since we now had a lot of spares in the datacentre doing nothing, why not see what kind of PPD we could squeeze out of them.
Originally we started out with a little over sixty dual-5420/5520 Xeon servers (8-12GB RAM each) running one instance of the regular CPU client for each CPU core. This gave a big boost to our rankings, going from… a very low number to the mid-2000s pretty quickly.
As the 5420/5520 servers were used up by new orders (and as we bought more powerful servers), I started running the SMP client (with the -bigadv option to increase the PPD) on a few Dell PowerEdge R810 servers (each with four quad-core HT-capable Xeons – a staggering 32 logical cores per server), which resulted in an enormous PPD increase.
We later had a bunch of GPU Cloud servers sent over from another datacentre, each with two 5620 Xeons, between 12 and 48GB RAM and two nVidia Fermi GPUs (pictured). With sixteen of these servers running two GPU Folding clients and the CPU SMP client (again with the -bigadv option), we shot up the team rankings, going from the low 1000s in early January to our current position of 232nd worldwide! And we’re still climbing…
(Update: 168th as of 7 Dec 2011)
Some stats, graphs and point/ranking predictions can be seen on the official Folding@Home stats page, the Extreme Overclocking stats tool or the Kakao Stats tool.
The power usage of these servers is also pretty phenomenal; each GPU servers uses a little over 2amps (at ~240VAC) when running at 100% CPU/GPU load, which equates to just under 40 amps for all sixteen. Each R810 uses about 4amps at full load (2amps per PSU) while the dual-5420/5520 servers only use approximately 1amp each.
And of course, with big power usage comes big heat output: each GPU server throws out an epic amount of hot air at over 50°C (122°F). You could heat a pretty big room with a single one of these GPU servers… as long as the occupants didn’t mind the horrendous noise the fans make at full speed.