As a matter of interest, what kind of power consumption are you getting on those servers at the moment?
Dell PowerEdge R730XD:
- 2 x Intel Xeon CPU E5-2687W v4
- 384GB RAM (8 x 32GB DDR4 2133 RDIMMs and 8 x 16GB DDR4 2133 RDIMMs)
- Dell Intel X710 Quad Port 10GbE SFP+ NIC
- Dell PERC H730 Mini (Embedded) (RAID Card in HBA mode)
- Dell T93GD 12Gbps SAS HBA (=9300-8e) external SAS
- Dell (P/N: GY1TD) PCI-E Extension card for front 2.5" U.2 NVMe drives.
- NVIDIA RTX 3060 GPU
- 2 x Dell EMC WD Ultrastar SS540 800GB Enterprise SSD (Mirrored for OS install)
- 3 x Kioxia PM6-R KPM6XRUG15T3 15.36TB SAS 24Gb/s Enterprise SSD
- 1 x Samsung PM1643a 15.36TB SAS 12Gb/s Enterprise SSD
The system above with those specs is currently idling at:
Now, the GPU server is idling higher, but here are the specs on it:
Dell PowerEdge C4130:
- 2 x Intel Xeon CPU E5-2698 v3
- 64GB RAM (8 x 8GB DDR4 2133 RDIMMs)
- 1 x Intel x520-da2 NIC
- 2 x Dell 400GB 6Gbps SATA MU MLC 1.8" SSD S3610
- 4 x NVIDIA Tesla P40 GPUs (24GB VRAM)
The system above with those specs,
with a model
loaded, but not currently doing anything is:
The GPUs each would normally draw 10w each, but with everything loaded into VRAM, they're at 50w each. So 399w idle - 160w = 239w when the server just sits there with nothing loaded and idling currently. Now I plan to drop to lower power CPUs which will help reduce the power consumed, since this thing doesn't really use CPUs at all, everything for my AI stuff relies on the GPUs.
The CPUs I plan to put into the GPU server are the
Intel Xeons Processor E5-2623 v4.
The current plan is to do that for this one.
The R730 I got arrived today. I just need to wait for components to arrive, but here:
Here's roughly how much you can get a barebones R730 for, shipped. I have CPUs on hand, what's in the GPU server may go into this thing. I have a Dell Intel X710 NIC to put in, and I'm getting RAM and the PERC RAID card off my IT buddy for this thing. As well as the front bezel and stuff.
-Edit-
Alright, I performed the CPU swap in the GPU server (C4130), and idle was a 63w drop in consumption:
Which is good since even under load, that's still a 63w drop, considering only the GPUs are doing the work when the AI is in use.
