From Digitalis

Revision as of 10:00, 26 February 2014 by Neyron (Talk | contribs)
Jump to: navigation, search




Idgraf is a Bi-Socket Intel Xeon Westmere machine featuring 8 Nvidia GPU

  • 2x Intel Xeon X5650 (Westmere, 6 cores each, total 12 cores)
  • 72 GB RAM
  • 8x coprocesseur Nvidia Tesla C2050


Beware that to support 8 GPU on a bi-socket Nehalem based machine, in addition to the need of 2 IOH connected via QPI buses, 2 PCI-e switches are required (PLXTech PEX8647 here), possibly limiting the bandwidth to the PCI-e cards.


How to experiment

Privileged commands

Currently, the following commands can be run via sudo in exclusive jobs:

  • sudo /usr/bin/whoami (provided for testing the mechanism, should return "root")
  • sudo /sbin/reboot
  • sudo /usr/bin/schedtool
  • sudo /usr/bin/nvidia-smi (please notify other users via the digitalis mailing list if you change parameters on GPUs that will not be reset to default after a reboot, e.g. the memory ECC configuration)
  • sudo /usr/local/bin/ipmi-reset

System changelog

Currently, the default system is outdated:

  • Debian squeeze
  • Cuda 4
  • ...

System is to be updated. Help welcome.

To be completed

Personal tools