Idgraf

From Digitalis

(Difference between revisions)
Jump to: navigation, search
(Other platforms with MICs)
 
(5 intermediate revisions not shown)
Line 27: Line 27:
* sudo /sbin/reboot
* sudo /sbin/reboot
* sudo /usr/bin/schedtool
* sudo /usr/bin/schedtool
 +
* sudo /usr/bin/opcontrol
 +
* sudo /usr/bin/perf
 +
* sudo /opt/likwid/bin/likwid-perfctr
 +
* sudo /opt/likwid/bin/likwid-topology
* sudo /usr/bin/nvidia-smi (please notify other users via the [mailto:digitalis@lists.grid5000.fr digitalis mailing list] if you change parameters on GPUs that will not be reset to default after a reboot, '''e.g. the memory ECC configuration''')
* sudo /usr/bin/nvidia-smi (please notify other users via the [mailto:digitalis@lists.grid5000.fr digitalis mailing list] if you change parameters on GPUs that will not be reset to default after a reboot, '''e.g. the memory ECC configuration''')
* sudo /usr/local/bin/ipmi-reset
* sudo /usr/local/bin/ipmi-reset
-
 
+
* sudo /usr/bin/lstopo
-
== Other experimental platforms with MICs ==
+
-
=== Grid'5000 ===
+
-
4 nodes with 1 Xeon Phi each are available on Grid'5000 Nancy's site, in the Graphite cluster. See:
+
-
* https://www.grid5000.fr/mediawiki/index.php/Nancy:Hardware#Graphite
+
-
* https://www.grid5000.fr/mediawiki/index.php/Accelerators_on_Grid%275000
+
-
 
+
-
=== Irisa ===
+
-
[mailto:Guillermo.Andrade-barroso@inria.fr Guillermo Andrade-barroso] installed a Xeon Phi host server at INRIA Rennes.
+
-
This server hosts 1 Intel® Xeon Phi™ 5110P (8 G, 1.053 GHz, 60 cores) under Debian 7.0 64 bits.
+
-
 
+
-
Access to this server is available for all INRIA members on demand.
+
-
 
+
-
The machine name is phileas.irisa.fr
+
-
 
+
-
=== Bordeaux - Plafrim ===
+
-
https://plafrim.bordeaux.inria.fr/doku.php?id=plateforme:configurations:mistral
+
== System changelog ==
== System changelog ==
Line 55: Line 43:
System is to be updated. Help welcome.
System is to be updated. Help welcome.
-
To be completed
+
== Acknolegment ==
 +
The idgraf machine was funded by the Mescal and Moais teams of LIG/Inria.

Current revision as of 09:22, 29 August 2016

| Introduction | Usage | Idfreeze | Idgraf | Idphix | Idbool | Idkat | Idcin | Idarm | Ppol | Grimage |

Contents

Overview

Idgraf is a Bi-Socket Intel Xeon Westmere machine featuring 8 Nvidia GPU

  • 2x Intel Xeon X5650 (Westmere, 6 cores each, total 12 cores)
  • 72 GB RAM
  • 8x coprocesseur Nvidia Tesla C2050

See:

Beware that to support 8 GPU on a bi-socket Nehalem based machine, in addition to the need of 2 IOH connected via QPI buses, 2 PCI-e switches are required (PLXTech PEX8647 here), possibly limiting the bandwidth to the PCI-e cards.

See:

How to experiment

Privileged commands

Currently, the following commands can be run via sudo in exclusive jobs:

  • sudo /usr/bin/whoami (provided for testing the mechanism, should return "root")
  • sudo /sbin/reboot
  • sudo /usr/bin/schedtool
  • sudo /usr/bin/opcontrol
  • sudo /usr/bin/perf
  • sudo /opt/likwid/bin/likwid-perfctr
  • sudo /opt/likwid/bin/likwid-topology
  • sudo /usr/bin/nvidia-smi (please notify other users via the digitalis mailing list if you change parameters on GPUs that will not be reset to default after a reboot, e.g. the memory ECC configuration)
  • sudo /usr/local/bin/ipmi-reset
  • sudo /usr/bin/lstopo

System changelog

Currently, the default system is outdated:

  • Debian squeeze
  • Cuda 4
  • ...

System is to be updated. Help welcome.

Acknolegment

The idgraf machine was funded by the Mescal and Moais teams of LIG/Inria.

Personal tools
platforms