About Cray Clusters at NSCEE
The National Supercomputing Center for Energy and the Environment (http://www.nscee.edu) has several high-performance computing clusters available. Two of them (eureka and yucca) are manufactured by Cray Inc..
Eureka is the production cluster and consists of a Cray CX-1000 with four distinct node types:
- Head Node - 2 cpu sockets and 24Gb ram, Each socket contains a 6 core Intel Xeon X5650 @ 2.67GHz. It also has a system attached storage array of ~50TB.
- COMPUTE - 72 blades, each with 2 cpu sockets and 24Gb ram. Each socket contains a 6 core Intel Xeon X5650 @ 2.67GHz. Each compute node also has a combined 360Gb/s inifiniband interconnect for communication between nodes.
- GPU - 9 blades, each with 2 cpu sockets, 24Gb ram, and 2 nVidia Corporation Telsa M2075 Dual-Slot Computing Module. Each GPU node also has a 40Gb/s inifiniband interconnect.
- SMP - Eureka has 8 mono SMP nodes (each with 32 cores Xeon X7560 @ 2.26GHz and 256Gb shared memory). Four of these nodes can form a single "quadri" mode (4 mono nodes each coupled with an hardware cache coherency interconnect based on the external Intel QuickPath Interconnect (QPI). The external QPI allows the four "mono" nodes to connect their system buses so they appear as one large system (128 cores and 1Tb shared memory). We no longer run in quadri mode, due to hardware reliability issues.
Yucca is a small development and test cluster. It is available for use by users to develop and test programs before moving them to eureka. It is also used by NSCEE staff to test configuration changes before they are applied to the production cluster.