HPC Challenge Benchmark Record

System Information
Affiliation:   NNSA - Lawrence Livermore National Laboratory   URL:   www.llnl.gov
Location:   USA, California, Livermore, CA   System Use:   Government
System Manufacturer:   IBM   System Name:   Dawn
Interconnect Manufacturer:   IBM   Interconnect Type:   Custom Torus + Tree + Barrier
Operating System:   Custom Lightweight kernel   MPI:   MPICH2 1.0.7
MPI Wtick:   0.000000001176471   BLAS:   custom
Language:   C   Compiler:   XLC 9.0
Compiler Flags:   -O3   Processor Type:   Power PC 450
Processor Speed:   0.85 GHz   Total Processors:   147456
Processors Entered:   131072   Processors determined:   131072
Cores per chip:   4   HPL Processes:   32768
MPI Processes:   32768   Threads Entered:   4
Threads determined:   4   FLOPs per cycle:  
Theoretical peak:   445.6 TFlop/s   Total memory:   147456 GiB
FFT library:   custom  
Explain Optimizations:

HPL, FFT and Random Access were modified to utilize Blue Gene specific intrinics, OpenMP, and custom algorithm for RA to take advantage to the network topology of the system.


HPL
HPL:   367.821 Tflop/s   HPL time:   33890.4
HPL eps:   1.11022e-16   HPL Rnorm1:   0.0000144113
HPL Anorm1:   664499   HPL AnormI:   664441
HPL Xnorm1:   47985500   HPL XnormI:   116.811
HPL N:   2654207   HPL NB:   96
HPL NProw:   64   HPL NPcol:   512
HPL depth:   1   HPL NBdiv:   2
HPL NBmin:   6   HPL CPfact:   C
HPL CRfact:   R   HPL CPtop:   6
HPL order:   R
HPL dMach EPS:   1.110223e-16   HPL sMach EPS:   0.00000005960464
HPL dMach sfMin:   2.225074e-308   HPL sMach sfMin:   1.1754939999999999e-38
HPL dMach Base:   2   HPL sMach Base:   2
HPL dMach Prec:   2.220446e-16   HPL sMach Prec:   0.0000001192093
HPL dMach mLen:   53   HPL sMach mLen:   24
HPL dMach Rnd:   1   HPL sMach Rnd:   1
HPL dMach eMin:   -1021   HPL sMach eMin:   -125
HPL dMach rMin:   2.225074e-308   HPL sMach rMin:   1.1754939999999999e-38
HPL dMach eMax:   1024   HPL sMach eMax:   128
HPL dMach rMax:   1.797693e308   HPL sMach rMax:   3.4028230000000003e38
dweps:   1.110223e-16   sweps:   0.00000005960464

PTRANS
PTRANS:   757.123 GB/s   PTRANS time:   17.4557 seconds
PTRANS residual:   0   PTRANS N:   1327103
PTRANS NB:   96   PTRANS NProw:   64
PTRANS NPcol:   512

STREAM
S-STREAM Copy:   7.7674 GB/s   S-STREAM Scale:   3.62628 GB/s
S-STREAM Add:   6.04241 GB/s   S-STREAM Triad:   3.97994 GB/s
EP-STREAM Copy:   7.7674 GB/s   EP-STREAM Scale:   3.62627 GB/s
EP-STREAM Add:   6.04239 GB/s   EP-STREAM Triad:   3.97993 GB/s
STREAM Vector Size:   71663562   STREAM Threads:   4

RandomAccess
S-RandomAccess:   0.0101762 Gup/s   EP-RandomAccess:   0.0101796 Gup/s
G-RandomAccess:   117.127 Gup/s   G-RandomAccess N:   4398046511104
G-RandomAccess time:   150.197 seconds   G-RandomAccess Check Time:   1811.12 seconds
G-RandomAccess Errors:   0   G-RandomAccess Errors Fraction:   0
G-RandomAccess TimeBound:   -1   G-RandomAccess ExeUpdates:   17592186044416
RandomAccess N:   134217728

FFT
S-FFT:   1.22894 GFlop/s   EP-FFT:   1.22518 GFlop/s
MPIFFT:   3201.2 GFlop/s   MPIFFT N:   549755813888
MPIFFT Max Error:   0.00000000000000247321   MPIFFT time0:   0.388409 seconds
MPIFFT time1:   8.57254 seconds   MPIFFT time2:   1.85945 seconds
MPIFFT time3:   9.67398 seconds   MPIFFT time4:   3.51935 seconds
MPIFFT time5:   9.3404 seconds   MPIFFT time6:   0.134039 seconds
FFTEnblk:   16   FFTEnp:   8
FFTEl2size:   1048576

DGEMM
S-DGEMM:   11.0728 GFlop/s   EP-DGEMM:   11.0748 GFlop/s
DGEMM N:   8464

RandomRing Latency/Bandwidth
RandomRing Latency:   5.59209 usec   RandomRing Bandwidth:   0.0222697 GB/s

NaturalRing Latency/Bandwidth
NaturalRing Latency:   4.72953 usec   NaturalRing Bandwidth:   0.374225 GB/s

PingPong Latency/Bandwidth
Maximum PingPong Latency:   6.64294 usec   Maximum PingPong Bandwidth:   0.385787 GB/s
Minimum PingPong Latency:   3.04846 usec   Minimum PingPong Bandwidth:   0.376624 GB/s
Average PingPong Latency:   4.74949 usec   Average PingPong Bandwidth:   0.382208 GB/s

Size of Data Types
char:   1 byte     short:   2 bytes
int:   4 bytes   long:   4 bytes
void ptr:   4 bytes   float:   4 bytes
double:   8 bytes   size t:   4 bytes
s64Int:   8 bytes   u64Int:   8 bytes

OpenMP
M OpenMP:   200505   OpenMP Num Threads:   4
OpenMP Num Procs:   4   OpenMP Max Threads:   4

Memory
MemProc:   -1   MemSpec:   -1
MemVal:   -1

CPS
CPS_HPCC_FFT_235:   0   CPS_HPCC_FFTW_ESTIMATE:   0
CPS_HPCC_MEMALLCTR:   1   CPS_HPL_USE_GETPROCESSTIMES:   0
CPS_RA_SANDIA_NOPT:   0   CPS_RA_SANDIA_OPT2:   0


Version: 1.2.0.f - Run Type: opt - Parent ID: 386
Created: 2009-11-11 - Exported: Wed Sep 3 00:53:12 2014
HPC Challenge Benchmark Record