HPC Challenge Benchmark Record

System Information
Affiliation:   IBM Development Engineering - DARPA Trial Subset   URL:   http://www.ibm.com
Location:   USA, Endicott   System Use:   Research
System Manufacturer:   IBM   System Name:   IBM Power775
Interconnect Manufacturer:   IBM   Interconnect Type:   IBM Hub Chip integrated interconnect
Operating System:   Redhat Linux 6.2   MPI:   IBM PE MPI release 1206
MPI Wtick:   0.0000000005252101   BLAS:   IBM ESSL 5.1
Language:   C   Compiler:   xlc 11.1
Compiler Flags:   -qhalt=w -qsmp=omp -g -q64 -O3 -qhot -qarch=pwr7 -qtune=pwr7   Processor Type:   IBM Power7 Quad-Chip module
Processor Speed:   3.836 GHz   Total Processors:   1488
Processors Entered:   1470   Processors determined:   47040
Cores per chip:   32   HPL Processes:   1470
MPI Processes:   1470   Threads Entered:   32
Threads determined:   32   FLOPs per cycle:  
Theoretical peak:   1443.56352 TFlop/s   Total memory:   188160 GiB
FFT library:   FFTW  
Explain Optimizations:

All optimizations done to routines in accordance with HPCC rules

Customized G-RandomAccess and EP-RandomAccess: Uses IBM hardware support. 

Customized G-PTRANS: Bypasses MPI and uses IBM Hub Chip interconnect

Customized G-FFT: Uses IBM Hub Chip interconnect during transpose phase

Customized EP-Stream: Uses pthreads explicit paralleization

Customized G-HPL: Uses OpenMP during LASWP phase


HPL
HPL:   1067.79 Tflop/s   HPL time:   12761.8
HPL eps:   1.11022e-16   HPL Rnorm1:   0.00000141383
HPL Anorm1:   684854   HPL AnormI:   684695
HPL Xnorm1:   3028690   HPL XnormI:   7.23258
HPL N:   2734200   HPL NB:   144
HPL NProw:   30   HPL NPcol:   49
HPL depth:   1   HPL NBdiv:   2
HPL NBmin:   4   HPL CPfact:   R
HPL CRfact:   R   HPL CPtop:   1
HPL order:   R
HPL dMach EPS:   1.110223e-16   HPL sMach EPS:   0.00000005960464
HPL dMach sfMin:   2.225074e-308   HPL sMach sfMin:   1.175494e-38
HPL dMach Base:   2   HPL sMach Base:   2
HPL dMach Prec:   2.220446e-16   HPL sMach Prec:   0.0000001192093
HPL dMach mLen:   53   HPL sMach mLen:   24
HPL dMach Rnd:   1   HPL sMach Rnd:   1
HPL dMach eMin:   -1021   HPL sMach eMin:   -125
HPL dMach rMin:   2.225074e-308   HPL sMach rMin:   1.175494e-38
HPL dMach eMax:   1024   HPL sMach eMax:   128
HPL dMach rMax:   1.797693e308   HPL sMach rMax:   3.402823e38
dweps:   1.110223e-16   sweps:   0.00000005960464

PTRANS
PTRANS:   46006.3 GB/s   PTRANS time:   0.32415 seconds
PTRANS residual:   0   PTRANS N:   1367100
PTRANS NB:   15   PTRANS NProw:   30
PTRANS NPcol:   49

STREAM
S-STREAM Copy:   177.742 GB/s   S-STREAM Scale:   175.601 GB/s
S-STREAM Add:   205.47 GB/s   S-STREAM Triad:   264.371 GB/s
EP-STREAM Copy:   178.843 GB/s   EP-STREAM Scale:   176.583 GB/s
EP-STREAM Add:   207.753 GB/s   EP-STREAM Triad:   265.299 GB/s
STREAM Vector Size:   1695204000   STREAM Threads:   32

RandomAccess
S-RandomAccess:   1.14777 Gup/s   EP-RandomAccess:   1.14762 Gup/s
G-RandomAccess:   1571.91 Gup/s   G-RandomAccess N:   4398046511104
G-RandomAccess time:   11.1916 seconds   G-RandomAccess Check Time:   2796.76 seconds
G-RandomAccess Errors:   0   G-RandomAccess Errors Fraction:   0
G-RandomAccess TimeBound:   -1   G-RandomAccess ExeUpdates:   17592186044416
RandomAccess N:   4294967296

FFT
S-FFT:   109.307 GFlop/s   EP-FFT:   109.506 GFlop/s
MPIFFT:   94855.8 GFlop/s   MPIFFT N:   918330048000
MPIFFT Max Error:   0.00000000000000437377   MPIFFT time0:   0 seconds
MPIFFT time1:   0 seconds   MPIFFT time2:   0 seconds
MPIFFT time3:   0 seconds   MPIFFT time4:   0 seconds
MPIFFT time5:   0 seconds   MPIFFT time6:   0 seconds
FFTEnblk:   16   FFTEnp:   8
FFTEl2size:   1048576

DGEMM
S-DGEMM:   816.061 GFlop/s   EP-DGEMM:   815.38 GFlop/s
DGEMM N:   41172

RandomRing Latency/Bandwidth
RandomRing Latency:   5.22689 usec   RandomRing Bandwidth:   3.38332 GB/s

NaturalRing Latency/Bandwidth
NaturalRing Latency:   4.85042 usec   NaturalRing Bandwidth:   6.71555 GB/s

PingPong Latency/Bandwidth
Maximum PingPong Latency:   5.57773 usec   Maximum PingPong Bandwidth:   15.3959 GB/s
Minimum PingPong Latency:   1.63826 usec   Minimum PingPong Bandwidth:   4.26162 GB/s
Average PingPong Latency:   2.72818 usec   Average PingPong Bandwidth:   5.55567 GB/s

Size of Data Types
char:   1 byte     short:   2 bytes
int:   4 bytes   long:   8 bytes
void ptr:   8 bytes   float:   4 bytes
double:   8 bytes   size t:   8 bytes
s64Int:   8 bytes   u64Int:   8 bytes

OpenMP
M OpenMP:   200805   OpenMP Num Threads:   32
OpenMP Num Procs:   64   OpenMP Max Threads:   32

Memory
MemProc:   -1   MemSpec:   -1
MemVal:   -1

CPS
CPS_HPCC_FFT_235:   1   CPS_HPCC_FFTW_ESTIMATE:   0
CPS_HPCC_MEMALLCTR:   0   CPS_HPL_USE_GETPROCESSTIMES:   0
CPS_RA_SANDIA_NOPT:   0   CPS_RA_SANDIA_OPT2:   0


Version: 1.4.1.f - Run Type: opt - Parent ID: 481
Created: 2012-07-15 - Exported: Fri Oct 31 15:23:18 2014
HPC Challenge Benchmark Record