Willus.com Home   |   Archive   |   About  

   CONTENTS

I. BACKGROUND
    1. Overview
    2. The Compilers
    3. Compiler Options
    4. The Programs
    5. Test Hardware
    6. Compiler Issues
    7. Other notes

II. RESULTS
    1. BW1D
    2. BZIP2
    3. CRAFTY
    4. K2PDFOPT (v1.30)
    5. LAME
    6. MESHER
    7. MODEL3D
    8. RESIZER
    9. TRANSCEND
    10. X264
    11. AVERAGE

III. SUMMARY

IV. COMMENTS

  
  
  
Willus.com's 2011 Win32/64 C Compiler Benchmarks:
II. RESULTS

3. CRAFTY
CODE: CRAFTY
LANGUAGE: C
LINES: 37,000
MEMORY FOOTPRINT: 20 MB
DESCRIPTION: Robert M. Hyatt's Crafty chess engine v23.4 from craftychess.com. I compiled it without the end-game tables (the C++ portion of the code). There is virtually no floating point in this benchmark. At the heart of the code are some bit-shifting/manipulating functions (LSB and MSB) that are usually replaced by optimized in-line assembly functions, but I wanted the compilers to have to do the work, so I used the C versions of these functions rather than the in-line assembly versions. I increased the PERFCYCLES values for the "perf" test loop and than timed how long the "perf" and "perft 6" commands took for the benchmark.

Click on a column heading to sort the rows based on the data in that column.
Compiler IPO Profiler // .exe
type
Total Build
Time (s)
.exe size
(MiB)
Run
Time (s)
Normalized
Run Time
tcc925       32-bit 1 0.40 150.2 7.33
msvc2010 X     32-bit 4 0.35 38.3 1.87
msvc2010       32-bit 4 0.35 40.7 1.99
msvc2010 X     64-bit 5 0.37 22.4 1.09
msvc2010       64-bit 5 0.38 22.6 1.10
gcc342       32-bit 6 0.42 52.6 2.57
gcc463       64-bit 6 0.44 24.5 1.20
intel11 X     32-bit 6 0.46 33.9 1.65
gcc463       32-bit 7 0.44 42.7 2.09
intel11 X   X 32-bit 7 0.47 34.7 1.70
intel11 X     64-bit 8 0.47 22.2 1.08
intel11 X   X 64-bit 8 0.48 22.0 1.07
intel11 X X   32-bit 10 0.39 32.3 1.58
intel11   X   32-bit 11 0.39 32.1 1.57
intel11 X X X 32-bit 11 0.41 32.6 1.59
gcc463   X   64-bit 13 0.37 22.6 1.10
gcc463   X   32-bit 14 0.37 39.1 1.91
gcc463 X     64-bit 14 0.42 23.6 1.15
gcc463 X     32-bit 15 0.42 42.0 2.05
intel11   X   64-bit 15 0.43 20.6 1.00
intel11       64-bit 15 0.47 22.3 1.09
gcc463 X   X 64-bit 15 0.50 23.6 1.15
gcc463 X   X 32-bit 16 0.49 41.9 2.04
intel11 X X   64-bit 18 0.43 20.7 1.01
intel11 X X X 64-bit 18 0.45 20.5 1.00
intel11       32-bit 22 0.48 33.4 1.63
dmc842       32-bit 24 0.31 44.1 2.15
gcc463 X X   64-bit 29 0.37 22.9 1.12
gcc463 X X   32-bit 30 0.37 38.9 1.90
gcc463 X X X 64-bit 32 0.45 22.7 1.11
gcc463 X X X 32-bit 33 0.44 38.7 1.89

      
  <<  Previous: BZIP2

Next: K2PDFOPT (v1.30)   >>

 
This page last modified
Sunday, 08-Feb-2015 18:58:10 MST