Willus.com Home   |   Archive   |   About  

Willus.com's MinGW/Gnu C Tips

MinGW Tips
Overview
Install Notes
Benchmark
Starter Links
Compile Flags
Fast Math Funcs
DLLs
Globbing
Console
Binary Stdout
Predefined Macros
Show All Tips
 
  Benchmarks

DEC 29, 2011 See my latest 2011 Win32/64 C Compiler Benchmarks.

I did my first compiler benchmarks in 2002. Below are some more recent ones that are more limited in scope.

NOV 19, 2011 (There are older 2010 benchmarks below. Scroll down for those.)
Today I benchmarked MinGW gcc 4.5.2 (32-bit and 64-bit), gcc 4.4.x (32-bit and 64-bit), and Fabrice Bellard's TCC, an amazingly small compiler that emphasizes compile speed. All benchmarks were compiled and run on my home PC, a Core i5-670 with 3.7 GHz turbo-boost speed running 64-bit Windows 7 (SP 1). TCC lives up to its claims of compiling almost 10 times faster than gcc, but, as might be expected, that compile performance comes with a significant penalty in executable performance (3 - 4 times slower in these two benchmarks). For what it is intended to be--a very lightweight, pseudo-scriptable C compiler, TCC is a remarkable achievement.

Benchmark #1, Image manipulation: crop and re-size 163 images
Lines of code: Approx. 250 K
Compiler Compiler Options Exe Type Compile Time Exe Size Exe Run Time
gcc 4.4.0 -O3 -ffast-math -m32 32-bit 70.0 s 2.09 MiB 105.4 s
gcc 4.4.5 -O3 -ffast-math -m64 64-bit 74.0 s 2.33 MiB 78.9 s
gcc 4.5.2 -O3 -ffast-math -m32 32-bit 93.5 s 2.24 MiB 105.7 s
gcc 4.5.2 -O3 -ffast-math -m64 64-bit 92.2 s 2.28 MiB 76.5 s
tcc 0.9.25 (none) 32-bit 10.2 s 2.22 MiB 325.1 s


Benchmark #2, Beam-Wave Interaction Simulator (heavy use of floating point)
Lines of code: Approx. 350 K
Compiler Compiler Options Exe Type Compile Time Exe Size Exe Run Time
gcc 4.4.0 -O3 -ffast-math -m32 32-bit 99.5 s 3.54 MiB 29.0 s
gcc 4.4.5 -O3 -ffast-math -m64 64-bit 102.3 s 3.98 MiB 25.3 s
gcc 4.5.2 -O3 -ffast-math -m32 32-bit 127.1 s 3.79 MiB 27.6 s
gcc 4.5.2 -O3 -ffast-math -m64 64-bit 126.4 s 3.95 MiB 25.8 s
tcc 0.9.25 (none) 32-bit 13.0 s 3.96 MiB 93.8 s



FEB 2, 2010
I was able to benchmark some different versions of MinGW gcc with both 32-bit and 64-bit executables, mostly under Windows 7 64-bit (freshly installed). I ran a couple of benchmarks. Interestingly, for one benchmark, going from gcc 3.X to gcc 4.X made a factor of two difference in the speed. For another, it made almost no difference. Other notes: both benchmarks are single threaded; using the -march=native and -mtune=native (I think -mtune=native is the default) didn't buy much over just using -O3 -ffast-math; and 64-bit bought about a 15% - 25% improvement over 32-bit.

Benchmark #1, Crop and re-size 200 images
Compiler/Flags Compiled on Exe Type Exe Run Time Run on
gcc 3.4.2 -O3 -ffast-math AMD 3200+ 32-bit 548 s Win XP/AMD 3200+ 2.0 GHz
gcc 3.4.2 -O3 -ffast-math AMD 3200+ 32-bit 451 s Win 7/Core i5 3.46 GHz
gcc 4.4.3 (no optimization) Core i5 64-bit 420 s Win 7/Core i5 3.46 GHz
gcc 3.4.2 -O3 -ffast-math Core i5 32-bit 254 s Win 7/Core i5 3.46 GHz
gcc 4.4.0 -O3 -ffast-math Core i5 32-bit 115 s Win 7/Core i5 3.46 GHz
gcc 4.4.3 -O3 -ffast-math Core i5 64-bit 90 s Win 7/Core i5 3.46 GHz
gcc 4.4.3 -O3 -ffast-math -march=native -mtune=native Core i5 64-bit 90 s Win 7/Core i5 3.46 GHz

Benchmark #2, Beam-Wave Interaction Simulator
Compiler/Flags Compiled on Exe Type Exe Run Time Run on
gcc 3.2 -O3 -ffast-math AMD 3200+ 32-bit 79 s Win XP/AMD 3200+ 2.0 GHz
gcc 3.2 -O3 -ffast-math AMD 3200+ 32-bit 40 s Win 7/Core i5 3.7 GHz*
gcc 3.4.2 -O3 -ffast-math Core i5 32-bit 28.9 s Win 7/Core i5 3.7 GHz*
gcc 4.4.0 -O3 -ffast-math Core i5 32-bit 29.0 s Win 7/Core i5 3.7 GHz*
gcc 4.4.3 -O3 -ffast-math Core i5 64-bit 25.8 s Win 7/Core i5 3.7 GHz*
* - 3.7 GHz is clock speed in turbo boost mode.

Benchmark #3, Info-Zip's Zip 3.1/Unzip 6.0
All versions were run on a core-i5 670 with turbo-boost (Windows 7).
Run times were to zip and unzip (-t) 10.4 GB of mostly JPEG files.
Compiler/Flags Compiled on Exe Type Zip Run Time Unzip Run Time
gcc 3.2 -O3 AMD 3200+ 32-bit 607 s 110 s
gcc 3.4.2 -O3 Core i5 32-bit 569 s 111 s
gcc 4.4.0 -O3 Core i5 32-bit 543 s 109 s
gcc 4.4.3 -O3 Core i5 64-bit 513 s 110 s


Benchmark #4, Info-Zip's Zip 3.1/Unzip 6.0 using bzip2 compression
All versions were run on a core-i5 670 with turbo-boost (Windows 7).
Run times were to zip (-Z bzip2) and unzip (-t) 2.3 GB of mostly JPEG files.
(Strange to note the large run time for gcc 4.4.0 32-bit.)
Compiler/Flags Compiled on Exe Type Zip Run Time Unzip Run Time
gcc 3.2 -O3 AMD 3200+ 32-bit 448 s 200 s
gcc 3.4.2 -O3 Core i5 32-bit 486 s 197 s
gcc 4.4.0 -O3 Core i5 32-bit 711 s 217 s
gcc 4.4.3 -O3 Core i5 64-bit 389 s 181 s


 
MinGW Links
MinGW64 Home
MinGW Home
Users Mail Archive
MinGW Bug List
Gnu C Home

Willus.com Links
Willus.com Home
Win32/64 Compilers
Win32/64 Software
Compiler Benchmark

This page last modified
Saturday, 19-Nov-2011 09:41:53 MST