thread-ring benchmark N=50,000,000
Each chart bar shows how many times slower, one ↓ thread-ring program was, compared to the fastest program.
These are not the only programs that could be written. These are not the only compilers and interpreters. These are not the only programming languages.
Column × shows how many times more each program used compared to the benchmark program that used least.
| sort | sort | sort | ||||
| × | Program Source Code | CPU secs | Elapsed secs | Memory KB | Code B | ≈ CPU Load |
|---|---|---|---|---|---|---|
| 1.0 | Haskell GHC | 9.92 | 9.10 | 3,820 | 307 | 4% 3% 2% 100% |
| 1.6 | Go #5 | 14.60 | 14.62 | 2,852 | 405 | 0% 1% 100% 0% |
| 3.7 | F# Mono #3 | 34.08 | 34.09 | 29,304 | 329 | 0% 0% 0% 100% |
| 14 | Clojure #2 | 147.90 | 125.34 | 396,744 | 299 | 41% 42% 16% 15% |
| 14 | Clojure | 149.95 | 125.37 | 407,644 | 348 | 39% 40% 18% 19% |
| 17 | Racket | 158.66 | 158.65 | 48,884 | 262 | 1% 0% 0% 100% |
| 19 | C++ g++ #5 | 9 min | 176.55 | 2,504 | 652 | 88% 86% 87% 88% |
| 21 | C++ g++ #4 | 9 min | 189.79 | 2,504 | 572 | 81% 78% 79% 81% |
| 29 | OCaml #2 | 5 min | 264.11 | 676 | 350 | 9% 45% 45% 9% |
| 29 | C++ g++ #2 | 5 min | 265.44 | 4,544 | 588 | 5% 51% 52% 2% |
| 29 | ATS | 267.91 | 266.67 | 4,532 | 1065 | 1% 38% 38% 1% |
| 30 | OCaml #3 | 5 min | 268.63 | 2,984 | 296 | 5% 50% 51% 4% |
| 30 | C++ g++ | 6 min | 270.66 | 3,012 | 636 | 9% 57% 57% 4% |
| 31 | C gcc #2 | 5 min | 280.24 | 2,428 | 575 | 18% 29% 29% 16% |
| 33 | F# Mono #2 | 13 min | 5 min | 42,104 | 555 | 65% 59% 72% 69% |
| 35 | Ada 2005 GNAT #4 | 7 min | 5 min | 6,656 | 960 | 55% 3% 3% 56% |
| 35 | Ada 2005 GNAT #3 | 7 min | 5 min | 6,652 | 727 | 2% 58% 58% 2% |
| 36 | Python 3 #2 | 7 min | 5 min | 6,700 | 288 | 1% 66% 65% 1% |
| 41 | Lisp SBCL | 8 min | 6 min | 53,940 | 618 | 20% 42% 42% 20% |
| 41 | Java 7 #3 | 6 min | 6 min | 288,644 | 530 | 1% 46% 46% 1% |
| 42 | Ada 2005 GNAT #2 | 10 min | 6 min | 6,652 | 560 | 1% 72% 73% 1% |
| 48 | OCaml | 9 min | 7 min | 7,608 | 282 | 63% 1% 1% 64% |
| 50 | C# Mono | 13 min | 7 min | 18,240 | 476 | 29% 30% 58% 58% |
| 53 | Ada 2005 GNAT | 14 min | 8 min | 6,656 | 602 | 13% 74% 75% 6% |
| 62 | Lisp SBCL #2 | 12 min | 9 min | 59,760 | 571 | 30% 32% 32% 31% |
| 74 | Perl #3 | 14 min | 11 min | 421,420 | 489 | 55% 6% 6% 56% |
| 162 | Ruby 2.0 #2 | 42 min | 24 min | 15,096 | 215 | 16% 60% 61% 19% |
| C gcc #3 | Failed | 916 | ||||
| C gcc | Make Error | 487 | ||||
| C gcc #4 | Timed Out | 10 min | 761 | |||
| Erlang HiPE | Failed | 273 | ||||
| Pascal Free Pascal | Make Error | 523 | ||||
| Perl | Timed Out | 1h 00 min | 353 | |||
| Ruby 2.0 | Failed | 331 | ||||
| Ruby JRuby #2 | Failed | 228 | ||||
| Ruby JRuby | Failed | 342 | ||||
| Scala | Failed | 296 | ||||
| "wrong" (different) algorithm / less comparable programs | ||||||
| 0.1 | Ada 2005 GNAT #5 | 0.58 | 0.55 | 6,656 | 1476 | |
| 0.1 | Java 7 #6 | 1.10 | 1.16 | 216,212 | 543 | |
| 0.3 | F# Mono #4 | 2.45 | 2.46 | 23,140 | 267 | |
| 0.6 | Java 7 #2 | 5.39 | 5.28 | 144,056 | 693 | |
| 1.3 | Python 3 #3 | 11.96 | 11.97 | 4,568 | 270 | |
| 1.8 | C++ g++ #3 | 16.18 | 16.19 | 2,556 | 726 | |
| 1.9 | Java 7 #5 | 19.42 | 17.71 | 100,784 | 432 | |
| 3.8 | Java 7 #4 | 37.64 | 34.68 | 104,948 | 894 | |
| missing benchmark programs | ||||||
| Dart | No program | |||||
| Fortran Intel | No program | |||||
| PHP | No program | |||||
thread-ring benchmark : Switch from thread to thread passing one token
diff program output N = 1000 with this output file to check your program is correct before contributing.
Each program should create and keep alive 503 pre-emptive threads, explicity or implicitly linked in a ring, and pass a token between one thread and the next thread at least N times.
We are trying to show the performance of various programming language implementations - so we ask that contributed programs not only give the correct result, but also use the same algorithm to calculate that result.
Each program should
- create 503 linked pre-emptive threads (named 1 to 503)
- thread 503 should be linked to thread 1, forming an unbroken ring
- pass a token to thread 1
- pass the token from thread to thread N times
- print the name of the last thread (1 to 503) to take the token
Similar benchmarks are described in Performance Measurements of Threads in Java and Processes in Erlang, 1998; and A Benchmark Test for BCPL Style Coroutines, 2004. (Note: 'Benchmarks that may seem to be concurrent are often sequential. The estone benchmark, for instance, is entirely sequential. So is also the most common implementation of the "ring benchmark'; usually one process is active, while the others wait in a receive statement.') For some language implementations increasing the number of threads quickly results in Death by Concurrency.
Programs may use pre-emptive kernel threads or pre-emptive lightweight threads; but programs that use non pre-emptive threads (coroutines, cooperative threads) and any programs that use custom schedulers, will be listed as interesting alternative implementations. Briefly say what concurrency technique is used in the program header comment.