Repository files navigation

Benchmarks for various Scheme implementations. Taken with kind permission from the Larceny project, based on the Gabriel and Gambit benchmarks.

See the resultshere

Just run

./bench <scheme> <test>

Schemes that should work:

• Bigloo (bigloo)
• Bones (bones)
• Chez (chez)
• Chibi (chibi)
• Chicken (chicken)
• Cyclone (cyclone)
• Foment (foment)
• GambitC (gambitc)
• Gauche (gauche)
• Guile (guile)
• IronScheme (ironscheme)
• Kawa (kawa)
• Larceny (larceny)
• Loko (loko)
• MIT/GNU Scheme (mit)
• Mosh (mosh)
• Petite Chez (chez)
• Picrin (picrin)
• Racket (racket)
• Rhizome/Pi (rhizome)
• RScheme (rscheme)
• Sagittarius (sagittarius)
• Scheme48 (scheme48)
• Scheme 9 from Empty Space (s9fes)
• TR7, tiny R7RS interpreter (TR7)
• Vicare (vicare)
• Ypsilon (ypsilon)

This should result in a file./results.<scheme>.

All of these Schemes are packaged for ArchLinux. The tests are run with whatever that package produces.

Run

make csv

to produce a fileall.csv with the test results (<scheme>,<test>,<seconds>).

The environment variableCPU_TIME can be set, to limit the time for compilation and for running (each individually).

CPU_TIME=3600 ./bench chez all

You can set an environment variable to specify the path to each Scheme.

LARCENY=/tmp/larceny/larceny MIT=/tmp/mit/mit-scheme ./bench "mit larceny" "fib ack"

The chicken test code assumes the presence of

• vector-lib
• r7rs

Install them by running

chicken-install vector-lib r7rs

The racket test code assumes the presence ofhttps://github.com/lexi-lambda/racket-r7rs.git.

Install the r7rs package installation-wide.

Run:

sudo raco pkg install --scope installation r7rs

Install the latest version of .NET Runtime (currently 9.0-preview, requires at least IronScheme 1.0.357) fromhttps://dotnet.microsoft.com/en-us/download/dotnet .

The default binary for IronScheme (can be changed by exporting IRONSCHEME in your shell before running bench) is calledironscheme.

If you unpack IronScheme in your home, you can create a shell script like the following:

#!/bin/bashexport DOTNET_CLI_TELEMETRY_OPTOUT=1dotnet ~/IronScheme/IronScheme.ConsoleCore.dll $*

and put that somewhere in your$PATH.

Before calling Stalin, the code is run throughalexpander (by default using Chicken’scsi). Then stalin is invoked on the result.

Missing a lot of necessary functions,read for example.

Problems with redirecting input,read chokes. No timing functions.

The benchmarking code doesnot use unsafe optimizations. These make code run even faster (but less safe ;) Specific options that could be used are:

Chez

--optimize-level 3

Gerbil / Gambit

(declare (not safe))