Benchmarking Implementations of Functional Languages with ``Pseudoknot'', a Float-Intensive Benchmark

Share/Save/Bookmark

Hartel, P.H. and Feeley, M. and Alt, M. and Augustsson, L. (1996) Benchmarking Implementations of Functional Languages with ``Pseudoknot'', a Float-Intensive Benchmark. Journal of functional programming, 6 (4). pp. 621-655. ISSN 0956-7968

[img]
Preview
PDF
295Kb
Abstract:Over 25 implementations of different functional languages are benchmarked using the same program, a floatingpoint intensive application taken from molecular biology. The principal aspects studied are compile time and execution time for the various implementations that were benchmarked. An important consideration is how the program can be modified and tuned to obtain maximal performance on each language implementation.
With few exceptions, the compilers take a significant amount of time to compile this program, though most compilers were faster than the then current GNU C compiler (GCC version 2.5.8). Compilers that generate C or Lisp are often slower than those that generate native code directly: the cost of compiling the intermediate form is normally a large fraction of the total compilation time.
There is no clear distinction between the runtime performance of eager and lazy implementations when appropriate annotations are used: lazy implementations have clearly come of age when it comes to implementing largely strict applications, such as the Pseudoknot program. The speed of C can be approached by some implemtations, but to achieve this performance, special measures such as strictness annotations are required by non-strict implementations.
The benchmark results have to be interpreted with care. Firstly, a benchmark based on a single program cannot cover a wide spectrum of 'typical' applications.j Secondly, the compilers vary in the kind and level of optimisations offered, so the effort required to obtain an optimal version of the program is similarly varied.
Item Type:Article
Copyright:© 1996 Cambridge University Press
Link to this item:http://purl.utwente.nl/publications/55704
Official URL:http://eprints.eemcs.utwente.nl/1109/01/JFP_pseudoknotI.pdf
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page