Questions tagged [benchmarking]

The tag has no usage guidance.

13
votes
1answer
871 views

What are the guidelines for conducting computational experiments?

Physics, biology, chemistry etc. have different sets of rules for making experiments: what events are considered relevant, how to avoid contamination of samples, how to create and fix a reproducing ...
1
vote
2answers
175 views

Flow past square cylinder benchmark in 2D. Famous papers to compare

I'm looking for a benchmark for the flow past square cylinder problem in 2D to compare my results. I have found some papers, but it seems that there are different results in different papers. I want ...
3
votes
2answers
180 views

Benchmark setup for incompressible Rayleigh-Taylor flow

I'm trying to benchmark a new numerical method for the incompressible Navier-Stokes equations. I'd like to use the most widely-accepted test cases possible. In particular, I'm looking for a ...
1
vote
2answers
176 views

Computational Science Hardware Benchmark Database

I am looking for a website/database of computer hardware (CPUs/GPUs) benchmarked with common scientific tools, e.g. *GEMM (see comment below for more info on this tool). Currently, I am quite ...
8
votes
2answers
235 views

How much does choice of OS matter for performance of scientific computing code?

It's common parlance to say that Linux is faster, and for good reasons. But as stated in the title, how much does choice of OS matter for performance of scientific computing code? For something things ...
7
votes
1answer
763 views

Integer vs float multiplication performance, modern CPUs

Are there benchmarks for how many multiplications of various integer types compared to floating point types can be achieved per second on modern CPUs? I'm trying to get some hint if it would be ...
4
votes
2answers
400 views

Lid-driven Cavity benchmark in 3D. Classical paper to compare

I'm looking for a benchmark for the lid-driven cavity problem in 3D to compare the results of my code. In 2D I used: U. K. N. G. Ghia, K. N. Ghia and C. T. Shin (1982) High-Re solutions for ...
3
votes
1answer
3k views

Is R or Matlab currently faster?

The most up-to-date performance benchmarks comparison between R and Matlab that I could find are several years out of date: 1 2 Is anyone aware of a more up-to-date comparison?
3
votes
1answer
215 views

How does matrix-matrix product scale with multiple CPUs?

These days, one can have 64 cores in a single node. I wonder how well the dense matrix-matrix product (SGEMM and DGEMM) scales ...
5
votes
1answer
178 views

What is the correct way of performing numerical experiments on desktops?

Suppose I want to set up an experiment to measure the performance of some numerical code on a desktop machine running Linux/Windows/MacOS. What kind of environment should I arrange in order to get ...
4
votes
1answer
236 views

Useful well-known numeric performance benchmarks other than Linear Algebra?

I am currently testing some new (embedded) processors for their double-precision numeric performance. The FPU capabilities vary wildly between platforms; For example, the ARM Cortex-A8 has a double ...
14
votes
3answers
1k views

Comparison of iteration methods: number of iterations vs. cpu time

I am comparing two iterative methods for inverting random square matrices. Since the matrices are random, every test case takes both different amounts of iterations and different elapsed times. My ...
8
votes
2answers
347 views

How do Volkov and Demmel experimentally determine the latencies, line sizes, and page sizes of a GPU?

In "LU, QR and Cholesky Factorizations using Vector Capabilities of GPUs", by Vasily Volkov and James Demmel, there is an interesting way to interpret the latencies, line sizes, and page sizes of a ...
4
votes
3answers
1k views

CPU benchmarks for numerical kernels

CPU benchmarks available online mostly focus on desktop apps/games and rarely on serial/parallel numerical kernels, specially sparse ones (e.g., MatMult). Some benchmarks like NAS/SciMark exists but ...
4
votes
2answers
389 views

Effects of memory speed/architecture on Pardiso scaling

I am using a program that utilizes the PARDISO solver as part of the Intel math kernel library. I am currently in the process of deciding on a new computer to run the simulations on. I have a ...
74
votes
6answers
17k views

How much better are Fortran compilers really?

This question is an extension of two discussions that came up recently in the replies to "C++ vs Fortran for HPC". And it is a bit more of a challenge than a question... One of the most often-heard ...
6
votes
1answer
506 views

Benchmarking performance in CFD: how to compare machines and codes?

Informally in our lab, we have developed 2 metrics to compare CFD solvers over the range of machines we have access to. One is called COMP, which stands for COde Machine Performance. This single ...