19 votes
Accepted

What are the guidelines for conducting computational experiments?

A lot has been written about how to design, execute, and report the results of computational experiments. This has obvious connections with open source software and the broader "open science" ...
10 votes

Should benchmarkings be done at all? What is the point?

Yes, benchmarking should be done. I make this claim as an Editor, Author, and Reviewer. Below, I represent these roles' stances slightly hyperbolically. But let me strongman your argument first. In ...
  • 3,566
8 votes

How to properly calculate CPU and GPU FLOPS performance?

You can calculate GFLOP rates this way, but the numbers are pretty meaningless on today's hardware: Floating point operations require a variable number of clock cycles. An addition is generally ...
7 votes
Accepted

How to measure efficiency of the differential equations solver

There are many different ways to do this. One of the standard is a work-precision plot where you plot the amount of time or function calls that it takes in order to achieve a certain level of accuracy....
7 votes

Should benchmarkings be done at all? What is the point?

Benchmarks are useful, but no benchmark tells the whole story. There are many useful benchmarks. For example, the Julia microbenchmarks are an interesting case of an isolating benchmark: it tries to ...
4 votes
Accepted

Why do people omit the lowest times when averaging timing results?

I don't know why Chris Rackaukas hid his answer because it's actually quite good. In the following, I'm going to assume that the program being tested is executing the same instructions every single ...
4 votes

Integer vs float multiplication performance, modern CPUs

In general, the answers is no. Modern CPU's excel at problems which have high arithmetic intensity and are implemented using floating point arithmetic. A few figures will help explain the ...
3 votes

How much does choice of OS matter for performance of scientific computing code?

I remember reading two or three years ago statistics about OS distribution for the List of the 500 fastest computers world wide. Linux/unix based running computer number was 498, Windows based 2 and ...
2 votes

How much does choice of OS matter for performance of scientific computing code?

There should be little difference in principle as the underlying tool kits are usually similar if not the same: libraries, compilers (and hardware). In practice, there can be improvement from using '...
2 votes

Benchmark setup for incompressible Rayleigh-Taylor flow

It's not quite the problem for which you're looking for solutions, but if you're willing to consider something slightly out of the box, there are numerous benchmarks for the R-T instability in the ...
2 votes

Benchmark setup for incompressible Rayleigh-Taylor flow

EDIT I had forgotten about this, but a while ago a friend of mine did his whole thesis work on the Rayleigh-Taylor instability in the context of statistical analysis of turbulence. You can find it ...
  • 1,137
2 votes

Should benchmarkings be done at all? What is the point?

All benchmarks are valid in some context, the problem is that authors of benchmarks frequently do not provide the context in which to meaningfully interpret the output of their benchmarks. The ...
2 votes

How to measure efficiency of the differential equations solver

Well the two main measures you should compare obviously is the computational time and the accuracy - do not overthink. You can compare also the convergency/accuracy as a function of the time step. ...
1 vote

Open-Source Benchmarks that Measure Compression Speed

Google's brotli links to several benchmarks which look to have speed in addition to ratio: Squash benchmark Squash benchmark unstable Large text compression benchmark Lzturbo benchmark Though you ...
  • 66
1 vote

How to properly calculate CPU and GPU FLOPS performance?

The FLOP measure for GPU's is supposed to represent the peak theoretical 32b float processing speed by any means necessary. In every modern instance, that means every single shading unit doing as many ...
  • 111
1 vote

Flow past square cylinder benchmark in 2D. Famous papers to compare

I believe this paper by Breuer et al. which uses both the lattice Boltzmann and the finite volume method could be of interest for you. There is tremendous information therein and I have used it before ...
  • 1,137
1 vote

Computational Science Hardware Benchmark Database

There's two recent papers you should check: GPU Performance Modeling and Optimization: https://pure.tue.nl/ws/files/39759895/20161018_Li.pdf Accelerating BLAS on Custom Architecture thru Algo/Arch ...
1 vote

Computational Science Hardware Benchmark Database

I don't know if there is one source. Mostly just blogs and manufacturers show this kind of thing. You may want to start a blog on this! The Puget Systems HPC Blog is probably the most complete source, ...
1 vote

Lid-driven Cavity benchmark in 3D. Classical paper to compare

On a side note perhaps, I think it's funny how the Ghia paper is still used as the benchmark 35 years later on. It had indeed produced great results for its time, but this being a computational ...
  • 111
1 vote
Accepted

Lid-driven Cavity benchmark in 3D. Classical paper to compare

I consider this to be the "classic" 3D-Lid-Driven Cavity (LDC) incompressible flow benchmark paper: Guj, G. & Stella, F. A vorticity-velocity method for the numerical of 3D incompressible flows. ...
  • 609

Only top scored, non community-wiki answers of a minimum length are eligible