19
votes
Accepted
What are the guidelines for conducting computational experiments?
A lot has been written about how to design, execute, and report the results of computational experiments. This has obvious connections with open source software and the broader "open science" ...
- 18k
10
votes
Should benchmarkings be done at all? What is the point?
Yes, benchmarking should be done. I make this claim as an Editor, Author, and Reviewer. Below, I represent these roles' stances slightly hyperbolically.
But let me strongman your argument first. In ...
- 3,566
8
votes
How to properly calculate CPU and GPU FLOPS performance?
You can calculate GFLOP rates this way, but the numbers are pretty meaningless on today's hardware:
Floating point operations require a variable number of clock cycles. An addition is generally ...
- 52.2k
7
votes
Accepted
How to measure efficiency of the differential equations solver
There are many different ways to do this. One of the standard is a work-precision plot where you plot the amount of time or function calls that it takes in order to achieve a certain level of accuracy....
- 12k
7
votes
Should benchmarkings be done at all? What is the point?
Benchmarks are useful, but no benchmark tells the whole story. There are many useful benchmarks. For example, the Julia microbenchmarks are an interesting case of an isolating benchmark: it tries to ...
- 12k
4
votes
Accepted
Why do people omit the lowest times when averaging timing results?
I don't know why Chris Rackaukas hid his answer because it's actually quite good. In the following, I'm going to assume that the program being tested is executing the same instructions every single ...
- 52.2k
4
votes
Integer vs float multiplication performance, modern CPUs
In general, the answers is no.
Modern CPU's excel at problems which have high arithmetic intensity and are implemented using floating point arithmetic.
A few figures will help explain the ...
- 1,361
3
votes
How much does choice of OS matter for performance of scientific computing code?
I remember reading two or three years ago statistics about OS distribution for the List of the 500 fastest computers world wide. Linux/unix based running computer number was 498, Windows based 2 and ...
- 289
2
votes
How much does choice of OS matter for performance of scientific computing code?
There should be little difference in principle as the underlying tool kits are usually similar if not the same: libraries, compilers (and hardware). In practice, there can be improvement from using '...
- 141
2
votes
Benchmark setup for incompressible Rayleigh-Taylor flow
It's not quite the problem for which you're looking for solutions, but if you're willing to consider something slightly out of the box, there are numerous benchmarks for the R-T instability in the ...
- 52.2k
2
votes
Benchmark setup for incompressible Rayleigh-Taylor flow
EDIT
I had forgotten about this, but a while ago a friend of mine did his whole thesis work on the Rayleigh-Taylor instability in the context of statistical analysis of turbulence. You can find it ...
- 1,137
2
votes
Should benchmarkings be done at all? What is the point?
All benchmarks are valid in some context, the problem is that authors of benchmarks frequently do not provide the context in which to meaningfully interpret the output of their benchmarks.
The ...
- 3,243
2
votes
How to measure efficiency of the differential equations solver
Well the two main measures you should compare obviously is the computational time and the accuracy - do not overthink.
You can compare also the convergency/accuracy as a function of the time step. ...
- 226
1
vote
Open-Source Benchmarks that Measure Compression Speed
Google's brotli links to several benchmarks which look to have speed in addition to ratio:
Squash benchmark
Squash benchmark unstable
Large text compression benchmark
Lzturbo benchmark
Though you ...
- 66
1
vote
How to properly calculate CPU and GPU FLOPS performance?
The FLOP measure for GPU's is supposed to represent the peak theoretical 32b float processing speed by any means necessary. In every modern instance, that means every single shading unit doing as many ...
- 111
1
vote
Flow past square cylinder benchmark in 2D. Famous papers to compare
I believe this paper by Breuer et al. which uses both the lattice Boltzmann and the finite volume method could be of interest for you. There is tremendous information therein and I have used it before ...
- 1,137
1
vote
Computational Science Hardware Benchmark Database
There's two recent papers you should check:
GPU Performance Modeling and Optimization:
https://pure.tue.nl/ws/files/39759895/20161018_Li.pdf
Accelerating BLAS on Custom Architecture thru Algo/Arch ...
- 11
1
vote
Computational Science Hardware Benchmark Database
I don't know if there is one source. Mostly just blogs and manufacturers show this kind of thing. You may want to start a blog on this! The Puget Systems HPC Blog is probably the most complete source, ...
- 12k
1
vote
Lid-driven Cavity benchmark in 3D. Classical paper to compare
On a side note perhaps, I think it's funny how the Ghia paper is still used as the benchmark 35 years later on. It had indeed produced great results for its time, but this being a computational ...
- 111
1
vote
Accepted
Lid-driven Cavity benchmark in 3D. Classical paper to compare
I consider this to be the "classic" 3D-Lid-Driven Cavity (LDC) incompressible flow benchmark paper:
Guj, G. & Stella, F. A vorticity-velocity method for the numerical of 3D incompressible flows. ...
- 609
Only top scored, non community-wiki answers of a minimum length are eligible