What efforts have been made to quantify the costs of the common numeric workhorse operations such as those found in LAPACK, BLAS, sparse matrix operations, etc....
We have several libraries which implement identical interfaces found in BLAS and LAPACK. I suspect these all have different strengths and weaknesses on various architectures.
Has there been any effort to compare them as a group for a particular sequential architecture?
Has there been any effort to do this on more complex architectures, i.e. has anyone compared the various GPU or multi-core library implementations?
In general each library has it's own set of papers comparing a few operations with another (often less sophisticated) library. I'm looking for work which does a more substantial and broad review.
In a perfect world we would like to be able to as questions like "for an i7 chip with 4GB memory and roughly this memory hierarchy the LU decomposition is 20% faster using library X over library Y". Profiling every algorithm on every architecture is obviously infeasible. What work is feasible? Do we know generally when library X is preferable to library Y without understanding each library in depth?