The cluster I work on has a filesystem labelled as "fast" with no further explanation. But the filesystem type is "lustre", which strongly hints at a Lustre filesystem. While general information about this file system type is easy to find, I have not been able to find any information about how to get the most performance from it, playing with the parameters that a programmer can work on: file layout and access patterns. Does anyone have experience with this?
Since I expect replies of the kind "just run benchmarks", that's of course what I did. I find that read access is sometimes dramatically faster then the NFS filesystem on the same machine, but sometimes clearly slower, although I don't see any significant difference between the two applications that gave these extreme results. That's why I'd like to understand the performance issues rather than just have numbers.