High Performance Computing generally uses large arrays of computers connected in clusters or grids.

learn more… | top users | synonyms

5
votes
1answer
27 views

Is there a way to ensure that PBS array jobs will be run in order?

I run many PBS scripts that take advantage of the job array structure for similar jobs (e.g. 12345[0] through 12345[9]). With the way that the code is written, job [0] needs to run first, and then any ...
1
vote
2answers
67 views

Using computational libraries on a machine without root access

If you want to use a computational library on a high-performance computing center where you have no root access to install new software you can use header-only template libraries such as MTL4, Eigen3, ...
2
votes
1answer
36 views

Performance based on the Roofline model

To somewhat follow up on the question asked here, I have been told that the Roofline model is one way of assessing the performance of any scientific code. Basically I compute the Arithmetic Intensity ...
2
votes
2answers
111 views

Direct Numerical Simulation of reacting flows

I need to write a DNS code for simulating reacting flows in turbulent conditions. The code has to be highly scalable, because the computational cost of simulations is expected very large. My idea is ...
0
votes
2answers
107 views

Planning to build a HPC [closed]

I start a study the best way to mount a HPC. On my datacenter i have to initial tests 3 servers whit this settings. DELL PowerEdge R720 2 x Intel Xeon E5-2680v2 2.8GHz 10 x 16GB RDIMM XenServer 6.5 ...
1
vote
1answer
64 views

Shared memory parallel computing solutions compared

As of 2015, what shared memory parallel computing solutions are available? What are the advantages and disadvantages of each for various use cases arising in high performance scientific computing? I ...
5
votes
1answer
84 views

Additional cost associated with quad (or higher) precision

In going from double precision to quad (or higher) precision, roughly how much of a performance hit is taken on various architectures and frameworks. Do floating point operations take twice as much ...
2
votes
1answer
101 views

CUDA Fortran: Multi GPU Programming and memory allocation

I am writing a program that is supposed to use multiple GPUs on a single node using CUDA Fortran. Although I've looked through the Portland Group CUDA Fortran Reference, I am still unclear about how ...
1
vote
1answer
129 views

Fast way to compute all eigenvalues of a dense Hermitian matrix

I am finding the eigenvalues of dense NxN Hermitian matrix which is calculated from a density operator in quantum physics. All the eigenvalues are needed as I need to calculate the sum of the absolute ...
1
vote
1answer
39 views

eigenvalue of small symmetric matrices

If I am to solve a symmetric eigenvalue system $A=QDQ^T$, where $A\in\mathcal{R}^{n\times n}$ and $n$ is small (in the range 4 - 64); I want all the eigenvectors and eigenvalues; There are two major ...
4
votes
2answers
284 views

Many processors reading a single HDF5 file

I'm working on a code that we eventually plan to scale up to 10's or 100's of thousands of processors (using MPI). I have a single HDF5 file (mesh nodes and connectivity, etc) that needs to be read ...
3
votes
2answers
81 views

Automated software optimization and tuning

I'm writing code that uses a lot of graph operations; many higher-level algorithms iterate over all the graph edges and do some processing on them. There's an iterator method that returns a batch of ...
4
votes
4answers
137 views

Removing non-determinism from molecular dynamics code

I've been looking through the other answers, and I haven't found a good answer yet. I'll describe the simulation I am running, and then the problems. The program simulates particles undergoing ...
3
votes
1answer
147 views

Increasing thread number degrades performance

I have a problem with parallelization and the brownian dynamics (molecular dynamics) code that I am using. We have our own home-grown framework at the university, and recently we've made the change ...
28
votes
1answer
12k views

CUDA vs OpenCL as of late 2013

How do CUDA and OpenCL compare to each other as of late 2013 from a programmer's perspective? My group is thinking about trying to make use of GPU computing. Would we be limiting ourself ...
1
vote
1answer
469 views

Masters in HPC (High Performance Computing)

Is there a master degree in HPC (High Performance Computing) in US? I am asking this question because in my early research I found no direct mentioning of HPC instead invidual courese in parallel ...
1
vote
2answers
654 views

HPC: Intel QPI versus AMD with HyperTransport

I am looking into upgrading to a High Performance Computing work-station to do mostly computational fluid dynamics computations and some fundamental numerics. The CFD software that is available does ...
3
votes
3answers
89 views

Can anyone recommend a pipeline dependency (“make”) tool for SGE jobs?

I am looking for a tool to specify pipelines of arbitrary multiple jobs with dependencies for the Sun Grid Engine. I can wire things together myself but I am hoping for something more declarative and ...
3
votes
5answers
567 views

Finding the correct Molecular Dynamics library

I just started working on some Biophysics research, and I was looking around for a good MD library to use. There is one right now at the university set up in C, with openMC parallelization, but the ...
4
votes
3answers
4k views

Difference between Nodes and CPUs when running software on a cluster?

I'm looking into moving some computations of mine to a data center to get more computation power. In the context of this process, I am getting confused by the differentiation of a computation node and ...
2
votes
1answer
59 views

Get job script directory with SGE

With the Sun Grid Engine, how can I get the directory where the job script is located, within the job script? I need this so I can start the script with ...
13
votes
4answers
5k views

Do currently available GPUs support double precision floating point arithmetic?

I have run the molecular dynamics (MD) code GROMACS on a Ubuntu Linux cluster consisting of nodes containing 24 Intel Xeon CPUs. My particular point of interest turns out to be somewhat sensitive to ...
11
votes
3answers
718 views

Log-log parallel scaling/efficiency plots

A lot of my own work revolves around making algorithms scale better, and one of the preferred ways of showing parallel scaling and/or parallel efficiency is to plot the performance of an ...
2
votes
1answer
323 views

Multi-node jobs with Sun Grid Engine without MPI

I am trying to figure out how to write a proper job file for the Sun Grid Engine so I can run a parallel computation using Mathematica on multiple nodes. Unfortunately almost all tutorials on the ...
10
votes
1answer
186 views

Statistical models for local memory/compute, network latency, and bandwidth jitter in HPC

Parallel computation is frequently modeled using a deterministic local rate of computation, latency overhead, and network bandwidth. In reality, these are spatially variable and non-deterministic. ...
4
votes
3answers
140 views

Offline (visualisation) rendering in scientific computing

I need to simulate the movement of a large number of agents. The processes that govern the agents' movement are complex and so the entire process requires parallelisation. The output from this ...
5
votes
4answers
1k views

Best hardware solution for microsecond Molecular Dynamics

We would like to reach Molecular Dynamics simulation of proteins with around 20000 atoms in explicit water with trajectories of around 1 microsecond each. We are looking at different options for ...
10
votes
2answers
313 views

Task-based shared-memory parallel libraries in Scientific Computing

In recent years, several libraries/software projects have appeared that offer some form or another of general-purpose data-driven shared-memory parallelism. The main idea is that instead of writing ...
16
votes
4answers
1k views

Is it a good idea to use vector<vector<double>> to form a matrix class for high performance scientific computing code?

Is it a good idea to use vector> to form a matrix class for high performance scientific computing code? If the answer is no. Why? Thanks
4
votes
3answers
199 views

How to efficiently structure simulation data in memory for cells with varying degrees of freedom?

For a discontinuous Galerkin-based simulation I need to store cell-based simulation data in memory. Since the order of the polynomial approximation $N_p$ may vary between cells, I wonder what the most ...
10
votes
2answers
755 views

Boost::mpi or C MPI for high performance scientific applications?

The thing I dislike most about MPI is dealing with datatypes (i.e. data maps/masks) because they don't fit that nicely with object oriented C++. boost::mpi only ...
14
votes
5answers
2k views

Parallel Scientific Computation Software Development Language?

I want to develop a parallel scientific computation software from scratch. I want some thoughts on which language to start. The program involves reading/writing data to txt files and doing heavy ...
7
votes
3answers
641 views

What is a robust, iterative solver for large 3-d linear-elastic problems?

I'm diving into the fascinating world of finite element analysis and would like to solve a large thermo-mechanical problem (only thermal $\rightarrow$ mechanical, no feedback). For the mechanical ...
8
votes
1answer
133 views

Anyone knows references summarizing the history of supercomputing?

Anyone knows references summarizing the history and ideas behind supercomputing including mentioning of developments in parallel programming languages, applications, startup companies (some was ...
7
votes
3answers
2k views

What is the best high performance computing platform for engineering simulations?

What is the best platform for high performance computing (HPC)? Windows is long gone, I think. So only Unix and Linux stand the chance. What platform will strongly back my interest on computational ...
20
votes
5answers
2k views

When is building a cluster in the cloud cheaper than building one in my lab for MD simulations?

An Amazon EC2 compute cluster costs about \$800-\$1000 (depending on duty cycle) per physical CPU core over the course of 3 years. In our last round of hardware acquisition, my lab picked up 48 cores ...
0
votes
1answer
144 views

Exit_status=15 , what does it mean? [closed]

I have a job which stops unexpectedly with Exit_status=15. What is the most probable error ?
2
votes
2answers
828 views

Contiguous prime numbers with MPI (Want more ideas for an efficient algorithm)

I am a programmer. I am working with Message Passing Interface (MPI) in C. I do a program that consist on finding the contiguous prime from 1 to 10,000,000. I already do it! but I do it with trial ...
7
votes
1answer
221 views

Online resources for reviewing graphics cards for GPGPU

Can anyone recommend a site that maintains up-to-date reviews of graphics cards for GPGPU use? Most benchmarks focus on gaming performance, whereas I am interested in the performance of scientific ...
3
votes
4answers
509 views

Parallel computing programming paradigms/models not based on a master/slave concept?

Do anyone know if there exist any widely used parallel computing programming paradigms/models not based on a master/slave concept?
10
votes
4answers
4k views

profiling CFD codes with callgrind

I'm using valgrind + callgrind to profile a solver I have written. As the valgrind user manual states, I've compiled my code with the debugging options for the compiler: "Without debugging info, the ...
4
votes
5answers
294 views

Will MPI continue to be a popular basis writing scalable massively parallel solvers on future many-core CPUs? [duplicate]

Possible Duplicate: What programming paradigms should I be investing in if I want my code to run on petascale machines in the future? Having entered the multi-core era (som already refers ...
7
votes
5answers
254 views

External hardware resources for running long and computationally intensive simulations

I've written code for an obstructed random walker simulation and I want to run long simulations (6 hours or more on my computer). I don't want to run this simulation on my computer because I will want ...
12
votes
5answers
456 views

How much should scientific software be optimized?

For applications requiring significant computational resources, high performance can be a critical factor when it comes to delivering scientific results or achieving "break-throughs" in reasonable ...
7
votes
1answer
204 views

Red(-Green)-Refinement vs. Newest-Vertex-Bisection

What are the "Pros and Cons" for these two methods of mesh-refinement? Both seem to be the prevalent methods. I can naturally imagine that global red refinement is comparatively easy to implement and ...
6
votes
2answers
673 views

Shape regularity in higher dimensions

In Finite Element theory, and other methods in scientific computing for PDEs, one uses meshes which fulfill several regularity criteria, many of them being equivalent. It is of interest to have ...
2
votes
1answer
82 views

Low performance on sge cluster

I'm having an issue with my project. When I run the code of Monte-Carlo simulation, on the local server (the machine in my office) it runs on a rate of roughly 100000 steps per 24 hours. When I run it ...
3
votes
3answers
382 views

What are the current obstacles to reaching exascale computing?

I have heard that one of the current goals in scientific computing is to surpass the exascale level by 2018 or so... After having passed the petascale a few years ago, one would think that the ...
13
votes
5answers
3k views

State of the Mac OS in Scientific Computing and HPC

Back towards the dawn of OS X, there seemed to be a great deal of hubbub, at least in the Mac world (I was nowhere near scientific computing at the time) about the Mac OS as a platform for scientific ...
5
votes
2answers
2k views

What does the priority of a PBS job really mean?

The qsub command which submits PBS jobs has a -p option that allows you to set the priority. From the man page: Defines the ...