Questions tagged [gpu]

Graphical Processing Unit - a specialized, relatively inexpensive hardware unit built for fast graphical computations and highly data-parallel scientific computations.

Filter by
Sorted by
Tagged with
0
votes
0answers
19 views

Temporal/spectral conversion for large fields - best approach?

I am currently working on a more efficient implementation of a pulse propagation algorithm. The propagation is done in the spectral domain, but several evaluations (such as energy calculations) are ...
5
votes
1answer
380 views

How to properly calculate CPU and GPU FLOPS performance?

Problem I'm trying to calculate CPU / GPU FLOPS performance but I'm not sure if I'm doing it correctly. Let's say we have: A Kaby Lake CPU (clock: 2.8 GHz, cores: 4, threads: 8) A Pascal GPU (clock: ...
1
vote
0answers
51 views

Hardware supporting floats with fraction beyond 64 bit

Is there any computation accelerator (like a GPGPU) available, that natively (this means in hardware, not emulated by a library) supports arithmetics using floating point numbers with a fractional ...
2
votes
1answer
55 views

Understading memory sharing in a GPGPU using a lattice example

I am new in the GPUs world, I used them in Matlab ambient so I didn't need to appreciate the subtleties of these devices. I know that a GPU can be divided into multiprocessors (also called Streaming ...
1
vote
1answer
63 views

Implementation of sparse matrix SVD for GPU

I have a sparse matrix $W$ which is almost-squared ($N+1 \times N$) and I would like to know the eigenvalues of $A = W^T W$. $A$ is Hermitian so the eigenvalues are real-positive valued. The usual ...
1
vote
2answers
90 views

Writing code on the CPU while developing, running it on the GPU when live - which approach?

In my simulations I am using dense matrix-vector multiplications and 2D-fft transformations quite often, for matrix sizes of 8kx8k and up. Hence, I assume that using a GPU is beneficial for speeding ...
17
votes
2answers
4k views

Options for solving ODE systems on GPUs?

I would like to farm out solving systems of ODEs onto GPUs, in a 'trivially parallelisable' setting. For example, doing a sensitivity analysis with 512 different parameter sets. Ideally I want to do ...
23
votes
9answers
9k views

Are there any embarrassingly parallel tasks that require a CPU rather than GPU?

I am looking for tasks that are unsuitable for GPUs gain significant speedup as more CPU nodes are added don't require large data transfer or inter-thread communication between nodes. Do any ...
2
votes
0answers
43 views

Solving a complex ODE with large number of variables (>1e6 variables) - best practise?

I have to solve a non-linear ODE of the shape $$\partial_zA=f(A)$$ with $f$ a non-linear function and $A$ a matrix/vector with >1e6 variables (i.e. $A$ is a matrix with >1000x1000 entries). For each ...
0
votes
1answer
5k views

Is it possible to access a GPU remotely (i.e., from another machine)? [closed]

I want to access a GPU on a computer remotely, and share this GPU with different desktops. I envision this sort of access as being similar to using a VNC. Is it possible to do something like what I've ...
1
vote
2answers
53 views

Augmented Dickey Fuller (ADF) test statistics GPU formulation

I have followed different sources of information and achieved the following formulation for the ADF $t$ test statistics. I implemented it to run several hundred thousands of ...
5
votes
3answers
5k views

Performance of kd-tree vs brute-force nearest neighbor search on GPU?

I wonder if there is any study that compares the performance of kd-tree vs brute-force nearest neighbor search on GPU. Post #4 on this page suggests that kd-tree may not be the optimal algorithm for ...
5
votes
1answer
243 views

Consumer hardware for scientific computing?

I'm interested in problems around probability, statistics, and statistical mechanics, and often I find it useful to perform simulations to get some sense of the underlying phenomena. Example ...
3
votes
3answers
149 views

GPGPU computing, software selection

I am using an existing GCC C++ x86 Qt application that filters, displays and stores results computed by some C code. Since the computation by now got too complex for CPUs I intend to port the small C ...
1
vote
0answers
49 views

Fusing callbacks with FFTs: an open-source GPU FFT implementation?

I'm using cuFFT to do some 2D FFTs on matrices of size 2048x2048 or larger. The FFTs are preceded and followed by various scaling operations. These scaling operations are memory-bound, so they take ...
1
vote
0answers
195 views

OpenFOAM and CFDEM on GPU

I have a simulation project written for OpenFOAM and CFDEM and would like to find an alternative to run it on GPU since raising the number of cores already provided a promising speed up and ...
5
votes
2answers
106 views

GPGPU language for AMD?

Nvidia seems to be dominating the HPC / GPGPU computing landscape with CUDA. If I want to write a scientific application using and AMD GPU, what is the preferred language these days? I believe it used ...
2
votes
0answers
535 views

Scalability of Julia language [closed]

The Julia language has caught my attention as I am a heavy MATLAB user, but would like more performance. Julia looks attractive as skipping the whole 'prototype in MATLAB then rewrite code in FORTRAN/...
3
votes
2answers
200 views

HPC reading material

I am an undergraduate, and enthusiastic about HPC. I am currently familiar with the tools OpenMP, MPI, CUDA, OpenCL, thrust libraries etc. But I want to know the core functioning of these tools, I ...
1
vote
2answers
1k views

New to CFD, Lattice Boltzmann or Navier-Stokes?

I apologize if some of my questions are naive; I am very new to computer simulations and fluid-dynamics. I am going to start a PhD in early 2017, and I would like to bone-up on some Computational ...
1
vote
1answer
167 views

Why is FLOP(Floating Point Operations Per Second) mentioned as a specification on every GPU?

Counting FLOP may not be representative of the actual algorithm real world performance but still all the GPU manufacturers mention FLOPS as a metric of Performance on GPU. Is there any way that this ...
2
votes
2answers
511 views

Lost on Matrix Inversion

I try to implement some big matrix inversion. My system configuration is Hardware:- Memory: 62.8GiB, Processor: Intel Xeon(R)CPU E5-2670 v3 @2.30GHZ*48 To implement matrix inversion I am using ...
0
votes
1answer
99 views

Use of GPU with respect to CPU

I have research work where I need to compute a matrix inversion. The matrix has a size $31300\times31300$. I am using a universal java matrix package to invert this matrix. But as the dimension of the ...
1
vote
2answers
1k views

Demo example for OpenFOAM with CUDA

I am looking for a simple usage example/demo of OpenFOAM + CUDA and would like to understand how exactly OpenFOAM benefits from CUDA. The thing is I do not have any background in fluid dynamics and so ...
2
votes
0answers
108 views

Accelerate computation speed by using a different syntax [closed]

I was reading a book about Matlab ("Accelerating Matlab with GPU computing - A Primer with Examples" by Jung Suh and Youngming Kim, 2013. Chapter 1.7 Examples). I read an example where it said that: ...
0
votes
1answer
94 views

Compare 64gb dd3 ram with 2gb Quadro M1000M gpu on Lenovo P50

I frequently work with Keras and tensorflow-gpu on my Lenovo P50 workstation which has 64GB ram and a 2GB Nvidia QUadro M1000M GPU. Today while training my model on GPU, it ran into memory error and ...
0
votes
1answer
198 views

Can I convert CUDA core to CPU core and use it as cpu core while running any program?

I was using Metatrader5 and have designed a strategy for trading using MQL5 programming language. While I was running a Strategy Optimization process, I saw the it will need 10,00= iterations or ...
86
votes
10answers
22k views

What kinds of problems lend themselves well to GPU computing?

So I've got a decent head for what problems I work with are best one in serial, and which can be managed in parallel. But right now, I don't have much of an idea of what's best handled by CPU-based ...
1
vote
2answers
3k views

How to use the basic Sparse matrix operations (multiplication, .etc) in PyCUDA

I try to use sparse matrix operations in GPU in Python and now try to use PyCUDA with theano. But I can't find how to do sparse matrix and vector multiplication. I only got an example showing how to ...
7
votes
5answers
2k views

Good Finite Element Library for a small project

I'm currently working on this project and I have a basic structural analyzer that uses the finite element method. Essentially, I turn each block into a set of trusses, construct a stiffness matrix ...
0
votes
1answer
159 views

Matrix free finite elements method [duplicate]

I am Computer Scientist and now I am interested in matrix multiplication on GPUs. My research are focused on matrix free finite elements method where I multiply sparse matrix. Sparse matrix could ...
0
votes
1answer
1k views

Fastest way to diagonalize square matrices with c++

I am currently writing software in c++ which solves the eigenvalue problem of sparse hermitian matrices. The size of the matrix depends on the user input, but as an estimation it will roughly be ...
4
votes
1answer
4k views

GPU-accelerated libraries for solving sparse linear systems

There are several libraries to (iteratively) solve large sparse linear equation systems in parallel on a number of CPUs. Our parallel cluster also has attached powerful GPUs, but so far, I did not ...
10
votes
3answers
2k views

Thrust for GPU programming

I'm very new to GPGPU programming so please forgive me if the question is not particularly appropriate. From what I understand GPU programming is a very intricate piece of engineering work when ...
0
votes
1answer
1k views

How to decide how to parallelize nested loops on GPU

Suppose I have an algorithms which I want to implement ona GPU. The algorithm consists of a main loop, and all iterations of the loop can be run in parallel. Also, each iteration of the loop has an ...
4
votes
2answers
700 views

Maxwell vs Kepler for GPU computation

I am looking at the Nvidia GT-860M which comes in both the old Kepler and new Maxwell architecture. The old one (1152) seems to have almost twice the cores as the new one (640). The new one has a ...
1
vote
1answer
95 views

Time loop for multiple GPU's

I have a loop that has a similar structure as give below: ...
1
vote
2answers
258 views

Computational Science Hardware Benchmark Database

I am looking for a website/database of computer hardware (CPUs/GPUs) benchmarked with common scientific tools, e.g. *GEMM (see comment below for more info on this tool). Currently, I am quite ...
1
vote
0answers
119 views

Porting from MPI to GPU

Assuming that the underlying algorithm can be ported to multi GPU, what aspects should one consider while porting from MPI (on multiple nodes) to multi GPU (again on multiple nodes)? Making use of ...
0
votes
4answers
1k views

Easiest Way to Begin GPU Computing

What is the the simplest way to get started using GPU computing? My interests are primarily in neural networks and I would love to start using GPUs, but my time for learning GPU computing is very ...
3
votes
1answer
1k views

Why am I not seeing faster neural network training after upgrading to a vastly better GPU?

I was previously running my neural networks using the Lasagne library to build and train neural networks in Theano on an NVIDIA GTX 750 Ti. I'm using a genetic algorithm to tune the hyperparameters of ...
2
votes
2answers
374 views

Algorithm for Eigenvalue Problem of a Real Symmetric nxn Matrix

I have a nxn covariance matrix (so, real, symmetric, dense, nxn... I mean positive semi-definite). 'n' may be very very very big! I'd like to solve partial (3 largest) eigenvalue (+eigenvectors) ...
0
votes
1answer
171 views

Hyperscale Vs Strong-scale HPC

NVIDIA's Tesla GPUs for Servers includes market segments called "Hyperscale HPC" and "Strong-Scale HPC". How different is ...
9
votes
3answers
3k views

Is there a constrained nonlinear optimization library like IPOPT that runs on GPUs?

Somebody on my team wants to paralelize IPOPT. (at least some of functions of it). I have not been able to find a GPU implementation of it or a similar package. Nor I've found anything on their docs. ...
3
votes
2answers
2k views

GPU-enabled Lattice Boltzmann solvers?

Is anybody aware of any GPU-enabled Lattice Boltzmann solvers (preferably on C++/OpenCL and open-source) that would be recommended? I have found Advanced Simulation Library, but it seems to be very ...
2
votes
2answers
2k views

GPU vs CPU calculation

I've been working on calculating large factorials ($N>10^9$) and I was wondering if it wasn't faster to use the GPU to run the calculations on something like openCL. What I realized however was ...
9
votes
2answers
3k views

Parallel computation of big covariance matrices

We need to compute covariance matrices with sizes ranging from $10000\times10000$ to $100000\times100000$. We have access to GPUs and clusters, we wonder what is the best parallel approach for ...
1
vote
2answers
616 views

Intel's OpenCL SDK for image processing

I'm working on an image processing project and have written some of my algorithms in OpenCL. At the moment I'm using Cloo. I'm at the stage now where I want to optimise my program, as it currently ...
5
votes
0answers
112 views

Computing entries of a matrix in parallel using GPU

I am trying to solve $Ax=b$ a system of linear equation. The matrix $A=(a_{ij})$ is constructed as $$a_{ij}=\int_0^1\int_0^1 K(x,y)h_i(x)h_j(y) dxdy.$$ The evaluation of integral takes a lot of time, ...
19
votes
4answers
3k views

For which statistical methods are GPUs faster than CPUs?

I have just installed a Nvidia GT660 graphic card on my desktop and, after some struggle, I manage to interface it with R. I have been playing with several R packages that use GPUs, especially ...