The current enterprise server rack has, in most cases, more than 1 CPU socket per board and a bunch of graphics card together with a data processing unit on a single board in a node. Several such nodes in a rack are closely stitched together for data pathways and tightly integrated into the cluster for a tailored application as deemed fit by the system architect. My question is Are we still in the Von-Neumann architecture era? The reason I raise this question is 2 fold
- We no longer have a centralized processing unit, for processing a myriad of data, but rather separate discrete processing units other than CPU for handling specialized function including GPU, DPU and in some cases dedicated accelerators. Architecturally also, in some cases, GPU can have separate access to DRAM and SSD. So more than one processing unit (assuming entire socket as a processor which is not the case though). How come this classifies under Von-Neumann architecture?
- If the so called neuromorphic computing ever comes into dominance would the current heterogenous compute elements would still be there or We will be completely shifting towards the neural engine cores? In other words would we still be using the traditional multiply and accumulate based registers or we will start moving to the compute in memory thing?
Are we really facing a architectural change to incorporate NVME drives, most importantly intel pmem, into traditional architecture? Clearly pmem shows architectural choke points for utilizing its full potential