A Journey in Shared Memory Land
Ran Ginosar
Abstract
I have greatly enjoyed spending many years in studying parallel computing. My journey goes thorough MP-C, PLURAL, Async Plural, HAL, RC64 and more. As a PhD student at Princeton I studied a combination of shared memory and message passing, motivated by algorithms and the ease of programming. While at the Technion, a brilliant MSc student figured out a better way for shared memory machines that further simplified parallel programming. He later founded Plurality and we developed the HAL machine. At Ramon Chips we reinvented RC64 and managed to make programming much easier. Theoretical computing models, especially PRAM, have constituted the foundation for my work. Fortunately, I spent many years learning the theory and practice of asynchronous logic, and applied some of these concepts towards improving, namely simplifying, parallel machines. Over the years I became disillusioned of inventive hardware designers and their innovative machines. That perspective helped crystalize this process. Still, much more remains to be done.
Create a lesson
Related papers
Locus: A Framework for Exploring and Optimizing Point Addition Hardware for Zero-Knowledge Proofs
Gaurav Kuwar, Alhad Daftardar, Jianqiao Mo et al.
Quantifying the Effect of HCLs on a Fixed-Microarchitecture MXFP4 Accelerator
Daniele Passaretti, Sajjad Tamimi, Nicola Dall'Ora
HBFlex: A Flexible Memory System for Bridging Fine-Grained LLM States and Coarse-Grained HBF Parallel Execution
Shuzhang Zhong, Weikai Xu, Yifan Zhou et al.
Automated Instruction Encoding Synthesis for Modern GPU ISA Compression
Mingyuan Ma, Hu He
VeriBugBench: An Empirically Grounded Framework for Constructing Verilog RTL Debugging Benchmarks
Xiankai Meng, Kejian Feng, Xinlin Zhao et al.
Budgeted Express-Mesh: Traffic-Aware Link Placement and Deadlock-Free Adaptive Routing
Li Cao, Jingyuan Ma