Analog Implementation of the Softmax Function

Abstract

An analog implementation of the Softmax activation function is presented. A modular design is proposed, scaling linearly with the number of inputs and outputs. The circuit behaves similarly using both a BJT and NMOS design scheme. Experimental results extracted from a BJT breadboard prototype presents computational accuracy within 4.2% margin of error. Simulation data presents accuracy within 1.3% margin of error for BJT and 0.9% margin of error for NMOS design schemes.