A Hardware-Partitioned micro-ROS Mini-Vehicle for Operator-Supervised Neural Driving

Abstract

We present a low-cost miniature Ackermann vehicle for embedded neural-driving research, organized as a hardware-partitioned perceive-decide-act agent: an ESP32 camera node streams frames over Wi-Fi to a host computer, where neural inference and state estimation run, while an ESP32-S3 chassis controller executes safety-critical actuation in a 100 Hz per-wheel proportional-integral-derivative (PID) loop beneath a micro-ROS client. The partition isolates real-time control and safety on the vehicle while learning-based components run off-board, supervised by an operator from a gamepad. We characterize the complete pipeline during real closed-loop neural driving. Wireless sensing, rather than neural inference, dominates latency, with a 59.5 ms median capture-to-actuation delay; the platform absorbed wireless variability by holding the last safe command under a firmware watchdog, operating across twelve autonomous sessions with zero collisions or manual interventions; and encoder-inertial-measurement-unit (IMU) fusion cut odometry loop-closure error by 22%. These results indicate that carefully partitioned microcontroller-class vehicles support reproducible experiments in embedded AI, wireless control, and operator-supervised autonomous driving. The platform software is open source.