Learning minimum-time navigation policies in two-dimensional flows with a genetic algorithm

Abstract

We study minimum-time navigation between two points in a known two-dimensional fluid flow for a vessel with fixed-magnitude slip velocity and controllable direction. The navigation policy is parameterized by a neural network and optimized using a genetic algorithm that evolves an ensemble of candidate strategies through Darwinian selection and parameter mutation, without crossover. The method recovers analytical and numerical optimal-control solutions in several benchmark cases, including two-dimensional turbulence, and outperforms Q-learning and one-step actor-critic method. We further show that the learned navigation strategies are robust to variations in the starting position and to unresolved small-scale turbulent fluctuations, provided that the characteristic velocity of these fluctuations remains small compared to the vessel's slip velocity. The proposed approach provides a compact representation of the navigation policy, is readily parallelizable, and eliminates the need for reward shaping, offering an efficient alternative to existing analytical and numerical methods for computing minimum-time trajectories in complex flows.