Goal-Oriented Ordered Autoencoding for Successive Refinement in Progressive Communication

Abstract

Goal-oriented communication often struggles to sustain downstream task performance under variable and unpredictable bandwidth. We address this problem by proposing GO-OAE (Goal-Oriented Ordered AutoEncoding), which learns a progressively refinable quantized latent sequence, optimized directly for task utility rather than source reconstruction. Each component of the sequence is represented for transmission by its code index, and the learned ordering enables inference from any received prefix of the index sequence, with performance improving as more indices arrive. We prove that optimizing the goal-oriented distortion objective is equivalent to solving a weighted conditional information bottleneck formulation, and introduce an unbiased multi-prefix importance sampling (MPIS) estimator, to reduce GO-OAE training computational cost from O(BK) to O(Bm) with m << K, and reduces the estimator variance by a factor of 1/m. Experiments show that, on MiniImageNet, GO-OAE achieves over 96% of the lossless upper-bound classification accuracy using 324 bits per image (683X compression vs. raw RGB), and already attains over 94% of the upper bound with only 70% of the transmitted indices. It consistently outperforms reconstruction-optimized codecs and ordered autoencoders trained with uniform prefix sampling across all transmission budgets, demonstrating effective communication at extreme compression rates.