Fine asymptotics for approximate simulation of symmetric channels
Valentinian Lungu, Aaron B. Wagner, Ioannis Kontoyiannis
Abstract
We study the approximate channel simulation problem in the normal approximation regime. Our starting point is the fact established by Cao et al.~Caochannelsimulation, that the minimal codebook size Mε*(W) for a fixed error tolerance ε>0 is closely related to the ε-smooth channel max-information, Iε(W). Using this, we refine earlier large-blocklength approximations to Mε*(W n) for discrete memoryless channels. Specifically, we provide tight third-order expansions for Gallager-symmetric channels and demonstrate that the third-order term is channel-dependent. As in corresponding channel coding expansions, we identify a substantial rate gap between singular and nonsingular channels. Notably, the direction of this gap is reversed relative to channel coding: The third-order term is -12 n for singular channels but O( n) for nonsingular channels.
Create a lesson
Related papers
Multiple-Function Approximated Coded Computing: Constructions and Error Bounds
Rimpi Borah, Wilton Kim, J. Harshan et al.
Log Density Spectrum Based Decoding of Polar Codes for Channels with Strong Phase Noise
Yinuo Mei, Daiming Qu
More Interactions Make Communications More Efficient: A Directed Information Bottleneck Approach to Task-Oriented Communication
Zhirun Zheng, Yiqin Deng, Phone Lin et al.
Generalized Hamming Weights and Subcode Support Weight Distributions of Twisted Reed-Solomon Codes
Chao Liu, Hao Chen, Dabin Zheng et al.
RPA Decoding with Few Subspace Projections for Correcting Structured Error Patterns in RM Codes
Shiv Pratap Singh Rathore, Navin Kashyap
Learning Rules, Memorizing Facts: An Information-Theoretic View of Hallucination
Gengze Xu, Anxin Guo, Yifei Hu et al.