Approaching Optimal Scaling of Queue Size for an Input-Queued Switch
Taha Ameen, Weina Wang
Abstract
We study the scaling of the expected total queue length in an n× n input-queued switch. It has been conjectured that the optimal scaling is O(n/(1-ρ)), up to logarithmic factors, where ρ is the system load. This conjecture has been established in the traditional heavy-traffic regime and in certain sub-regimes of the large-system regime. But it remains unresolved over a wide range of load scalings in the large-system regime. In this paper, we develop a family of scheduling policies parameterized by a positive integer k 2. We show that under uniform traffic, our policy achieves an expected total queue length of O(n\n,1/(1-ρ)\/(1-ρ)2k/(2k-1)), as long as ρ 1 in the large-system regime. As k increases, the exponent 2k/(2k-1) approaches 1, bringing our bound arbitrarily close to the conjectured scaling. The expected amortized scheduling cost of the policy is O(n3 k) per time slot. Our policy is of a batching type, with a novel recursive design that allows an arbitrary number of batching levels. This design principle may also be useful for other scheduling problems in which combinatorial constraints restrict which jobs can be served simultaneously.
Create a lesson
Related papers
The Unreported Variable:Collector Selectivity in Data Placement Evaluation
Nannan Zhao, Jiameng Zhang, Taoyu Zhong et al.
HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes
Bowen Cui, Junyu Yin, Tejas Ramesh et al.
DIMWIT: Directly Invoking Models Without Intensive Tuning
Saarth Deshpande, Neeraja J. Yadwadkar, Venkat Arun
Understanding the Energy Cost of Quantized Agents on Shared GPUs
Stephen Abkin, Alex Flesher, Aldric Yang et al.
How Far Are We From On-Device VLM Inference? A Measurement Study on Edge NPUs
Huan Yang, Shiqi Jiang, Yu Mao et al.
EdgePace: Deadline- and Freshness-Aware LLM Scheduling on Unified-Memory Platforms
Teng Mei, Chengxuan Pei, Weijun Wang et al.