Tandem Queues with Hybrid Abandonment in Heavy Traffic
Cameron Curtis, Izzy Grosof, Seyed Iravani
Abstract
Hybrid-abandonment systems, where jobs abandon from certain stages of service but not others, occur frequently in medical, service, and computing systems. Abandonment affects the heavy-traffic behavior of both the stages with and without abandonment. In contrast to existing heavy-traffic works that focus on cases where there is abandonment at either all stages or no stages, we focus on the heavy-traffic behavior for these hybrid-abandonment systems. We provide the first heavy-traffic characterization of the second queue length in a two-stage tandem queue with abandonment only in the first stage. We characterize the scaled mean of the second stage queue length and prove that the scaled second queue length is asymptotically exponentially distributed and asymptotically independent of the first stage queue length. We derive our results by analyzing Markovian arrival process queues with countably infinite phases. We do this by extending techniques used to analyze queues with Markov-modulated arrivals to the broader class of infinite Markovian arrival process queues. We prove asymptotic results for a more general infinite phase process condition, an infinite birth-death phase process, and the hybrid-abandonment tandem case. We also empirically demonstrate that our heavy-traffic approximations are good approximations across various system settings.
Create a lesson
Related papers
Reproducible LLM Inference Benchmarking: A Sequential Isolation Protocol for Regression Testing
Arnold Olympio, Juan Manuel Servera Bondroit, Wael Abdelmalek et al.
CXDVirt: Low Latency Kernel Module Based CXL-SSD Emulation
Hyunsun Chung, Seongho Bong, Hong-Yeon Kim et al.
LLBPE: Linked-List Based GPU-Parallel BPE Tokenizer
Aditya Kovilur, Varun Chandra Shekar, Ariful Azad
Energy-performance tradeoffs in server farms with batch services and setup times
Thu Le-Anh, Tuan Phung-Duc
PonyTail: Profiling and Improving Service Tail Latency
Roee Wodislawski, Adam Morrison
Execution-Path Qualification and Realized Costs in Speculative Decoding on Consumer Systems
Chengzhan Li