Understanding Federated Learning Through the Lens of Mechanism Design: The Role of Data Heterogeneity
Lina Alkarmi, Po-Yen Chen, Mingyan Liu
Abstract
Federated learning (FL) requires effective incentive mechanisms to motivate data sharing and prevent strategic free-riding. Recent FL mechanisms such as the Shapley value mechanism MShap guarantee reciprocal fairness for agents. However, a complete analysis of how such mechanisms impact social optimality and individual rationality under realistic, standalone outside options remains unknown. In this paper, we address this gap by adapting the classical Externality mechanism ME to the federated learning setting. We conduct a comparison of MShap and ME across three dimensions: social optimality, individual rationality, and fairness/reciprocity. First, we establish that MShap generally does not maximize social welfare because its marginal incentives drive agents to over-contribute resources, while ME maximizes social welfare by design. Second, we evaluate participation incentives through the individual rationality gap when considering agents' outside options as standalone training on their own data. We find that both mechanisms ensure individual rationality in homogeneous settings. We further show that under mild conditions, ME maintains this guarantee under agent heterogeneity, whereas MShap does not. Third, we demonstrate that while MShap maintains perfect reciprocity by design, ME generally does not, and only ensures that individual benefits match Shapley contributions at symmetric equilibria under homogeneity, as it sacrifices individual fairness to maximize collective welfare under heterogeneity. Empirical simulations validate our theoretical findings and illustrate a tradeoff between reciprocal fairness and social efficiency.
Create a lesson
Related papers
On the Role of Tie-Breaking Rules in the Convergence of Fictitious Play for Symmetric First-Price Auctions
Benjamin Heymann
Epsilon-Nash Equilibria in History-Dependent SA-MDPs
Brandon Gary Kaplowitz, Dominik Bohnet Zurcher, Akash Agrawal et al.
Core stability recognition for minimum-cost spanning tree games: Parameterized perspective
Michal Dvořák, Ioannis Kakatelis, Dušan Knop
Second-Best Gains from Trade in Matching Markets
Xiaohui Bei, Bo Li, Wenhao Wu et al.
Equilibria of Round-Robin: Computational Hardness and Fairness for Few Subadditive Agents
Paul W. Goldberg, Alexandros Hollender, Giannis Tyrovolas
Estimate then Predict: Convex Formulation for Travel Demand Forecasting
Youngseo Kim, Gioele Zardini, Samitha Samaranayake et al.