CORTEXA
← Browse
arxivcs.ITmath.PRmath.STstat.ML2026-06-25

All you need is log

Akshay Balsubramani

Comparing two probability distributions is a basic building block of statistics and machine learning, and the right family is well understood: the Rényi divergences of order $α\in[0,\infty]$ are the unique family monotone under data processing and additive on independent products. Many problems instead compare more than two distributions at once -- multi-population fairness, multi-prior PAC-Bayes bounds, multi-hypothesis testing -- and the right multi-distribution generalization of the Rényi family has been an open question. We characterize it. Every functional of $W$-tuples of distributions that is monotone under data processing and additive on independent products is a positive integral of multi-way coincidence divergences $C_α(π_1,\dots,π_W) := -\log\int π_1^{α_1}\cdotsπ_W^{α_W}$ (with $\sum_k α_k = 1$) over a parameter space with four strata: the simplex interior; mixed-sign exponent cones (the analogue of Rényi orders $>1$); a tropical boundary at infinity carrying max-divergences; and pairwise Kullback-Leibler edges at the simplex vertices. Each stratum is necessary -- the destination of an explicit data-processing-monotone, product-additive divergence the others cannot reproduce -- and each is a clean limit of simplex-interior atoms. The same family arises from several independent routes -- the structural axioms, Kolmogorov-Nagumo means with Rényi's entropy axiomatics, classical entropy characterizations, multi-hypothesis testing error exponents, and a multi-lottery betting interpretation -- structural evidence that this is the canonical multi-distribution Rényi calculus rather than an artefact of any one axiomatic input. The two-prior case recovers the standard Rényi result; a worked $W=3$ instance, numerical verification, and a conditional extension round out the treatment.

View free PDFSource page

Related papers

arxivmath.STmath.PRstat.ML2026-07-17

Dimension-invariant uniform consistency of the empirical spatial distribution function and its associated spatial depth estimator

Felix Gnettner, Hyemin Yeon, Piotr Kokoszka

We provide a proof that the empirical spatial distribution estimator in $\mathbb R^d$ as well as the corresponding plug-in estimator of the spatial depth are uniformly $L^1$-consistent. The consistency rate only depends on the sample size $n$, not on the dimension $d$ or any tuni…

View free PDFSource page
arxivcs.ITcs.DSmath.STstat.ML2026-07-17

On the Role of Normalization in Binary Iterative Hard Thresholding for 1-bit Compressed Sensing

Arya Mazumdar, Prateeti Mukherjee

Binary Iterative Hard Thresholding (BIHT) is a simple, yet effective, greedy method for recovering a sparse vector from one-bit sign measurements. In its original form, BIHT performs a ``gradient-descent'' step, followed by hard thresholding. A convergence analysis of this algori…

View free PDFSource page
arxivmath.STcs.ITeess.SPmath.PRstat.ME2026-07-21

Gaffke's confidence interval for the mean of bounded data is inadmissible but asymptotically efficient

Jiahao Ming, Aaditya Ramdas, Yi Shen, Ruodu Wang, Ian Waudby-Smith

Given observations $\mathbf x=(x_1,\dots,x_n)$, Gaffke (2005) defined \[ K_n(\mathbf x)=\mathbb{P}_{\mathbf D}\!\left\{\sum_{i=1}^n x_iD_i\le 1\right\}, \qquad (D_0,D_1,\ldots,D_n)\sim\mathrm{Dirichlet}(1,\ldots,1), \] and conjectured that it is a $p$-value whenever the inputs ar…

View free PDFSource page
arxivstat.MLcs.LGmath.PRmath.ST2026-07-15

Spectral Concentration and Recovery in Sparse High-Dimensional Random Geometric Graphs

Manuel Fernandez, Yizhe Zhu

We study sparse threshold random geometric graphs generated by high-dimensional spherical or Gaussian latent vectors. Although each edge has marginal probability $p$, shared latent variables make the adjacency entries dependent. At the connectivity scale $np=Ω(\log n)$, the spher…

View free PDFSource page