privora-graph

ADR 0001: Exact Binomial Rényi Differential Privacy (RDP) Accountant + Compact DP-SGD

Context

Asymptotic Gaussian moments approximations underestimate privacy spend at moderate $\sigma$ or small subsampling rates, while applying isotropic DP noise to overparameterized dense layers degrades utility at $O(\sqrt{p}/(\varepsilon n))$.

Decision

We implement exact log-space binomial evaluation of Mironov-Talwar-Zhang (2019) integer-order Subsampled Gaussian RDP across $\alpha \in {2, \dots, 64}$ with Balle et al. (2020) $(\varepsilon, \delta)$ conversion, paired with per-sample $L_2$-clipped compact representations.

Consequences