The variance of relative surprisal as single-shot quantifier

The variance of (relative) surprisal, also known as varentropy, so far mostly plays a role in information theory as quantifying the leading order corrections to asymptotic i.i.d.~limits. Here, we comprehensively study the use of it to derive single-shot results in (quantum) information theory. We sh...

Full description

Saved in:
Bibliographic Details
Main Authors: Boes, Paul, Ng, Nelly Huei Ying, Wilming, Henrik
Other Authors: School of Physical and Mathematical Sciences
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/163972
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-163972
record_format dspace
spelling sg-ntu-dr.10356-1639722023-02-28T20:04:51Z The variance of relative surprisal as single-shot quantifier Boes, Paul Ng, Nelly Huei Ying Wilming, Henrik School of Physical and Mathematical Sciences Science::Physics Leading Orders Quantum Information Theory The variance of (relative) surprisal, also known as varentropy, so far mostly plays a role in information theory as quantifying the leading order corrections to asymptotic i.i.d.~limits. Here, we comprehensively study the use of it to derive single-shot results in (quantum) information theory. We show that it gives genuine sufficient and necessary conditions for approximate state-transitions between pairs of quantum states in the single-shot setting, without the need for further optimization. We also clarify its relation to smoothed min- and max-entropies, and construct a monotone for resource theories using only the standard (relative) entropy and variance of (relative) surprisal. This immediately gives rise to enhanced lower bounds for entropy production in random processes. We establish certain properties of the variance of relative surprisal which will be useful for further investigations, such as uniform continuity and upper bounds on the violation of sub-additivity. Motivated by our results, we further derive a simple and physically appealing axiomatic single-shot characterization of (relative) entropy which we believe to be of independent interest. We illustrate our results with several applications, ranging from interconvertibility of ergodic states, over Landauer erasure to a bound on the necessary dimension of the catalyst for catalytic state transitions and Boltzmann's H-theorem. Nanyang Technological University Published version P.B. and N.N. acknowledge support by DFG Grant No. FOR 2724 and FQXi. P.B. further acknowledges funding from the Templeton Foundation. N.N. further acknowledges the Alexander von Humboldt foundation and the Nanyang Technological University, Singapore under its Nanyang Assistant Professorship Start Up Grant. H.W. acknowledges contributions from the Swiss National Science Foundation via the NCCR QSIT as well as Project No. 200020_165843. 2022-12-27T08:07:25Z 2022-12-27T08:07:25Z 2022 Journal Article Boes, P., Ng, N. H. Y. & Wilming, H. (2022). The variance of relative surprisal as single-shot quantifier. PRX Quantum, 3(1), 010325-1-010325-31. https://dx.doi.org/10.1103/PRXQuantum.3.010325 2691-3399 https://hdl.handle.net/10356/163972 10.1103/PRXQuantum.3.010325 2-s2.0-85126566779 1 3 010325-1 010325-31 en PRX Quantum © 2022 the Authors. Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Science::Physics
Leading Orders
Quantum Information Theory
spellingShingle Science::Physics
Leading Orders
Quantum Information Theory
Boes, Paul
Ng, Nelly Huei Ying
Wilming, Henrik
The variance of relative surprisal as single-shot quantifier
description The variance of (relative) surprisal, also known as varentropy, so far mostly plays a role in information theory as quantifying the leading order corrections to asymptotic i.i.d.~limits. Here, we comprehensively study the use of it to derive single-shot results in (quantum) information theory. We show that it gives genuine sufficient and necessary conditions for approximate state-transitions between pairs of quantum states in the single-shot setting, without the need for further optimization. We also clarify its relation to smoothed min- and max-entropies, and construct a monotone for resource theories using only the standard (relative) entropy and variance of (relative) surprisal. This immediately gives rise to enhanced lower bounds for entropy production in random processes. We establish certain properties of the variance of relative surprisal which will be useful for further investigations, such as uniform continuity and upper bounds on the violation of sub-additivity. Motivated by our results, we further derive a simple and physically appealing axiomatic single-shot characterization of (relative) entropy which we believe to be of independent interest. We illustrate our results with several applications, ranging from interconvertibility of ergodic states, over Landauer erasure to a bound on the necessary dimension of the catalyst for catalytic state transitions and Boltzmann's H-theorem.
author2 School of Physical and Mathematical Sciences
author_facet School of Physical and Mathematical Sciences
Boes, Paul
Ng, Nelly Huei Ying
Wilming, Henrik
format Article
author Boes, Paul
Ng, Nelly Huei Ying
Wilming, Henrik
author_sort Boes, Paul
title The variance of relative surprisal as single-shot quantifier
title_short The variance of relative surprisal as single-shot quantifier
title_full The variance of relative surprisal as single-shot quantifier
title_fullStr The variance of relative surprisal as single-shot quantifier
title_full_unstemmed The variance of relative surprisal as single-shot quantifier
title_sort variance of relative surprisal as single-shot quantifier
publishDate 2022
url https://hdl.handle.net/10356/163972
_version_ 1759853174327345152