The variance of relative surprisal as single-shot quantifier
The variance of (relative) surprisal, also known as varentropy, so far mostly plays a role in information theory as quantifying the leading order corrections to asymptotic i.i.d.~limits. Here, we comprehensively study the use of it to derive single-shot results in (quantum) information theory. We sh...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/163972 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-163972 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1639722023-02-28T20:04:51Z The variance of relative surprisal as single-shot quantifier Boes, Paul Ng, Nelly Huei Ying Wilming, Henrik School of Physical and Mathematical Sciences Science::Physics Leading Orders Quantum Information Theory The variance of (relative) surprisal, also known as varentropy, so far mostly plays a role in information theory as quantifying the leading order corrections to asymptotic i.i.d.~limits. Here, we comprehensively study the use of it to derive single-shot results in (quantum) information theory. We show that it gives genuine sufficient and necessary conditions for approximate state-transitions between pairs of quantum states in the single-shot setting, without the need for further optimization. We also clarify its relation to smoothed min- and max-entropies, and construct a monotone for resource theories using only the standard (relative) entropy and variance of (relative) surprisal. This immediately gives rise to enhanced lower bounds for entropy production in random processes. We establish certain properties of the variance of relative surprisal which will be useful for further investigations, such as uniform continuity and upper bounds on the violation of sub-additivity. Motivated by our results, we further derive a simple and physically appealing axiomatic single-shot characterization of (relative) entropy which we believe to be of independent interest. We illustrate our results with several applications, ranging from interconvertibility of ergodic states, over Landauer erasure to a bound on the necessary dimension of the catalyst for catalytic state transitions and Boltzmann's H-theorem. Nanyang Technological University Published version P.B. and N.N. acknowledge support by DFG Grant No. FOR 2724 and FQXi. P.B. further acknowledges funding from the Templeton Foundation. N.N. further acknowledges the Alexander von Humboldt foundation and the Nanyang Technological University, Singapore under its Nanyang Assistant Professorship Start Up Grant. H.W. acknowledges contributions from the Swiss National Science Foundation via the NCCR QSIT as well as Project No. 200020_165843. 2022-12-27T08:07:25Z 2022-12-27T08:07:25Z 2022 Journal Article Boes, P., Ng, N. H. Y. & Wilming, H. (2022). The variance of relative surprisal as single-shot quantifier. PRX Quantum, 3(1), 010325-1-010325-31. https://dx.doi.org/10.1103/PRXQuantum.3.010325 2691-3399 https://hdl.handle.net/10356/163972 10.1103/PRXQuantum.3.010325 2-s2.0-85126566779 1 3 010325-1 010325-31 en PRX Quantum © 2022 the Authors. Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Science::Physics Leading Orders Quantum Information Theory |
spellingShingle |
Science::Physics Leading Orders Quantum Information Theory Boes, Paul Ng, Nelly Huei Ying Wilming, Henrik The variance of relative surprisal as single-shot quantifier |
description |
The variance of (relative) surprisal, also known as varentropy, so far mostly plays a role in information theory as quantifying the leading order corrections to asymptotic i.i.d.~limits. Here, we comprehensively study the use of it to derive single-shot results in (quantum) information theory. We show that it gives genuine sufficient and necessary conditions for approximate
state-transitions between pairs of quantum states in the single-shot setting,
without the need for further optimization. We also clarify its relation to smoothed min- and max-entropies, and construct a monotone for resource theories using only the standard (relative) entropy and variance of (relative) surprisal. This immediately gives rise to enhanced lower bounds for entropy production in random processes. We establish certain properties of the variance of relative surprisal which will be useful for further investigations, such as
uniform continuity and upper bounds on the violation of sub-additivity. Motivated by our results, we further derive a simple and physically appealing axiomatic single-shot characterization of (relative) entropy which we believe to be of independent interest. We illustrate our results with several applications, ranging from interconvertibility of ergodic states, over Landauer
erasure to a bound on the necessary dimension of the catalyst for catalytic state transitions and Boltzmann's H-theorem. |
author2 |
School of Physical and Mathematical Sciences |
author_facet |
School of Physical and Mathematical Sciences Boes, Paul Ng, Nelly Huei Ying Wilming, Henrik |
format |
Article |
author |
Boes, Paul Ng, Nelly Huei Ying Wilming, Henrik |
author_sort |
Boes, Paul |
title |
The variance of relative surprisal as single-shot quantifier |
title_short |
The variance of relative surprisal as single-shot quantifier |
title_full |
The variance of relative surprisal as single-shot quantifier |
title_fullStr |
The variance of relative surprisal as single-shot quantifier |
title_full_unstemmed |
The variance of relative surprisal as single-shot quantifier |
title_sort |
variance of relative surprisal as single-shot quantifier |
publishDate |
2022 |
url |
https://hdl.handle.net/10356/163972 |
_version_ |
1759853174327345152 |