Home | Biography | Research | Publication | Teaching
Research Interests
- Generally speaking, my current research interests are studying high-dimensional math problems, mainly at the interface of probability, combinatorics, and information theory. Specifically, my research interests include:
- Combinatorics and Coding Theory
- Boolean functions and Hamming spaces
- Packing and covering
- Probability and Information Theory
- Common information, noise stability, isoperimetry, and hypercontractivity
- Coupling and optimal transport
- Information-theoretic methods, especially the combination of entropy/divergence and coupling techniques
- Past Interests: My research has seamlessly transitioned from video transmission to current ones.
(Thank my former advisors for providing me freedom to choose topics.)
Research Topics
- Functional/Information-Theoretic Inequalities
- Lei Yu, "Rényi Resolvability, Noise Stability, and Anti-contractivity", Feb 2024. [arxiv]
- Hao Wu, Lei Yu, Laigang Guo, "On the Completely Monotone Conjecture for Rényi Entropy", Dec. 2023 [arxiv].
- Lei Yu and Hao Wu, "Rényi–Sobolev Inequalities and Connections to Spectral Graph Theory", Jun. 2023 [arxiv].
- Lei Yu and Venkat Anantharam, "The Hypercontractivity Constant is the Largest Tensorized Φ-SDPI Constant for Binary Sources", 2021.
- Lei Yu, "Strong Brascamp-Lieb and Hypercontractivity Inequalities," Feb. 2021. Updated and submitted Sep. 2022. [arxiv] [updated version]
* This paper, motivated by the works in [link] and [link], strengthens classic Brascamp-Lieb and hypercontractivity inequalities, and also resolves Ordentlich-Polyanskiy-Shayevitz's conjecture in [link] and independently resolves Polyanskiy's conjecture stated in [link]. See the monograph for details.
* The following paper is incorporated into the paper above.
Lei Yu, "The Convexity and Concavity of Envelopes of the Minimum-Relative-Entropy Region for the DSBS," Jun. 2021. Updated Jul. 2022. [arxiv] [updated version]
- Lei Yu, Venkat Anantharam, and Jun Chen, "Graphs of Joint Types, Noninteractive Simulation, and Stronger Hypercontractivity," IEEE Trans. Inf. Theory, 2024. [arxiv]
- Lei Yu, "Gray–Wyner and Mutual Information Regions for Doubly Symmetric Binary Sources and Gaussian Sources", IEEE Trans. Inf. Theory, Vol. 69, No. 10, pp. 6251 - 6268, Oct 2023. [link][arxiv] * This paper resolves a conjecture of Gray and Wyner in 1974
- Noise Stability and Isoperimetry
- Lei Yu, "Exact Exponents for Concentration and Isoperimetry in Product Polish Spaces", May 2022. Updated Sep. 2022. [arxiv]
* The convergence rates of the concentration and isoperimetric functions in the product Polish probability space were characterized in this paper, which verify an intimate connection among information theory, optimal transport, and concentration of measure or isoperimetric inequalities.
- Lei Yu, "On the Φ-Stability and Related Conjectures," Probability Theory and Related Fields, vol. 186, pp. 1045-1080, 2023. [link] [arxiv] [MathematicaCode]
* This paper partially resolves the Mossel-O’Donnell Conjecture, the Courtade-Kumar Conjecture, and the Li-Médard Conjecture.
- Lei Yu, "Edge-Isoperimetric Inequalities and Ball-Noise Stability: Linear Programming and Probabilistic Approaches," Journal of Combinatorial Theory, Series A, Volume 188, May 2022, 105583. [arxiv]
- Lei Yu and Vincent Y. F. Tan, "On Non-Interactive Simulation of Binary Random Variables" IEEE Trans. Inf. Theory, Vol. 67, No. 4, Pages 2528 – 2538, Apr 2021. [arxiv] [slides]
* This paper resolves a problem posed by Elchanan Mossel in 2017.
- Common Information and Simulation
- Lei Yu and Venkat Anantharam, "Sequential Channel Synthesis", IEEE Trans. Inf. Theory, Vol. 69, No. 5, pp. 2779 - 2795, May 2023. [arxiv]
- Lei Yu and Vincent Y. F. Tan, “On exact and ∞-Rényi common informations,” IEEE Trans. Inf. Theory, Vol. 66, No. 6, Pages 3366 – 3406, Jun 2020. [arxiv] [slides] [slides]
* This paper resolves a problem posed by Kumar, Li, and El Gamal in 2014.
- Lei Yu and Vincent Y. F. Tan, “Exact channel synthesis,” IEEE Trans. Inf. Theory, Vol. 66, No. 5, Pages 2299 – 2818, May 2020. [arxiv] [slides]
- Lei Yu and Vincent Y. F. Tan, “Simulation of random variables under Rényi divergence measures of all orders,” IEEE Trans. Inf. Theory, Vol. 65, No. 6, Pages 3349 – 3383, Jun 2019. [link] [arxiv] [slides]
- Lei Yu and Vincent Y. F. Tan, "Rényi resolvability and its applications to the wiretap channel," IEEE Trans. Inf. Theory, Vol. 65, No. 3, Pages 1862– 1897, Mar 2019. [link] [arxiv]
- Lei Yu and Vincent Y. F. Tan, "Wyner’s common information under Rényi divergence measures," IEEE Trans. Inf. Theory, vol. 64, no. 5, pp. 3616-3632, May 2018. [link] [arxiv]
* An error exists in this paper, due to my negligence in the derivation. See Correction and New Converse in "Corrections to “Wyner’s Common Information under Rényi Divergence Measures”" IEEE Trans. Inf. Theory, Vol. 66, No. 4, Pages 2599 – 2608, Apr 2020
- Optimal Transport and Coupling
- Lei Yu, "Asymptotics for Strassen's Optimal Transport Problem," Annales de l'Institut Henri Poincaré (B) Probabilités et Statistiques, 59(4): 1745-1777, Nov 2023. [link] [arxiv]
- Lei Yu and Vincent Y. F. Tan, “Asymptotic coupling and its applications in information theory,” IEEE Trans. Inf. Theory, Vol. 65, No. 3, Pages 1321– 1344, Mar 2019. [link] [arxiv] [slides]
* Conjecture 26 was disproved in [link]. Open Problem 1 was solved in [arxiv]. By using Kumagai-Hayashi's proof ideas in [link], Open Problem 2 can be easily solved and Conjecture 25 can be easily disproved.
- Combinatorics
- Lei Yu, "Dimension-Free Bounds for the Union-Closed Sets Conjecture", (Invited Paper) Entropy, 25(5), 767, 2023. [link] [arxiv] [MathematicaCode]
* This paper numerically evaluates Sawin's bound on the Union-Closed Sets Conjecture which is 0.38234......
- Shannon Theory
- Jun Chen, Lei Yu, Jia Wang, Wuxian Shi, Yiqun Ge, Wen Tong, "On the Rate-Distortion-Perception Function," IEEE Journal on Selected Areas in Information Theory, vol. 3, no. 4, pp. 664-673, Dec. 2022.
- M. Baig, Lei Yu, Z. Xiong, A. Host-Madsen, H. Li, and W. Li, "On the Energy-Delay Tradeoff in Streaming Data: Finite Blocklength Analysis," IEEE Trans. Inf. Theory, Vol. 66, No. 3, Pages 1861 - 1881, Mar 2020.
- Lei Yu, Houqiang Li, and Weiping Li, "Distortion bounds for source broadcast problems," IEEE Trans. Inf. Theory, vol. 64, no. 9, pp. 6034-6053, Sep. 2018. [link] [arxiv]
- Lin Zhou, Vincent Y. F. Tan, Lei Yu and Mehul Motani, "Exponential strong converse for content identification with lossy recovery," IEEE Trans. Inf. Theory, vol. 64, no. 8, pp. 5879-5897, Aug 2018. [link] [arxiv]
- Lei Yu, Houqiang Li, and Weiping Li, "Joint source-channel secrecy using uncoded schemes: Towards secure source broadcast," IEEE Trans. Inf. Theory, vol. 63, no. 11, pp. 7442-7463, Nov. 2017. [link] [arxiv]
- Lei Yu, Houqiang Li, and Weiping Li, "Source-channel secrecy for Shannon cipher system," IEEE Trans. Inf. Theory, vol. 63, no. 4, pp. 2596-2622, Apr. 2017. [link] [arxiv] [slides]
- Lei Yu, Houqiang Li, and Weiping Li, "Comments on 'Approximate characterizations for the Gaussian source broadcast distortion region'," IEEE Trans. Inf. Theory, vol. 62, no. 10, pp. 5966-5969, Oct. 2016. [link] [arxiv]
- Video Communication
- Jian Shen, Lei Yu, Li Li, and Houqiang Li, "Foveation based wireless soft image delivery," IEEE Trans. Multimedia, vol. 20, no. 10, pp. 2788 - 2800, May 2018.
- Lei Yu, Houqiang Li, and Weiping Li, "Wireless cooperative video coding using a hybrid digital-analog scheme," IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 3, pp. 436-450, Mar. 2015. [link] [pdf]
- Lei Yu, Houqiang Li, and Weiping Li, "Wireless scalable video coding using a hybrid digital-analog scheme," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 2, pp. 331-345, Feb. 2014. [link] [pdf] [matlab-code]
Randomly Selected Invited Talks
- "无处不在的熵", 上海交通大学数学沙龙, May 2023 [slides]
- "The Entropy Method", Chinese Conference on Information Theory, Dec. 2022
- "Noise Stability: Old and New", Institute for Advanced Study in Mathematics, Harbin Institute of Technology, Jul. 2022 [slides]
- "On the Φ-Stability and Related Conjectures," Shandong University, Apr. 2022
- "Strong Brascamp-Lieb Inequalities," ITW, Oct. 2021
- "Common Information: Old and New", Tutorial at the 2021 ISIT with Vincent Y. F. Tan, Jul. 2021. [slides of my part] (corrected version)
- "Noninteractive simulation of binary random variables" (almost same as the 2nd part of the tutorial at the 2021 ISIT), School of Mathematics and Statistics, Kashgar University, China, Jul. 2021.
- "Average Distance and Boolean Function", Institute for Mathematical Sciences, ShanghaiTech University, China, Dec. 2019.
- "Asymptotics for Strassen's Optimal Transport Problem", Institute for Mathematical Sciences, ShanghaiTech University, China, Dec. 2019.
- "On Binary Codes and Non-Interactive Simulation", Workshop on Probability and Information Theory, The University of Hong Kong, China, Aug. 2019.
- "On exact and ∞-Rényi common informations," ITA, Feb. 2019.
- "Joint source-channel coding," McMaster University, Canada, Dec. 1, 2016.
Useful Techniques in High-Dimensional Combinatorics, Probability, and Information Theory
- Method of types, information spectrum method, information-theoretic inequalities, probability concentration inequalities (CLT, large deviation theory, entropy/Renyi entropy method, ...), basic inequalities (Holder inequality, Minkowski inequality, ...), hypercontractivity inequalities, Fourier analysis, optimization theory (duality, KKT condition, variational method, ...), linear programming method (duality, coupling and optimal transport), linear algebra, spectral graph method, polynomial method, random matrix theory, group theory, stochastic process and MDP, ...
Open Problems and Conjectures
- I summarize several my open problems and conjectures in [pdf]
- Famous open problems and conjectures in TCS can be found in [pdf]