FULL [LIST] OF
PUBLICATIONS
SELECTED PUBLICATIONS
& PREPRINTS:
PREPRINTS
● O. Johnson, L.
Gavalakis and I. Kontoyiannis. "Relative entropy bounds for sampling with
and without replacement." Submitted. [arXiv]
● V. Lungu and
I. Kontoyiannis. "Finite-sample expansions for the optimal error
probability in asymmetric binary hypothesis testing." Submitted. [arXiv]
● L. Gavalakis,
I. Kontoyiannis and M. Madiman. "The entropic doubling constant and
robustness of Gaussian codebooks for additive-noise channels." Submitted.
[arXiv]
● I.
Papageorgiou and I. Kontoyiannis. "The Bayesian Context Trees State Space
Model for time series modelling and forecasting." Submitted. [arXiv]
● E.M. Loizidou, A. Simistiras, P. Barbounakis, S. Glentis, A.
Dimopoulos, M. Anezaki, P. Rouskas,
I. Kontoyiannis, N. Demiris, N. Scarmeas, M. Yannakoulia, K. Rouskas and A.S.
Dimas. "Periodic restriction of animal products rapidly decreases
cardiovascular disease risk and reduces low-grade inflammation: the FastBio study." Submitted. [medRxiv]
● V. Lungu, I.
Papageorgiou and I. Kontoyiannis. "Change-point detection and segmentation
of discrete data using Bayesian Context Trees. " Submitted. [arXiv]
Associated R package on CRAN [BCT]
● V. Borkar, S.
Chen, A. Devraj, I. Kontoyiannis and S.P. Meyn. "The ODE method for
asymptotic statistics in stochastic approximation and reinforcement
learning." Submitted. [arXiv]
2021-PRESENT
● M. Tapia
Costa, I. Kontoyiannis and S. Godsill. "Generalised shot noise representations
of stochastic systems driven by non-Gaussian Lévy processes." To
appear, Journal of Applied Probability, 2024. [arXiv]
● I.
Papageorgiou and I. Kontoyiannis. "Posterior representations for Bayesian
Context Trees: Sampling, estimation and convergence." Bayesian Analysis,
19, no. 2, pp. 501-529, June 2024. [arXiv]
● M. Berta, L.
Gavalakis and I. Kontoyiannis. "A third information-theoretic approach to
finite de Finetti theorems." 2024 IEEE International Symposium on
Information Theory, Athens, Greece, July 2024. [arXiv]
● L. Gavalakis
and I. Kontoyiannis. "Entropy and the discrete central limit
theorem." Stochastic Processes and Their Applications, 70,
104294, April 2024. [arXiv]
● A.
Theocharous, G.G. Gregoriou, P. Sapountzis, and I.
Kontoyiannis. "Temporally causal discovery tests for discrete time series
and neural spike trains." IEEE Transactions on Signal Processing, 72,
pp. 1333-1347, February 2024. [arXiv]
● I.
Kontoyiannis. "Context-tree weighting and Bayesian Context Trees:
Asymptotic and non-asymptotic justifications." IEEE Trans. Information
Theory, 70, no. 2, pp. 1204-1219, February 2024. [arXiv]
● I.
Papageorgiou and I. Kontoyiannis. "Context-tree weighting for real-valued
time series: Bayesian inference with hierarchical mixture models." 2023
IEEE International Symposium on Information Theory, Taipei, Taiwan, June
2023. [arXiv]
● I. Gavalakis
and I. Kontoyiannis. "Information in probability: Another
information-theoretic proof of a finite de Finetti theorem." In Mathematics
Going Forward: Collected Mathematical Brushstrokes, (J.-M. Morel, B.
Teissier, editors), pp. 367-385, Lecture Notes in Mathematics series, vol.
2313, Springer, Switzerland, May 2023. [arXiv]
● I.
Papageorgiou and I. Kontoyiannis. "Truly Bayesian entropy
estimation." 2023 IEEE Information Theory Workshop,
● I.
Kontoyiannis, L. Mertzanis, A. Panotopoulou, I. Papageorgiou and M.
Skoularidou. "Bayesian Context Trees: Modelling and exact inference for
discrete time series." Journal of
the Royal Statistical Society: Series B, 84, no. 4, pp. 1287-1323,
September 2022. [arXiv]
Associated R package on CRAN [BCT]
● L. Tray and I.
Kontoyiannis. "The feature-first block model." 36th International
Workshop on Statistical Modelling, Trieste, Italy July 2022. Longer
version: [arXiv]
● I.
Kontoyiannis, Y.H. Lim, K. Papakonstantinopoulou and W. Szpankowski.
"Compression and symmetry of small-world graphs and structures." Communications
in Information and Systems, 22, no. 2, pp. 275-302, May 2022. [arXiv]
● I.
Papageorgiou, V.M. Lungu and I. Kontoyiannis. R package BCT: "Bayesian
Context Trees for Discrete Time Series." Version 1.2, May 2022, available
on CRAN [BCT]
● P. Barmpounakis,
N. Demiris, I. Kontoyiannis, G. Pavlakis and V. Sypsa. " Evaluating the
effects of second-dose vaccine-delay policies in European countries: A
simulation study based on data from Greece." PLoS ONE, 17(4):
e0263977, April 2022. [medRxiv]
● L. Gavalakis
and I. Kontoyiannis. "An information-theoretic
proof of a finite de Finetti theorem." Electronic Comm. in Probab.,
26, paper 68, pp. 1-5, December 2021. [arXiv]
● T.B. Berrett,
I. Kontoyiannis and R.J. Samworth. "Optimal rates for independence testing
via U-statistic permutation
tests." Annals of Statistics, 49, no. 5, pp. 2457-2490,
October 2021. [arXiv] Associated R package on
CRAN [USP]
● A.M. Devraj,
I. Kontoyiannis and S.P. Meyn. "Differential
temporal difference learning." To IEEE Trans. Automatic
Control, 66, no. 10, pp. 4652-4667 October 2021. [arXiv]
● S. Diggavi, A.
El Gamal, I. Kontoyiannis, A. Paranjpe and M. Subbarao "Joy Thomas:
Legacy, foundation and the IT society." IEEE BITS the Information
Theory Magazine, 1, no. 1, pp. 85-88, August 2021. [IEEEXplore] [pdf]
● L. Gavalakis
and I. Kontoyiannis. "Fundamental limits of lossless data compression with
side information." IEEE Trans. Information Theory, 67, no.
5, pp. 2680-2692, May 2021. [arXiv]
● J. Taipale, I.
Kontoyiannis and S. Linnarsson. "Population-scale testing can suppress the
spread of infectious disease." arXiv manuscript, 2104.06857 [q-bio.PE],
April 2021. [arXiv]
Conference talk on YouTube [video] [slides]
2016-2020
● I. Papageorgiou,
V.M. Lungu and I. Kontoyiannis. R package BCT: "Bayesian
Context Trees for Discrete Time Series." Version 1.1, November 2020,
available on CRAN [BCT]
● T.B. Berrett,
I. Kontoyiannis and R.J. Samworth. R package USP: "U-Statistic
Permutation Tests of Independence for all Data Types." Version 1.0,
November 2020, available on CRAN [USP]
● R. Cavallari,
S. Toumpis, R. Verdone and I. Kontoyiannis. "Packet speed and cost in
mobile wireless delay-tolerant networks." IEEE Trans. Information
Theory, 66, no. 9, pp. 5683-5702, September 2020. [arXiv]
● M. Riabiz, T.
Ardeshiri, I. Kontoyiannis and S Godsill. "Nonasymptotic Gaussian
approximation for inference with stable noise." IEEE Trans. Information
Theory, 66, no. 8, pp. 4966-4991, August 2020. [arXiv]
● D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "A simple network of nodes
moving on the circle." Random Structures & Algorithms, 57,
no. 2, pp. 317-338, July 2020. [arXiv]
● L. Gavalakis
and I. Kontoyiannis. "Sharp second-order pointwise asymptotics for
lossless compression with side information." Entropy, 22,
no. 6, paper 705, June 2020. [arXiv]
● A.M. Devraj,
I. Kontoyiannis and S.P. Meyn. "Geometric ergodicity in a weighted Sobolev
space." Annals of Probability, 48, no. 1, pp.
308-403, January 2020. [arXiv]
● M. Madiman and
I. Kontoyiannis. "Entropy bounds on abelian groups and the Ruzsa
divergence." IEEE Trans. Information Theory, 64, no. 1, pp. 77-92, January 2018. [arXiv]
● M. Riabiz, T.
Ardeshiri, I. Kontoyiannis and S Godsill. "Simulated convergence rates
with application to an intractable alpha-stable inference problem."
(invited paper) IEEE International Workshop on
Computational Advances in Multi-Sensor Adaptive Processing, Curaçao, Dutch Antilles, December 2017. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Approximating a diffusion by a finite-state
hidden Markov model." Stochastic Processes and their
Applications, 127, no. 8, pp.
2482-2507, August 2017. [pdf] [arXiv]
● D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "Exact speed and transmission
cost in a simple one-dimensional wireless delay-tolerant network." 2017
IEEE International Symposium on Information Theory, Aachen, Germany, June
2017. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "On the f-norm ergodicity of Markov
processes in continuous time." Electronic Comm. in Probab., 21, paper 77,
pp. 1-10, November 2016. [pdf] [arXiv]
● I.
Kontoyiannis and M. Skoularidou. "Estimating the directed information and
testing for causality." IEEE Trans. Information Theory, 62,
no. 11, pp. 6053-6067,
November 2016. [arXiv]
● Book: (in
Greek) I. Kontoyiannis and S. Toumpis. "Elements
of Probability: With Applications in Statistics and Computer Science."
Hellenic Academic Libraries Link, Ministry of Education, Athens, 2015. [Citation in Greek:
Γ. Κοντογιάννης και Σ. Τουμπής. "Στοιχεία
πιθανοτήτων:
Με εφαρμογές
στη στατιστική
και την
πληροφορική". Σύνδεσμος
Ελληνικών
Ακαδημαϊκών
Βιβλιοθηκών, Αθήνα,
2015.] ISBN: 978-960-603-182-3 [Official
Page] [Latest
Version] [Searchable pdf without hyperlinks]
● I.
Kontoyiannis and M. Madiman. "Sumset and inverse sumset inequalities for
differential entropy and mutual information." IEEE Trans. Information
Theory, 60, no. 8, pp. 4503-4514, August 2014. [pdf]
● I.
Kontoyiannis and S. Verdú. "Optimal lossless data compression:
Non-asymptotics and asymptotics." IEEE Trans. Information Theory, 60,
no. 2, pp. 777-795, February 2014. [pdf]
● Y. Altuğ,
I. Kontoyiannis and A.B. Wagner. "Lossless compression with moderate error
probability." 2013 IEEE International Symposium on Information Theory,
Istanbul, Turkey, July 2013. [pdf]
● O. Johnson, I.
Kontoyiannis and M. Madiman. "Log-concavity, ultra-log-concavity and a
maximum entropy property of discrete compound Poisson measures." Discrete Applied Mathematics (Special
issue, Proceedings of the Jubilee Conference on Discrete Mathematics JCDM 2009,
D. J. Kleitman, A. Shastri, V. T. So's, eds.) 161, no. 9, pp. 1232-1250,
June 2013. [pdf] See also earlier version on the [arXiv]
● C. Gioran and
I. Kontoyiannis. "Complexity-compression tradeoffs in lossy compression
via efficient random codebooks and databases." Problems of Information Transmission, 48, Issue 4, pp.
376-394, October 2012. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Geometric ergodicity and the spectral gap of
non-reversible Markov chains." Probability Theory and Related Fields, 154, Issue 1-2, pp.
327-339, October 2012. [pdf]
● V. Anantharam,
G. Caire, M. Costa, I. Kontoyiannis, G. Kramer, R. Yeung, and S. Verdú.
"Panel on New Perspectives on
Information Theory." (Invited discussion.) IEEE Information Theory Society Newsletter, pp. 21-27, March 2012.
[pdf]
● P. Dellaportas
and I. Kontoyiannis. "Control variates for estimation based on reversible
Markov chain Monte Carlo samplers." Journal
of the Royal Statistical Society: Series B, 74, Part 1, pp. 133-161, 2012. [pdf]
● P.
Harremoës, O. Johnson and I. Kontoyiannis. "Thinning, entropy and the
law of thin numbers." IEEE Trans. Inform. Theory, 56, no. 9, pp. 4228-4244, September 2010. [pdf]
● A.D. Barbour,
O. Johnson, I. Kontoyiannis and M. Madiman. "Compound Poisson
approximation via information functionals." Electronic J. of Probab.,
15, paper 42, pp. 1344-1368, August
2010. [pdf]
● A.
Anagnostopoulos, C. Dombry, N. Guillotin-Plantard, I. Kontoyiannis and E.
Upfal. "Probabilistic analysis of the k-server
problem on the circle." Unpublishe manuscript,
May 2010. [pdf]
● P. Dellaportas
and I. Kontoyiannis. "Notes on using control variates for estimation with
reversible MCMC samplers." arXiv
manuscript, 0907.4160 [stat.CO], July 2009. [arXiv]
2006-2008
● S. Kyriazopoulou-Panagiotopoulou, I. Kontoyiannis and S.P.
Meyn. "Control variates as screening functions. " Third
International Conference on Performance Evaluation Methodologies and Tools,
Athens, Greece, October 2008. [pdf]
● M. Harrison and
I. Kontoyiannis "Estimation of the rate-distortion function." IEEE
Trans. Inform. Theory, 54, pp. 3757-3763, August 2008. [pdf] See also the longer version with additional results,
details and proofs on the [arXiv]
● I.
Kontoyiannis. "Book review: "Information and complexity in
statistical modeling," by J. Rissanen, Springer, NY, 2007." Amer.
Math. Monthly, 115, no. 10, pp. 956-960, December 2008. [pdf] [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Computable exponential bounds for screened
estimation and simulation." Ann. Appl. Probab., 18, pp.
1491-1518, August 2008. [pdf]
● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Estimating the entropy of binary time
series: Methodology, some theory and a simulation study." Entropy, 10, issue 2, pp. 71-99, June 2008. [pdf] [pdf]
● I. Kontoyiannis. "Counting the primes using entropy." IEEE
Information Theory Society Newsletter, 58, no. 2, pp. 6-9, June
2008. [pdf] [pdf] Slides from a talk on this work at ITW 2008 in
Porto, May 2008. [pdf]
● I.
Kontoyiannis. "Some information-theoretic computations related to the
distribution of prime numbers." In Festschrift in Honor of Jorma
Rissanen, (P. Grunwald, P. Myllymaki, I. Tabus, M. Weinberger, B. Yu,
eds.), pp. 135-143,
● H.M. Aktulga,
I. Kontoyiannis,
● P.
Harremoës, O. Johnson and I. Kontoyiannis. "Thinning and the law of
small numbers." 2007 IEEE International Symposium on Information Theory,
Nice, France, June 2007. [pdf]
● M. Madiman, O.
Johnson and I. Kontoyiannis. "Fisher information, compound Poisson
approximation, and the Poisson channel." 2007 IEEE International
Symposium on Information Theory, Nice, France, June 2007. [pdf]
● I.
Kontoyiannis,
● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "From the entropy to the statistical
structure of spike trains." 2006 IEEE International Symposium on
Information Theory,
● I.
Kontoyiannis and M. Madiman. "Measure concentration for compound Poisson
distributions." Electronic Comm. in Probab., 11, paper 5,
pp. 45-57, May 2006. [pdf]
● I.
Kontoyiannis and R. Zamir. "Mismatched codebooks and the role of entropy-coding
in lossy data compression." IEEE Trans. Inform. Theory, 52,
pp. 1922-1938, May 2006. [pdf] [pdf]
2003-2005
● I.
Kontoyiannis,
● I.
Kontoyiannis and B. Lucena. "Mutual information, synergy, and some curious
phenomena for simple channels." 2005 IEEE International Symposium on
Information Theory,
● B. Lucena and
I. Kontoyiannis. "Filtering: The case for "noisier" data." 2005
IEEE Information Theory Workshop,
● A. Anagnostopoulos,
I. Kontoyiannis and E. Upfal. "Steady state analysis of balanced
allocation routing." Random Structures & Algorithms, 26,
pp. 446-467, July 2005. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Large deviations asymptotics and the spectral
theory of multiplicatively regular Markov processes." Electronic J. of
Probab., 10, paper 3, pp. 61-123, February 2005. [pdf] See also the slides from a
presentation on this work: [pdf]
● I.
Kontoyiannis, P. Harremoës and O. Johnson. "Entropy and the law of
small numbers." IEEE Trans. Inform. Theory, 51, pp. 466-472,
February 2005. [pdf] [pdf]
● I.
Kontoyiannis and M. Madiman. "Entropy, compound Poisson approximation,
log-Sobolev inequalities and measure concentration." 2004 IEEE Information
Theory Workshop,
● M. Madiman, M.
Harrison and I. Kontoyiannis. "Minimum Description Length vs. Maximum
Likelihood in lossy data compression." 2004 IEEE International
Symposium on Information Theory,
● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Estimating the entropy rate of spike
trains." 38th Annual Conference on Information Sciences and Systems,
● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Lempel-Ziv and CTW entropy estimators
for spike trains." Invited paper, Estimation of entropy Workshop,
2003 Neural Information Processing Systems Conference, Vancouver, BC,
Canada, December 2003. [pdf]
● I.
Kontoyiannis. "Pattern matching and lossy data compression on random
fields." IEEE Trans. Inform. Theory, 49, pp. 1047-1051,
April 2003. [pdf]
● I.
Kontoyiannis and A.D. Sezer. "A remark on unified error exponents:
Hypothesis testing, data compression and measure concentration." Barcelona
Conference on Stochastic Inequalities and Their Applications, Spain, 2002;
published in Progress in Probability, vol. 56, pp. 23-32, Birkhauser,
Basel/Switzerland, 2003. [pdf]
● N. Merhav and
I. Kontoyiannis. "Source coding exponents for zero-delay coding with
finite memory." IEEE Trans. Inform. Theory, 49, pp. 609-625,
March 2003. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Spectral theory and limit theorems for
geometrically ergodic Markov processes." Ann. Appl. Probab., 13,
pp. 304-362, February 2003. [pdf]
2000-2002
● M. Harrison
and I. Kontoyiannis. "Maximum likelihood estimation for lossy data
compression" (invited paper). 40th Allerton Conference on
Communication, Control and Computing,
● V. Castelli
and I. Kontoyiannis. "An efficient recursive partitioning algorithm for
classification, using wavelets." APPTS
Report
#02-7, Division of Applied Math,
● J. Huang, I. Kontoyiannis
and S.P. Meyn. "The ODE method and spectral theory of Markov
operators." In Proceedings of Stochastic Theory and Control Workshop,
Springer,
● I. Kontoyiannis
and J. Zhang. "Arbitrary source models and Bayesian codebooks in
rate-distortion theory." IEEE Trans. Inform. Theory, 48, pp.
2276-2290, August 2002. [pdf]
● A. Dembo and
I. Kontoyiannis. "Source coding, large deviations, and approximate pattern
matching." Invited paper in IEEE Trans. Inform. Theory special
issue on Shannon theory, dedicated to Aaron D.
Wyner, 48, pp. 1590-1615, June 2002. [pdf]
● A. Antos and
I. Kontoyiannis. "Convergence properties of functional estimates for
discrete distributions." Random Structures & Algorithms, 19,
pp. 163-193. October 2001. [pdf]
● J. Zhang,
E.K.P. Chong and I. Kontoyiannis. "Unified spatial diversity combining and
power allocation schemes for CDMA systems." IEEE J. on Selected Areas
in Comm., 19, pp. 1276-1288, July 2001. [pdf]
● I.
Kontoyiannis. "Sphere-covering, measure concentration, and source
coding." IEEE Trans. Inform. Theory, 47, pp. 1544-1552, May
2001. [pdf] [pdf]
● A. Dembo and
I. Kontoyiannis. "Critical behavior in lossy source coding." IEEE
Trans. Inform. Theory, 47, pp. 1230-1236, March 2001. [pdf] [pdf]
● Patent: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,141,445. October 2000. [HTML]
● I.
Kontoyiannis. "Model selection via rate-distortion theory" (invited
paper). 34th Annual Conference on Information Sciences and Systems,
March 2000. [pdf]
● Patent: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,021,224. February 2000. [HTML]
● I.
Kontoyiannis. "Pointwise redundancy in lossy data compression and universal
lossy data compression." IEEE Trans. Inform. Theory, 46, pp.
136-152, January 2000. [pdf]
1999 & EARLIER
● I.
Kontoyiannis. "An implementable lossy version of the Lempel-Ziv algorithm
-- Part I: Optimality for memoryless sources." IEEE Trans. Inform.
Theory, 45, pp. 2293-2305, November 1999. [pdf]
● A. Dembo and
I. Kontoyiannis. "Critical behavior in data compression." Technical
Report no. TR-99-26, Department of Statistics,
● I.
Kontoyiannis. "Efficient sphere-covering and converse measure
concentration via generalized coding theorems." Technical Report no. TR-99-26,
Department of Statistics,
● A. Dembo and
I. Kontoyiannis. "The asymptotics of waiting times between stationary
processes, allowing distortion." Ann. Appl. Probab., 9, pp.
413-429, May 1999. [pdf]
● I.
Kontoyiannis. "Asymptotic recurrence and waiting times for stationary
processes." J. Theoret. Probab., 11, pp. 795-811, July 1998.
[pdf]
● I.
Kontoyiannis, P.H. Algoet, Yu. M. Suhov and A.J. Wyner. "Nonparametric
entropy estimation for stationary processes and random fields, with
applications to English text." IEEE Trans. Inform. Theory, 44,
pp. 1319-1327, May 1998. [pdf]
● Ph.D. Thesis: "Recurrence and Waiting Times in Stationary
Processes, and their Applications in Data Compression." Department of Electrical Engineering, Stanford University, May 1998. [HTML]
● V. Castelli,
L. Bergman, I. Kontoyiannis, C.-S. Li, J. Robinson and J. Turek.
"Progressive search and retrieval in large image archives." IBM J.
Res. Develop., 42, pp. 253-268, March 1998. [pdf]
● I.
Kontoyiannis. "Second-order noiseless source coding theorems." IEEE
Trans. Inform. Theory, 43, pp. 1339-1341, July 1997. [pdf]
● I.
Kontoyiannis. "The complexity and entropy of literary styles." NSF
Technical Report no. 97, Department of Statistics,
● V. Castelli,
I. Kontoyiannis, C.S. Li, and J.J. Turek. "Progressive classification in
the compressed domain for large EOS satellite databases." 1996 IEEE
International Conference on Acoustics, Speech and Signal Processing. [pdf]
● I.
Kontoyiannis, J. Turek, V. Castelli and J. Robinson. "Multiresolution
lossless image compression." Unpublished manuscript, December 1995. [pdf]
●
I.
Kontoyiannis and Yu. M. Suhov. "Prefixes and the entropy rate for
long-range sources." In Probability Statistics and Optimization: A
tribute to Peter Whittle (F.P. Kelly ed.), pp. 89-98, Wiley, 1994. [pdf]