Bibliography

Works cited throughout the notes, in author–date order. Citations in the text link here.

Akaike, Hirotugu. 1974. “A New Look at the Statistical Model Identification.” IEEE Transactions on Automatic Control 19 (6): 716–23. https://doi.org/10.1109/TAC.1974.1100705.

Allman, Elizabeth S., Catherine Matias, and John A. Rhodes. 2009. “Identifiability of Parameters in Latent Structure Models with Many Observed Variables.” The Annals of Statistics 37 (6A): 3099–132. https://doi.org/10.1214/09-AOS689.

Altman, Rachel MacKay. 2007. “Mixed Hidden Markov Models: An Extension of the Hidden Markov Model to the Longitudinal Data Setting.” Journal of the American Statistical Association 102 (477): 201–10. https://doi.org/10.1198/016214506000001086.

Amari, Shun-ichi. 2016. Information Geometry and Its Applications. Springer. https://doi.org/10.1007/978-4-431-55978-8.

Argiento, Raffaele, and Maria De Iorio. 2022. “Is Infinity That Far? A Bayesian Nonparametric Perspective of Finite Mixture Models.” The Annals of Statistics 50 (5): 2641–63. https://doi.org/10.1214/22-AOS2201.

Åström, Karl Johan. 1965. “Optimal Control of Markov Processes with Incomplete State Information.” Journal of Mathematical Analysis and Applications 10 (1): 174–205. https://doi.org/10.1016/0022-247X(65)90154-X.

Baum, Leonard E., and Ted Petrie. 1966. “Statistical Inference for Probabilistic Functions of Finite State Markov Chains.” The Annals of Mathematical Statistics 37 (6): 1554–63. https://doi.org/10.1214/aoms/1177699147.

Baum, Leonard E., Ted Petrie, George Soules, and Norman Weiss. 1970. “A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains.” The Annals of Mathematical Statistics 41 (1): 164–71. https://doi.org/10.1214/aoms/1177697196.

Beal, Matthew J., Zoubin Ghahramani, and Carl E. Rasmussen. 2002. “The Infinite Hidden Markov Model.” Advances in Neural Information Processing Systems 14: 577–84.

Betancourt, Michael, and Mark Girolami. 2015. “Hamiltonian Monte Carlo for Hierarchical Models.” Current Trends in Bayesian Methodology with Applications, 79–101. https://doi.org/10.1201/b18502-5.

Bickel, Peter J., Ya’acov Ritov, and Tobias Rydén. 1998. “Asymptotic Normality of the Maximum-Likelihood Estimator for General Hidden Markov Models.” The Annals of Statistics 26 (4): 1614–35. https://doi.org/10.1214/aos/1024691255.

Bishop, Christopher M. 2006. Pattern Recognition and Machine Learning. Springer.

Boyd, Stephen, and Lieven Vandenberghe. 2004. Convex Optimization. Cambridge University Press. https://doi.org/10.1017/CBO9780511804441.

Cappé, Olivier, Éric Moulines, and Tobias Rydén. 2005. Inference in Hidden Markov Models. Springer Series in Statistics. Springer. https://doi.org/10.1007/0-387-28982-8.

Carter, Chris K., and Robert Kohn. 1994. “On Gibbs Sampling for State Space Models.” Biometrika 81 (3): 541–53. https://doi.org/10.1093/biomet/81.3.541.

Celeux, Gilles, and Jean-Baptiste Durand. 2008. “Selecting Hidden Markov Model State Number with Cross-Validated Likelihood.” Computational Statistics 23 (4): 541–64. https://doi.org/10.1007/s00180-007-0097-1.

Cesa-Bianchi, Nicolò, and Gábor Lugosi. 2006. Prediction, Learning, and Games. Cambridge University Press. https://doi.org/10.1017/CBO9780511546921.

Chib, Siddhartha. 1996. “Calculating Posterior Distributions and Modal Estimates in Markov Mixture Models.” Journal of Econometrics 75 (1): 79–97. https://doi.org/10.1016/0304-4076(95)01770-4.

Chopin, Nicolas, and Omiros Papaspiliopoulos. 2020. An Introduction to Sequential Monte Carlo. Springer. https://doi.org/10.1007/978-3-030-47845-2.

Cover, Thomas M., and Joy A. Thomas. 2006. Elements of Information Theory. 2nd ed. Wiley. https://doi.org/10.1002/047174882X.

Del Moral, Pierre, and Alice Guionnet. 2001. “On the Stability of Interacting Processes with Applications to Filtering and Genetic Algorithms.” Annales de l’Institut Henri Poincaré (B) Probability and Statistics 37 (2): 155–94. https://doi.org/10.1016/S0246-0203(00)01064-5.

Dempster, Arthur P., Nan M. Laird, and Donald B. Rubin. 1977. “Maximum Likelihood from Incomplete Data via the EM Algorithm.” Journal of the Royal Statistical Society, Series B 39 (1): 1–38. https://doi.org/10.1111/j.2517-6161.1977.tb01600.x.

Douc, Randal, Éric Moulines, and Tobias Rydén. 2004. “Asymptotic Properties of the Maximum Likelihood Estimator in Autoregressive Models with Markov Regime.” The Annals of Statistics 32 (5): 2254–304. https://doi.org/10.1214/009053604000000021.

Douc, Randal, Éric Moulines, and David S. Stoffer. 2014. Nonlinear Time Series: Theory, Methods and Applications with R Examples. Chapman; Hall/CRC. https://doi.org/10.1201/b16331.

Doucet, Arnaud, Nando de Freitas, and Neil Gordon, eds. 2001. Sequential Monte Carlo Methods in Practice. Springer. https://doi.org/10.1007/978-1-4757-3437-9.

Durbin, Richard, Sean R. Eddy, Anders Krogh, and Graeme Mitchison. 1998. Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids. Cambridge University Press. https://doi.org/10.1017/CBO9780511790492.

Eddy, Sean R. 1998. “Profile Hidden Markov Models.” Bioinformatics 14 (9): 755–63. https://doi.org/10.1093/bioinformatics/14.9.755.

Fine, Shai, Yoram Singer, and Naftali Tishby. 1998. “The Hierarchical Hidden Markov Model: Analysis and Applications.” Machine Learning 32 (1): 41–62. https://doi.org/10.1023/A:1007469218079.

Forney, G. David. 1973. “The Viterbi Algorithm.” Proceedings of the IEEE 61 (3): 268–78. https://doi.org/10.1109/PROC.1973.9030.

Fox, Emily B., Erik B. Sudderth, Michael I. Jordan, and Alan S. Willsky. 2011. “A Sticky HDP-HMM with Application to Speaker Diarization.” The Annals of Applied Statistics 5 (2A): 1020–56. https://doi.org/10.1214/10-AOAS395.

Frühwirth-Schnatter, Sylvia. 1994. “Data Augmentation and Dynamic Linear Models.” Journal of Time Series Analysis 15 (2): 183–202. https://doi.org/10.1111/j.1467-9892.1994.tb00184.x.

Frühwirth-Schnatter, Sylvia. 2006. Finite Mixture and Markov Switching Models. Springer Series in Statistics. Springer. https://doi.org/10.1007/978-0-387-35768-3.

Frühwirth-Schnatter, Sylvia, Gilles Celeux, and Christian P. Robert, eds. 2019. Handbook of Mixture Analysis. Chapman; Hall/CRC. https://doi.org/10.1201/9780429055911.

Frühwirth-Schnatter, Sylvia, Gertraud Malsiner-Walli, and Bettina Grün. 2021. “Generalized Mixtures of Finite Mixtures and Telescoping Sampling.” Bayesian Analysis 16 (4): 1279–307. https://doi.org/10.1214/21-BA1294.

Gassiat, Elisabeth, Alice Cleynen, and Stéphane Robin. 2016. “Inference in Finite State Space Non Parametric Hidden Markov Models and Applications.” Statistics and Computing 26 (1): 61–71. https://doi.org/10.1007/s11222-014-9523-8.

Gelman, Andrew, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, and Donald B. Rubin. 2013. Bayesian Data Analysis. 3rd ed. Chapman; Hall/CRC. https://doi.org/10.1201/b16018.

Gelman, Andrew, and Jennifer Hill. 2007. Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press. https://doi.org/10.1017/CBO9780511790942.

Ghahramani, Zoubin, and Geoffrey E. Hinton. 2000. “Variational Learning for Switching State-Space Models.” Neural Computation 12 (4): 831–64. https://doi.org/10.1162/089976600300015619.

Ghahramani, Zoubin, and Michael I. Jordan. 1997. “Factorial Hidden Markov Models.” Machine Learning 29 (2): 245–73. https://doi.org/10.1023/A:1007425814087.

Green, Peter J. 1995. “Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination.” Biometrika 82 (4): 711–32. https://doi.org/10.1093/biomet/82.4.711.

Grün, Bettina, Gertraud Malsiner-Walli, and Sylvia Frühwirth-Schnatter. 2022. “How Many Data Clusters Are in the Galaxy Data Set? Bayesian Cluster Analysis in Action.” Advances in Data Analysis and Classification 16 (2): 325–49. https://doi.org/10.1007/s11634-021-00461-8.

Hamilton, James D. 1989. “A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle.” Econometrica 57 (2): 357–84. https://doi.org/10.2307/1912559.

Havre, Zoe van, Nicole White, Judith Rousseau, and Kerrie Mengersen. 2015. “Overfitting Bayesian Mixture Models with an Unknown Number of Components.” PLOS ONE 10 (7): e0131739. https://doi.org/10.1371/journal.pone.0131739.

Horn, Roger A., and Charles R. Johnson. 2013. Matrix Analysis. 2nd ed. Cambridge University Press. https://doi.org/10.1017/CBO9780511810817.

Hsu, Daniel, Sham M. Kakade, and Tong Zhang. 2012. “A Spectral Algorithm for Learning Hidden Markov Models.” Journal of Computer and System Sciences 78 (5): 1460–80. https://doi.org/10.1016/j.jcss.2011.12.025.

Jackson, Christopher H., Linda D. Sharples, Simon G. Thompson, Stephen W. Duffy, and Elisabeth Couto. 2003. “Multistate Markov Models for Disease Progression with Classification Error.” Journal of the Royal Statistical Society, Series D 52 (2): 193–209. https://doi.org/10.1111/1467-9884.00351.

Jasra, Ajay, Chris C. Holmes, and David A. Stephens. 2005. “Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling.” Statistical Science 20 (1): 50–67. https://doi.org/10.1214/088342305000000016.

Jurafsky, Daniel, and James H. Martin. 2025. Speech and Language Processing. 3rd (draft). https://web.stanford.edu/~jurafsky/slp3/.

Kaelbling, Leslie Pack, Michael L. Littman, and Anthony R. Cassandra. 1998. “Planning and Acting in Partially Observable Stochastic Domains.” Artificial Intelligence 101 (1–2): 99–134. https://doi.org/10.1016/S0004-3702(98)00023-X.

Kallenberg, Olav. 2021. Foundations of Modern Probability. 3rd ed. Springer. https://doi.org/10.1007/978-3-030-61871-1.

Kalman, Rudolph E. 1960. “A New Approach to Linear Filtering and Prediction Problems.” Journal of Basic Engineering 82 (1): 35–45. https://doi.org/10.1115/1.3662552.

Krogh, Anders, Michael Brown, I. Saira Mian, Kimmen Sjölander, and David Haussler. 1994. “Hidden Markov Models in Computational Biology: Applications to Protein Modeling.” Journal of Molecular Biology 235 (5): 1501–31. https://doi.org/10.1006/jmbi.1994.1104.

Kruskal, Joseph B. 1977. “Three-Way Arrays: Rank and Uniqueness of Trilinear Decompositions, with Application to Arithmetic Complexity and Statistics.” Linear Algebra and Its Applications 18 (2): 95–138. https://doi.org/10.1016/0024-3795(77)90069-6.

Langrock, Roland, Ruth King, Jason Matthiopoulos, Len Thomas, Daniel Fortin, and Juan M. Morales. 2012. “Flexible and Practical Modeling of Animal Telemetry Data: Hidden Markov Models and Extensions.” Ecology 93 (11): 2336–42. https://doi.org/10.1890/11-2241.1.

Leroux, Brian G. 1992. “Maximum-Likelihood Estimation for Hidden Markov Models.” Stochastic Processes and Their Applications 40 (1): 127–43. https://doi.org/10.1016/0304-4149(92)90141-C.

Levin, David A., and Yuval Peres. 2017. Markov Chains and Mixing Times. 2nd ed. American Mathematical Society. https://doi.org/10.1090/mbk/107.

Levinson, Stephen E., Lawrence R. Rabiner, and Man Mohan Sondhi. 1983. “An Introduction to the Application of the Theory of Probabilistic Functions of a Markov Process to Automatic Speech Recognition.” Bell System Technical Journal 62 (4): 1035–74. https://doi.org/10.1002/j.1538-7305.1983.tb03114.x.

Malsiner-Walli, Gertraud, Sylvia Frühwirth-Schnatter, and Bettina Grün. 2016. “Model-Based Clustering Based on Sparse Finite Gaussian Mixtures.” Statistics and Computing 26 (1): 303–24. https://doi.org/10.1007/s11222-014-9500-2.

Malsiner-Walli, Gertraud, Bettina Grün, and Sylvia Frühwirth-Schnatter. 2026. Telescope: Bayesian Mixtures with an Unknown Number of Components. https://CRAN.R-project.org/package=telescope.

Maruotti, Antonello. 2011. “Mixed Hidden Markov Models for Longitudinal Data: An Overview.” International Statistical Review 79 (3): 427–54. https://doi.org/10.1111/j.1751-5823.2011.00160.x.

Merhav, Neri, and Meir Feder. 1998. “Universal Prediction.” IEEE Transactions on Information Theory 44 (6): 2124–47. https://doi.org/10.1109/18.720534.

Meyn, Sean, and Richard L. Tweedie. 2009. Markov Chains and Stochastic Stability. 2nd ed. Cambridge University Press. https://doi.org/10.1017/CBO9780511626630.

Miller, Jeffrey W., and Matthew T. Harrison. 2018. “Mixture Models with a Prior on the Number of Components.” Journal of the American Statistical Association 113 (521): 340–56. https://doi.org/10.1080/01621459.2016.1255636.

Murphy, Kevin P. 2012. Machine Learning: A Probabilistic Perspective. MIT Press.

Murphy, Kevin P., and Mark A. Paskin. 2001. “Linear-Time Inference in Hierarchical HMMs.” Advances in Neural Information Processing Systems 14: 833–40.

Neal, Radford M., and Geoffrey E. Hinton. 1998. “A View of the EM Algorithm That Justifies Incremental, Sparse, and Other Variants.” In Learning in Graphical Models, edited by Michael I. Jordan. Springer. https://doi.org/10.1007/978-94-011-5014-9_12.

Nobile, Agostino. 2004. “On the Posterior Distribution of the Number of Components in a Finite Mixture.” The Annals of Statistics 32 (5): 2044–73. https://doi.org/10.1214/009053604000000788.

Nobile, Agostino, and Alastair T. Fearnside. 2007. “Bayesian Finite Mixtures with an Unknown Number of Components: The Allocation Sampler.” Statistics and Computing 17 (2): 147–62. https://doi.org/10.1007/s11222-006-9014-7.

Papaspiliopoulos, Omiros, Gareth O. Roberts, and Martin Sköld. 2007. “A General Framework for the Parametrization of Hierarchical Models.” Statistical Science 22 (1): 59–73. https://doi.org/10.1214/088342307000000014.

Petrie, Ted. 1969. “Probabilistic Functions of Finite State Markov Chains.” The Annals of Mathematical Statistics 40 (1): 97–115. https://doi.org/10.1214/aoms/1177697812.

Pohle, Jennifer, Roland Langrock, Floris M. van Beest, and Niels Martin Schmidt. 2017. “Selecting the Number of States in Hidden Markov Models: Pragmatic Solutions Illustrated Using Animal Movement.” Journal of Agricultural, Biological and Environmental Statistics 22 (3): 270–93. https://doi.org/10.1007/s13253-017-0283-8.

Rabiner, Lawrence R. 1989. “A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition.” Proceedings of the IEEE 77 (2): 257–86. https://doi.org/10.1109/5.18626.

Richardson, Sylvia, and Peter J. Green. 1997. “On Bayesian Analysis of Mixtures with an Unknown Number of Components.” Journal of the Royal Statistical Society, Series B 59 (4): 731–92. https://doi.org/10.1111/1467-9868.00095.

Robert, Christian P., and George Casella. 2004. Monte Carlo Statistical Methods. 2nd ed. Springer. https://doi.org/10.1007/978-1-4757-4145-2.

Robert, Christian P., Tobias Rydén, and D. Michael Titterington. 2000. “Bayesian Inference in Hidden Markov Models Through the Reversible Jump Markov Chain Monte Carlo Method.” Journal of the Royal Statistical Society, Series B 62 (1): 57–75. https://doi.org/10.1111/1467-9868.00219.

Rousseau, Judith, and Kerrie Mengersen. 2011. “Asymptotic Behaviour of the Posterior Distribution in Overfitted Mixture Models.” Journal of the Royal Statistical Society, Series B 73 (5): 689–710. https://doi.org/10.1111/j.1467-9868.2011.00781.x.

Rydén, Tobias. 2008. “EM Versus Markov Chain Monte Carlo for Estimation of Hidden Markov Models: A Computational Perspective.” Bayesian Analysis 3 (4): 659–88. https://doi.org/10.1214/08-BA326.

Schwarz, Gideon. 1978. “Estimating the Dimension of a Model.” The Annals of Statistics 6 (2): 461–64. https://doi.org/10.1214/aos/1176344136.

Scott, Steven L. 2002. “Bayesian Methods for Hidden Markov Models: Recursive Computing in the 21st Century.” Journal of the American Statistical Association 97 (457): 337–51. https://doi.org/10.1198/016214502753479464.

Seneta, Eugene. 2006. Non-Negative Matrices and Markov Chains. Revised. Springer. https://doi.org/10.1007/0-387-32792-4.

Stephens, Matthew. 2000. “Dealing with Label Switching in Mixture Models.” Journal of the Royal Statistical Society, Series B 62 (4): 795–809. https://doi.org/10.1111/1467-9868.00265.

Teh, Yee Whye, Michael I. Jordan, Matthew J. Beal, and David M. Blei. 2006. “Hierarchical Dirichlet Processes.” Journal of the American Statistical Association 101 (476): 1566–81. https://doi.org/10.1198/016214506000000302.

Vaart, Aad W. van der. 1998. Asymptotic Statistics. Cambridge University Press. https://doi.org/10.1017/CBO9780511802256.

Van Gael, Jurgen, Yunus Saatci, Yee Whye Teh, and Zoubin Ghahramani. 2008. “Beam Sampling for the Infinite Hidden Markov Model.” Proceedings of the 25th International Conference on Machine Learning, 1088–95. https://doi.org/10.1145/1390156.1390293.

Viterbi, Andrew J. 1967. “Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm.” IEEE Transactions on Information Theory 13 (2): 260–69. https://doi.org/10.1109/TIT.1967.1054010.

Wainwright, Martin J., and Michael I. Jordan. 2008. “Graphical Models, Exponential Families, and Variational Inference.” Foundations and Trends in Machine Learning 1 (1–2): 1–305. https://doi.org/10.1561/2200000001.

White, Halbert. 1982. “Maximum Likelihood Estimation of Misspecified Models.” Econometrica 50 (1): 1–25. https://doi.org/10.2307/1912526.

Williams, David. 1991. Probability with Martingales. Cambridge University Press. https://doi.org/10.1017/CBO9780511813658.

Wu, C. F. Jeff. 1983. “On the Convergence Properties of the EM Algorithm.” The Annals of Statistics 11 (1): 95–103. https://doi.org/10.1214/aos/1176346060.

Zucchini, Walter, Iain L. MacDonald, and Roland Langrock. 2016. Hidden Markov Models for Time Series: An Introduction Using R. 2nd ed. Chapman; Hall/CRC. https://doi.org/10.1201/b20790.