Exploiting the Architecture of Dynamic Systems

By Xavier Boyen and Daphne Koller.

In National Conference on Artificial Intelligence (AAAI 1999), Orlando, Florida, July 1999, pages 313-320. AAAI Press, 1999.


Consider the problem of monitoring the state of a complex dynamic system, and predicting its future evolution. Exact algorithms for this task typically maintain a belief state (the distribution over the states at some point in time). Unfortunately, these algorithms fail when applied to complex processes such as those represented as dynamic Bayesian networks (DBNs), as the representation of the belief state grows exponentially with the size of the process. Boyen and Koller recently proposed an efficient approximate tracking algorithm that maintains an approximate belief state that has a compact representation as a set of independent factors. Their analysis relies on a bound on the error introduced by approximating a belief state of this process by a factored one. They argue informally that their algorithm is justified in cases where the interaction between variables in the processes is ``weak''. In this paper, we give formal information-theoretic definitions for notions such as weak interaction and sparse interaction of processes. We use these notions to analyze the conditions under which the error induced by this type of approximation is small. We demonstrate several cases where our results formally support intuitions about strength of interaction.


- published paper (PS)
- expanded version (PS)
- presentation slides (HTML)


  author = {Xavier Boyen and Daphne Koller},
  title = {Exploiting the Architecture of Dynamic Systems},
  booktitle = {Proceedings of the 16th National Conference on Artificial Intelligence---AAAI 1999},
  pages = {313--320},
  publisher = {Menlo Park: AAAI Press},
  year = {1999},
  note = {Available at \url{http://www.cs.stanford.edu/~xb/aaai99/}}

Unless indicated otherwise, these documents are Copyright © Xavier Boyen; all rights reserved in all countries.
Back to Xavier's homepage