A Brief Introduction to Graphical Models and Bayesian Networks
2012-03-02 20:36
375 查看
By Kevin Murphy, 1998.
"Graphical models are a marriage between probability theory and graph theory. They provide a natural tool for dealing with two problems that occur throughout applied mathematics and engineering -- uncertainty and complexity -- and in particular they
are playing an increasingly important role in the design and analysis of machine learning algorithms. Fundamental to the idea of a graphical model is the notion of modularity -- a complex system is built by combining simpler parts. Probability theory provides
the glue whereby the parts are combined, ensuring that the system as a whole is consistent, and providing ways to interface models to data. The graph theoretic side of graphical models provides both an intuitively appealing interface by which humans can model
highly-interacting sets of variables as well as a data structure that lends itself naturally to the design of efficient general-purpose algorithms.
Many of the classical multivariate probabalistic systems studied in fields such as statistics, systems engineering, information theory, pattern recognition and statistical mechanics are special cases of the general graphical model formalism -- examples
include mixture models, factor analysis, hidden Markov models, Kalman filters and Ising models. The graphical model framework provides a way to view all of these systems as instances of a common underlying formalism. This view has many advantages -- in particular,
specialized techniques that have been developed in one field can be transferred between research communities and exploited more widely. Moreover, the graphical model formalism provides a natural framework for the design of new systems." --- Michael Jordan,
1998.
详细内容请参考本帖原文:http://www.cs.ubc.ca/~murphyk/Bayes/bnintro.html
(有时间翻译一下)
"Graphical models are a marriage between probability theory and graph theory. They provide a natural tool for dealing with two problems that occur throughout applied mathematics and engineering -- uncertainty and complexity -- and in particular they
are playing an increasingly important role in the design and analysis of machine learning algorithms. Fundamental to the idea of a graphical model is the notion of modularity -- a complex system is built by combining simpler parts. Probability theory provides
the glue whereby the parts are combined, ensuring that the system as a whole is consistent, and providing ways to interface models to data. The graph theoretic side of graphical models provides both an intuitively appealing interface by which humans can model
highly-interacting sets of variables as well as a data structure that lends itself naturally to the design of efficient general-purpose algorithms.
Many of the classical multivariate probabalistic systems studied in fields such as statistics, systems engineering, information theory, pattern recognition and statistical mechanics are special cases of the general graphical model formalism -- examples
include mixture models, factor analysis, hidden Markov models, Kalman filters and Ising models. The graphical model framework provides a way to view all of these systems as instances of a common underlying formalism. This view has many advantages -- in particular,
specialized techniques that have been developed in one field can be transferred between research communities and exploited more widely. Moreover, the graphical model formalism provides a natural framework for the design of new systems." --- Michael Jordan,
1998.
详细内容请参考本帖原文:http://www.cs.ubc.ca/~murphyk/Bayes/bnintro.html
(有时间翻译一下)
相关文章推荐
- A brief introduction to Hashing and Rehashing
- [Machine Learning] Probabilistic Graphical Models:一、Introduction and Overview(1、Overview and Motivation)
- Introduction to Probabilistic Graphical Models
- Data Structures and algorithm analysis—1.3. A Brief Introduction to Recursion(数据结构—1.3 递归的简介)(之二)
- a brief introduction to Loaders and the LoaderManager
- Data Structures and algorithm analysis—1.3. A Brief Introduction to Recursion(数据结构—1.3 递归的简介)(之一)
- Brief introduction to Scala and Breeze for statistical computing
- A brief introduction to XenStore: Format and Interface
- Bayesian Inference and Naive Bayesian Classification: A Brief Introduction - 贝叶斯推断与朴素贝叶斯分类算法简述
- A brief introduction to C++ and Interfacing with Excel
- [Machine Learning] Probabilistic Graphical Models:一、Introduction and Overview(2、Factors)
- An Introduction to SELinux on CentOS 7 – Part 2: Files and Processes
- Introduction to Face Detection and Face Recognition:
- A Quick Introduction to Neural Networks
- introduction to vxl and Target
- An Introduction to Dynamic Management Views and Functions in SQL Server 2005
- Towards End-to-End Car License Plates Detection and Recognition with Deep Neural Networks
- End-to-End Learning of Deformable Mixture of Parts and Deep Convolutional Neural Networks for Human
- 【学习笔记】Introduction to Computer Science and Programming
- Introduction to DataSets and working with XML files