Bigdata and Deep Learning Lecture points(1)

Li Deng from Microsoft Research,gaven the lecture at Peking University at July 11-12,2015.

Link:普适计算与大数据

Basics

What is Deep Learning

https://en.wikipedia.org/wiki/Deep_learning

Deep learninlg is a branch of Machine Learning based on a set of** algorithms** that attempt to model high-level abstractions in data by using model architectures,wich complex structures or otherwise,composed of multiple non-linear transformations.

Review of Deep Learning Basics

Deep Learning(aka Deep Structured Learning,Hierarchical Learning)

Deep belief nets(DBN)

Boltzman machine(BM)

Restricted Boltzman machine(RBM)

Deep neural nets(DNN)

Deep auto-coder

Distributed representation

Distributed Representation

A representation of the observed data in such a way that they are modeled as being generated by the interactions of many hidden factors. A particular factor learned from configurations of other factors can often generalize well. Distributed representations form the basis of deep learning.

More on “Deep Learning”

Four Definition

Definition1:

A class of machine learning techniques that exploit many layers of non-linear information processing for supervised or unsupervised feature extraction and transformation,and for pattern analysis and classification.

Definition2:

A sub-field within machine learning that is based on algorithms for learning multiple levels o representation in order to model complex relation ships among data.

Definition3:

A sub-field of machine learning that is based on learning several levels of representations,corresponding to a hierarchy of features or factors or concepts,where higher-level concepts are defined from lower-level ones,and the same lower-level concepts can help to define many higher-level concepts.

See http://en.wikipedia.org/wiki/Deep_learning.

Definition4:

Deep Learning is about learning multiple levels of representation and abstraction that help to make sense of data such as images,sound,and text.

See https://github.com/lisa-lab/DeepLearningTutorials

Highlight of Deep Learning in the Era of Big Data

Deep Learing vs.Machince Learning

Recipe for(Supervised) Machine Learning with Big Data

Impact of Deep learning in Speech technology