Advice for students of machine learning
2016-05-20 13:11
393 查看
点击打开链接
One of my students recently asked me for advice on learning ML. Here’s what I wrote. It’s biased toward my own experience, but should generalize.
My current favorite introduction is Kevin Murphy’s book (Machine Learning). You might also want to look at books by Chris Bishop (Pattern Recognition), Daphne Koller (Probabilistic Graphical Models), and David MacKay (Information Theory, Inference and Learning Algorithms).
Anything you can learn about linear algebra and probability/statistics will be useful. Strang’s Introduction to Linear Algebra, Gelman, Carlin, Stern and Rubin’s Bayesian Data Analysis, and Gelman and Hill’s Data Analysis using Regression and Multilevel/Hierarchical
models are some of my favorite books.
Don’t expect to get anything the first time. Read descriptions of the same thing from several different sources.
There’s nothing like trying something yourself. Pick a model and implement it. Work through open source implementations and compare. Are there computational or mathematical tricks that make things work?
Read a lot of papers. When I was a grad student, I had a 20 minute bus ride in the morning and the evening. I always tried to have an interesting paper in my bag. The bus isn’t the important part — what was useful was having about half an hour every day devoted
to reading.
Pick a paper you like and “live inside it” for a week. Think about it all the time. Memorize the form of each equation. Take long walks and try to figure out how each variable affects the output, and how different variables interact. Think about how you get
from Eq. 6 to Eq. 7 — authors often gloss over algebraic details. Fill them in.
Be patient and persistent. Remember von Neumann: “in mathematics you don’t understand things, you just get used to them.”
One of my students recently asked me for advice on learning ML. Here’s what I wrote. It’s biased toward my own experience, but should generalize.
My current favorite introduction is Kevin Murphy’s book (Machine Learning). You might also want to look at books by Chris Bishop (Pattern Recognition), Daphne Koller (Probabilistic Graphical Models), and David MacKay (Information Theory, Inference and Learning Algorithms).
Anything you can learn about linear algebra and probability/statistics will be useful. Strang’s Introduction to Linear Algebra, Gelman, Carlin, Stern and Rubin’s Bayesian Data Analysis, and Gelman and Hill’s Data Analysis using Regression and Multilevel/Hierarchical
models are some of my favorite books.
Don’t expect to get anything the first time. Read descriptions of the same thing from several different sources.
There’s nothing like trying something yourself. Pick a model and implement it. Work through open source implementations and compare. Are there computational or mathematical tricks that make things work?
Read a lot of papers. When I was a grad student, I had a 20 minute bus ride in the morning and the evening. I always tried to have an interesting paper in my bag. The bus isn’t the important part — what was useful was having about half an hour every day devoted
to reading.
Pick a paper you like and “live inside it” for a week. Think about it all the time. Memorize the form of each equation. Take long walks and try to figure out how each variable affects the output, and how different variables interact. Think about how you get
from Eq. 6 to Eq. 7 — authors often gloss over algebraic details. Fill them in.
Be patient and persistent. Remember von Neumann: “in mathematics you don’t understand things, you just get used to them.”
相关文章推荐
- jquery管理ajax异步-deferred对象
- JAXB - Annotations, The Object Factory: XmlRegistry, XmlElementDecl
- linux 读取文件信息并且输出
- 《构建之法》阅读笔记08-软件设计与实现
- MySQL数据类型
- 如何获取闭包中循环的i值
- 项目 Web 的 NuGet 程序包还原失败: 找不到“1.0.0”版本的程序包“Microsoft.Net.Compilers”。。 0
- struts2中的几个技术
- 《招一个靠谱的移动开发》iOS面试题及详解(上篇)
- 工作总结与感悟
- 《招一个靠谱的移动开发》iOS面试题及详解(上篇)
- C++生成n个指定1到 n 不同的随机数
- STM32F4时钟设置分析
- ⻦哥的LINUX私房菜 学习
- 【Linux】 find指令(文件查找)
- caffe层解读系列-softmax_loss
- spring boot集成data-jpa
- 【转载】最动听的发烧好歌辑《爱上草原爱上你》30首
- USB总线驱动程序
- 使用新的 apt 命令在 Ubuntu 16.04 LTS 下管理软件包