For those who want a more solid take on machine learning, and who still remember their math and probability/statistics, (i.e. advanced undergrad or new grad student), the best texts seem to be:
The Elements of Statistical Learning by Hastie, Tibshirani and Friedman, available for free on line.
Pattern Recognition and Machine Learning by Chris Bishop. Very Bayesian.
Machine Learning: A Probabilistic Perspective by Kevin Murphy. Also Bayesian, although not as Bayesian as Bishop. The most recent of the three, and therefore covers a few topics not covered elsewhere like deep learning and conditional random fields. The first few printings are full of errors and confusing passages, should be better before too long.
It differs from other books in that all the material is treated from the unified perspective of statistical learning theory and VC dimension, as a result the book feels less like a hodgepodge of unrelated techniques and more like an introduction to a coherent field.
Hastie and Tibshirani also have a new, less demanding mathematically book out:
Both require a willingness to immerse in the mathematics. But the maths isn't hard, even for someone like me who hasn't formally studied it since I was 15.
The Elements of Statistical Learning by Hastie, Tibshirani and Friedman, available for free on line.
Pattern Recognition and Machine Learning by Chris Bishop. Very Bayesian.
Machine Learning: A Probabilistic Perspective by Kevin Murphy. Also Bayesian, although not as Bayesian as Bishop. The most recent of the three, and therefore covers a few topics not covered elsewhere like deep learning and conditional random fields. The first few printings are full of errors and confusing passages, should be better before too long.
Did I miss any?