A very useful talk by Chih-Jen Lin, the author of LibSVM and LibLinear: Experiences and Lessons in Developing Machine Learning Software. Four main points:
- Data scaling
- Parameter tuning
- Easy to use software v.s. complicated software with marginal improvement
- Numerical stability
Interesting and important lessons!