Differences between revisions 5 and 13 (spanning 8 versions)
⇤ ← Revision 5 as of 2018-05-24 13:52:34 →
Size: 2881
Editor: SeulKiYeom
Comment:
← Revision 13 as of 2018-08-20 13:41:28 → ⇥
Size: 2915
Editor: PhilippSeegerer
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
 || '''Lecture time:''' || 8:45 - 12:00, 13:30 - 17:00 (approx.) ||
Line 6: Line 7:
 || '''Room:''' || MAR 4.063, Marchstr. 23 ||
Line 8: Line 10:
 ||'''Application deadline'''|| June 15th, 2018 ||
Line 27: Line 31:
 * Density estimation: kernel density estimation, Parzen windows, parametric density/MaxLikelihood  * Density estimation: kernel density estimation, Parzen windows, parametric density
Line 34: Line 38:
 * Embeddings (RBF?)?  * Embeddings (RBF)
Line 36: Line 40:
 * tSNE?  * tSNE
Line 44: Line 48:
 * Bayesian/Akaike information criterion, Occam's razor?  * Bayesian/Akaike information criterion, Occam's razor
Line 51: Line 55:
 * Gradient descent? Where should it go? NNs?  * Gradient descent
Line 56: Line 60:
 * Linear separability, margins  * Linear separability, maximum margin and soft margin
Line 59: Line 63:
 * Multi-class SVM?  * Multi-class SVM
Line 65: Line 69:
 * Cross references to previous methods: ridge regression, PCA, SVM
Line 71: Line 74:
 * Motivation with Logistic regression  * Motivation with logistic regression
Line 74: Line 77:
 * Famous Conv nets (imagenet winners): AlexNet, GoogleNet, ResNet
 * Recurrent NNs?		  * Famous Conv net architectures: AlexNet, GoogleNet, ResNet etc.
 * Recurrent NNs
Line 77: Line 80:
 * Practical recommendations for Training of DNNs (following e.g. Bengio's 2012 paper), hyperparameters

8. Recap		  * Practical recommendations for Training of DNNs, hyperparameter tuning

Beginners Workshop Machine Learning

Enrollment / Limited number of participants

If you intend to participate, please send an e-mail to lassner@tu-berlin.de with title "Beginners Workshop Enrollment" and this text: 

Name: Your name
Matr.Nr: Your student ID (Matrikelnummer)
Degree: The degree you are enrolled in and want to use this course for.
TU student: Yes/No (Are you a enrolled as a regular student at TU Berlin?)
Other student: If you are not a regular student, please write your status.
ML1: Yes/No (Did you take the course Machine Learning 1 at TU Berlin?)
Other ML course: If you did not take ML1 at TU Berlin, please write if you took any equivalent course.

Participation spots are mostly assigned on a random basis. Please keep in mind that auditing students and Nebenhörer can only participate if less than the maximum number of regular TU students register for the course (http://www.studsek.tu-berlin.de/menue/studierendenverwaltung/gast_und_nebenhoererschaft/parameter/en/).

(temporary) Workshop Lecture topics are:

1. Clustering, mixtures, density estimation

  • Density estimation: kernel density estimation, Parzen windows, parametric density
  • K means clustering
  • Gaussian mixture models, EM algorithm
  • Curse of dimensionality

2. Manifold learning

  • LLE
  • Embeddings (RBF)
  • Multidimensional scaling
  • tSNE

3. Bayesian Methods

  • What is learning?
  • Frequentist vs Bayes
  • Bayes rule
  • Naive Bayes
  • Bayesian linear regression
  • Bayesian/Akaike information criterion, Occam's razor

4. Classical and linear methods

  • Matrix factorization
  • Logistic regression
  • Regularization, Lasso, Ridge regression
  • Fisher's Linear discriminant
  • Gradient descent
  • Decision boundaries

5. Support Vector Machine

  • Linear SVM
  • Linear separability, maximum margin and soft margin
  • Duality in optimization, KKT conditions
  • SVM for regression
  • Multi-class SVM
  • Applications

6. Kernels

  • Feature transformations
  • Kernel trick
  • Nadaraya-Watson kernel regression

7. Neural Networks

  • Rosenblatt's Perceptron
  • Multi layer perceptron
  • Motivation with logistic regression
  • Backpropagation, (Stochastic) (Minibatch) gradient descent
  • Convolutional NNs

  • Famous Conv net architectures: AlexNet, GoogleNet, ResNet etc.

  • Recurrent NNs
  • Applications
  • Practical recommendations for Training of DNNs, hyperparameter tuning

IDA Wiki: Main/SS18_BeginnersWorkshop (last edited 2018-08-20 13:41:28 by PhilippSeegerer)