PaperReading20200330

Curriculum Learning

• Motivation: Humans learn easy things first and then begin to learn hard knowledge. This is like the curriculum, first basic ones and then hard ones.
• Method: At an abstract level, a curriculum can also be seen
  as a sequence of training criteria. Each training criterion in the sequence is associated with a different set of weights on training examples. The author just did lots of experiments on shape classification and language modeling.
• Contribution: Curriculum learning can be seen as a very useful trick in deep learning training.