# Curriculum learning imitates human learning order from easier classes to harder classes

Last updated on：4 months ago

Curriculum learning (CL) is a training strategy that trains a machine learning model from easier data to harder data (with a curriculum), which imitates the meaningful learning order in human curricula.

# Introduction

- Original curriculum learning. A curriculum is a sequence of training criteria over T training steps. Each criterion $Q_t$ is a reweighting of the target training distribution $P(z)$.
**Conditions satisfied:**

- The entropy of distributions gradually increases
- The weight for any example increases

Data-level generalized curriculum learning. Discarding all three conditions in definition 1, a curriculum is a sequence of reweighting of target training distribution over T training steps.

Generalized curriculum learning. A curriculum is a sequence of training criteria over T training steps. Each criterion $Q_t$ includes the design for all the elements in training a machine learning model.

# Reference

[1] Wang, X., Chen, Y. and Zhu, W., 2021. A survey on curriculum learning. *IEEE Transactions on Pattern Analysis and Machine Intelligence*.

本博客所有文章除特别声明外，均采用 CC BY-SA 4.0 协议 ，转载请注明出处！