视觉特征-自监督-对比学习:CLIP

视觉特征-自监督-对比学习:CLIP
训练范式经典论文 / 模型 1经典论文 / 模型 2核心特点
监督学习(Supervised Learning)AlexNetImageNet Classification with Deep Convolutional Neural Networks, NeurIPS 2012ResNetDeep Residual Learning for Image Recognition, CVPR 2016使用人工类别标签进行训练
自监督学习(Self-Supervised Learning)MoCoMomentum Contrast for Unsupervised Visual Representation Learning, CVPR 2020DINOEmerging Properties in Self-Supervised Vision Transformers, ICCV 2021不使用人工语义标签,从图像自身构造监督信号
弱监督学习(Weakly Supervised Learning)WSL / ResNeXt-WSLExploring the Limits of Weakly Supervised Pretraining, ECCV 2018