我已经成功地使用的BertForSequenceClassification构建了一个情感分析工具,可以将$tsla推文分类为正面或负面。然而,我不知道如何从我的微调模型中获得每个tweet的特征向量(更具体地说,是嵌入[CLS])。有关所用型号的更多信息:
model = BertForSequenceClassification.from_pretrained(OUTPUT_DIR, num_labels=num_labels)
当我像这样从检查点加载时:我收到警告说权值被重新初始化:Some weights of the model checkpoint at tbs17/MathBERT were not used when initializing BertForSequenceClassificationmodel from a BertForSequen