基于轻量级预训练模型的微博情感分析算法研究

    Lightweight pre-training model-based Weibo sentiment analysis algorithm research

    • 摘要: 针对微博中文本内容特征复杂难以提取的问题,本文提出了一种基于轻量级预训练模型的文本情感分析算法模型。首先,模型引入神经网络正则化失活算法改进损失函数,通过增加正则化实现有监督的数据增强。其次,在算法层面,融入卷积以及时序注意力双通道网络结构,提升算法对长文本特征的提取效率。最后,为了解决多层模型带来的特征丢失问题,引入残差网络来提高模型的鲁棒性。在酒店评论公共数据集以及微博评论数据集上进行实验,结果表明,相较于基线模型,本文提出的模型在两个数据集准确率分别提高了1.33和1.41个百分点,实验验证了该算法有效提高了轻量级文本情感分析模型的特征捕捉能力和情感分析的准确性。

       

      Abstract: The challenge of extracting complex textual features from Weibo posts has been tackled through the proposal of a text-sentiment analysis algorithm built on a lightweight pre-trained model. First, the loss function was refined by introducing a neural-network dropout regularization algorithm, through which supervised data augmentation was achieved. Second, at the algorithmic level, a dual-channel network combining convolution and temporal attention was incorporated, so that the efficiency of long-text feature extraction was enhanced. Finally, to mitigate the feature loss introduced by deep architectures, residual connections were employed to improve robustness. Experiments were carried out on a public hotel-review dataset and a Weibo-comment dataset. The results indicated that, relative to the baseline model, classification accuracy was increased by 1.33 and 1.41 percentage points on the two datasets, respectively, thereby demonstrating that the proposed algorithm effectively strengthens the feature-capturing capability and sentiment-analysis accuracy of lightweight models.

       

    /

    返回文章
    返回