Information message extraction method and device based on big data
The invention discloses an information extraction method and device based on big data, and relates to the field of data analysis. Obtaining a target text by calculating the association degree between the text in the information database and a preset subject term; according to the method, emotion sco...
Saved in:
Main Authors | , , |
---|---|
Format | Patent |
Language | Chinese English |
Published |
14.05.2024
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | The invention discloses an information extraction method and device based on big data, and relates to the field of data analysis. Obtaining a target text by calculating the association degree between the text in the information database and a preset subject term; according to the method, emotion score calculation and data labeling are carried out on the target texts, the target texts are processed separately, the emotion tendency of the texts can be determined more accurately, high-quality labeled data are provided for agent model training, and the problems that manual labeling is long in time and high in cost are solved; and secondary labeling is carried out on the target text with unobvious sentiment polarity through the intelligent agent, so that the sentiment analysis accuracy is further improved.
本发明公开了一种基于大数据的资讯信息提取方法及装置,涉及数据分析领域;通过计算资讯数据库中的文本与预设主题词的关联度获得目标文本;通过对目标文本进行情感分数计算和数据标注,将目标文本分别处理,有助于更准确地确定文本的情感倾向,并为智能体模型训练提供了高质量的有标注数据,解决了人工标注时间长、成本高的问题;通过智能体对情感极性不明显的目标文本进行二次标注,进一步提高了情感分析的准确性。 |
---|---|
Bibliography: | Application Number: CN202410186792 |