高级检索

基于自注意力机制的多维跨度信息联合抽取实体与关系及在电力应急系统的应用

Self-Attention-Based Joint Extraction of Entities and Relations from Multi-Dimensional Span Information and Its Application in Power Emergency Systems

  • 摘要: 电力系统作为现代社会核心基础设施,其稳定性与可靠性直接关乎经济发展和社会运转,电力故障应急响应的高效性愈发关键。从海量电力应急文本中精准提取实体与关系并进行结构化组织,是提升应急决策效率的核心前提,也是当前研究的关键方向。现有方法在处理电力应急场景下的长实体、嵌套实体及长距离依赖关系时存在明显局限,易引发错误传播,导致语义理解不充分、抽取精度不足。为此,提出一种基于自注意力机制的多维跨度信息联合抽取实体与关系方法(MSAM),创新性设计多维关系嵌入层与实体宽度嵌入层,通过端到端联合模型同步完成实体识别与关系抽取,可高效捕捉文本长短期依赖,强化上下文理解并抑制错误传播。在 CoNLL04和SciERC 2个公开数据集上的实验表明,MSAM相较于现有先进模型性能显著提升,其中关系抽取任务Micro-F1值分别提高1.59%和1.47%;在自建的电力应急数据集(含3218条真实应急报告)上的测试进一步验证了其实际适用性,实体识别与关系抽取Micro-F1值分别达到 82.34%和74.46%,可为电力应急决策提供可靠的结构化信息支撑。

     

    Abstract: As a core infrastructure of modern society, the stability and reliability of power systems are directly related to economic development and social operation, making the efficiency of power failure emergency response increasingly critical. Accurately extracting entities and relations from massive power emergency texts and organizing them structurally is a core prerequisite for improving emergency decision-making efficiency and a key direction of current research. Existing methods have obvious limitations in handling long entities, nested entities, and long-distance dependencies in power emergency scenarios, which easily lead to error propagation, insufficient semantic comprehension, and low extraction accuracy. To address these issues, this paper proposes a multidimensional span-based attention mechanism (MSAM) for the joint extraction of entities and relations, innovatively designing a multi-dimensional relation embedding layer and an entity width embedding layer. The end-to-end joint model simultaneously performs named entity recognition and relation extraction, which can efficiently capture long and short-term dependencies in texts, enhance context understanding, and suppress error propagation. Experiments on two public datasets (CoNLL04 and SciERC) show that MSAM achieves significant performance improvements compared with state-of-the-art models, with Micro-F1 values of relation extraction task increased by 1.59% and 1.47% respectively. Tests on a self-constructed power emergency dataset (containing 3218 real emergency reports) further verify its practical applicability, with Micro-F1 values of entity recognition and relation extraction reaching 82.34% and 74.46% respectively, which can provide reliable structured information support for power emergency decision-making.

     

/

返回文章
返回