论文合集||多模态实体识别论文合集

发表时间:2023-05-30 13:32作者:沃恩智慧


近期,沃恩智慧小编梳理了一些多模态实体识别任务的论文合集,希望对各位在科研路上砥砺前行的小伙伴有所帮助。




2020年  
图片

[1] Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal Transformer

论文:

https://aclanthology.org/2020.acl-main.306/

代码:

https://github.com/jefferyYu/UMT


[2]

RIVA-A Pre-trained Tweet Multimodal Model Based on Text-image Relation for Multimodal NER

论文:

https://aclanthology.org/2020.coling-main.168/


[3] Multimodal Representation with Embedded Visual Guiding Objects for Named Entity Recognition in Social Media Posts

论文:

https://dl.acm.org/doi/10.1145/3394171.3413650

代码:

https://github.com/softhuafei/Pytorch-implementation-for-OCSGA



图片


2021年

图片

[1]

PromptMNER- Prompt-Based Entity-Related Visual Clue Extraction and Integration for Multimodal Named Entity Recognition

论文:

https://link.springer.com/chapter/10.1007/978-3-031-00129-1_24


[2] Multimodal Named Entity Recognition with Image Attributes and Image Knowledge

论文链接:

https://link.springer.com/chapter/10.1007/978-3-030-73197-7_12


[3]

Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance

论文:

https://ojs.aaai.org/index.php/AAAI/article/view/17687

代码:

https://github.com/MANLP-suda/UMGF


[4]

RpBERT- A Text-image Relation Propagation-based BERT Model for Multimodal NER

论文:

https://ojs.aaai.org/index.php/AAAI/article/view/17633

代码:

https://github.com/Multimodal-NER/RpBERT


[5]

Hierarchical self-adaptation network for multimodal named entity recognition in social media

论文:

https://linkinghub.elsevier.com/retrieve/pii/S0925231221000886


[6] Can images help recognize entities? A study of the role of images for Multimodal NER

论文:

https://aclanthology.org/2021.wnut-1.11/

代码:

https://github.com/RiTUAL-UH/multimodal_NER


[7]

Object-Aware Multimodal Named Entity Recognition in Social Media Posts With Adversarial Learning

论文:

https://ieeexplore.ieee.org/document/9154571/

代码:

https://github.com/thecharm/AGBAN



图片



2022年

图片

[1] Query Prior Matters- A MRC Framework for Multimodal Named Entity Recognition

论文链接:

https://dl.acm.org/doi/10.1145/3503161.3548427


[2] CWI- A multimodal deep learning approach for named entity recognition from social media using character, word and image features

论文:

https://link.springer.com/article/10.1007/s00521-021-06488-4


[3]

Learning from Different text-image Pairs- A Relation-enhanced Graph Convolutional Network for Multimodal NER

论文:

https://dl.acm.org/doi/10.1145/3503161.3548228

代码:

https://github.com/1429904852/R-GCN


[4]

A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition

论文:

https://aclanthology.org/2022.emnlp-main.422/

代码:

https://github.com/ZovanZhou/SMVAE


[5]

ITA- Image-Text Alignments for Multi-Modal Named Entity Recognition

论文:

https://aclanthology.org/2022.naacl-main.232/

代码链接:

https://github.com/Alibaba-NLP/KB-NER/tree/main/ITA


[6]

Flat Multi-modal Interaction Transformer for Named Entity Recognition

论文:

https://aclanthology.org/2022.coling-1.179


[7]

CAT-MNER-Multimodal Named Entity Recognition with Knowledge-Refined Cross-Modal Attention

论文:

https://ieeexplore.ieee.org/document/9859972/


[8] MAF- A General Matching and Alignment Framework for Multimodal Named Entity Recognition

论文:

https://dl.acm.org/doi/10.1145/3488560.3498475

代码:

https://github.com/xubodhu/MAF


[9]

UAMNer-uncertainty-aware multimodal named entity recognition in social media posts

论文:

https://link.springer.com/article/10.1007/s10489-021-02546-5


[10] Good Visual Guidance Makes A Better Extractor- Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction

论文:

https://arxiv.org/abs/2205.03521

代码:

https://github.com/zjunlp/HVPNeT


图片

2023年

图片

[1]

Reducing the Bias of Visual Objects in Multimodal Named Entity Recognition

论文:

https://dl.acm.org/doi/10.1145/3539597.3570485


[2] Multimodal Named Entity Recognition with Bottleneck Fusion and Contrastive Learning

论文:

https://www.jstage.jst.go.jp/article/transinf/E106.D/4/E106.D_2022EDP7116/_article


[3]

Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Tagging

论文:

https://arxiv.org/abs/2211.15028

代码:

https://github.com/YuanLi95/EEGA-for-JMERE



[4] A Novel Framework for Multimodal Named Entity Recognition with Multi-level Alignments

论文链接:

https://arxiv.org/abs/2305.08372


图片
在最后


分享到: