Bayesian Information Extraction Network
Leonid Peshkin, Avi Pfeffer
Abstract
Dynamic Bayesian networks (DBNs) offer an elegant way to integrate various aspects of language in one model. Many existing algorithms developed for learning and inference in DBNs are applicable to probabilistic language modeling. To demonstrate the potential of DBNs for natural language processing, we employ a DBN in an information extraction task. We show how to assemble wealth of emerging linguistic instruments for shallow parsing, syntactic and semantic tagging, morphological decomposition, named entity recognition etc. in order to incrementally build a robust information extraction system. Our method outperforms previously published results on an established benchmark domain.
Create a lesson
Related papers
ToolSpace: Scaling Tool-Centric Environment Synthesis for Long-Horizon Agents
Guanting Dong, Zhichao Sun, Xinyu Yang et al.
Whose Effect Is It? How Objectives Inflate Learned Subspace Interventions
Toygar Tanyel, Serkan Ayvaz
Who is the Pronoun Pro? Comparing LLMs and Humans at Number-Disambiguation of 'they'
Carlos Hartmann
Shuffled OPSD: When Semantic Consistency Hurts On-Policy Self-Distillation?
Qingyuan Zheng, Zhihao Dou
HERIT: Enabling Global Access to Hanja-to-English Historical Translation by Mitigating Temporal Bias
Dayeon Jeong, Kyeongpil Kang
Residual Attribute Leakage Is an Interface: Auditing Privacy Evaluation After Text De-identification
Tuan Thanh Duong, Joongmin Shin, Jeongho Yoon et al.