A method of lexical domain analysis based on usage discrepancy

Abstract

领域知识的表达形式最终体现在词汇的 领域性上,因此对领域词及其部件的领域度分析是一个关键。该文在分词的基础上,对各个领域语料进行分析,利用词语之间的关系,引入链接分析方法分析词语在 各个领域中的使用重要性,并通过词语在各个领域中的使用差异性计算其领域度,从而达到领域分析的目的,获取某个领域的领域部件词。该文采用以上方法在军 事、娱乐等领域进行了实验,实验结果表明该方法相对于当前常用的tf×idf方法和Bootstrapping方法,可以更有效地进行领域分析获取领域部 件词。 The representation of domain knowledge usually focuses on the domain lexicons,and then domain analysis for terms or term components is a natural task.In this paper,we propose a novel domain analysis method based on the discrepancy of lexical usage.Based on the word segmentation result,we introduce a link analysis method to compute the usage degree of each word for several typical domain corpora.Then through analyzing the discrepancy of the word usage in different domains,we can acquire the domain term component with larger usage discrepancy.This method is experimented on several domains such as military,entertainment and so on,achieving better results than the commonly used tf×idf method and Bootstapping method.