Improving information retrieval through correspondence analysis instead of latent semantic analysis

被引:0
|
作者
Qi, Qianqian [1 ]
Hessen, David J. [1 ]
van der Heijden, Peter G. M. [1 ,2 ]
机构
[1] Univ Utrecht, Fac Social Sci, Dept Methodol & Stat, Utrecht, Netherlands
[2] Univ Southampton, Southampton Stat Sci Res Inst, Southampton, England
关键词
Singular value decomposition; Singular value weighting exponent; Initial dimensions; Information retrieval;
D O I
10.1007/s10844-023-00815-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The initial dimensions extracted by latent semantic analysis (LSA) of a document-term matrix have been shown to mainly display marginal effects, which are irrelevant for information retrieval. To improve the performance of LSA, usually the elements of the raw document-term matrix are weighted and the weighting exponent of singular values can be adjusted. An alternative information retrieval technique that ignores the marginal effects is correspondence analysis (CA). In this paper, the information retrieval performance of LSA and CA is empirically compared. Moreover, it is explored whether the two weightings also improve the performance of CA. The results for four empirical datasets show that CA always performs better than LSA. Weighting the elements of the raw data matrix can improve CA; however, it is data dependent and the improvement is small. Adjusting the singular value weighting exponent often improves the performance of CA; however, the extent of the improvement depends on the dataset and the number of dimensions.
引用
收藏
页码:209 / 230
页数:22
相关论文
共 50 条