一种适合弱标签数据集的图像语义标注方法

被引:3
作者
田枫 [1 ,2 ]
沈旭昆 [1 ]
机构
[1] 虚拟现实技术与系统国家重点实验室(北京航空航天大学)
[2] 东北石油大学计算机与信息技术学院
关键词
图像语义标注; 弱标签数据集; 测度学习; 非负稀疏编码; 语义近邻;
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
真实环境下数据集中广泛存在着标签噪声问题,数据集的弱标签性已严重阻碍了图像语义标注的实用化进程.针对弱标签数据集中的标签不准确、不完整和语义分布失衡现象,提出了一种适用于弱标签数据集的图像语义标注方法.首先,在视觉内容与标签语义的一致性约束、标签相关性约束和语义稀疏性约束下,通过直推式学习填充样本标签,构建样本的近似语义平衡邻域.鉴于邻域中存在噪声干扰,通过多标签语义嵌入的邻域最大边际学习获得距离测度和图像语义的一致性,使得近邻处于同一语义子空间.然后,以近邻为局部坐标基,通过邻域非负稀疏编码获得目标图像和近邻的部分相关性,并构建局部语义一致邻域.以邻域内的语义近邻为指导并结合语境相关信息,进行迭代式降噪与标签预测.实验结果表明了方法的有效性.
引用
收藏
页码:2405 / 2418
页数:14
相关论文
共 27 条
[1]  
To search or to label?:predicting the performance of search-based automatic image classifiers. Kennedy L S,Chang S,Kozintsev I V. Proceedings of the 8th ACM International Work-shop on Multimedia Information Retrieval . 2006
[2]  
Flickr Tag Recommendation based on Collective Knowledge. Borkur Sigurbj(o|¨)rnsson,Roelof van Zwol. International Conference on World Wide Web . 2008
[3]  
"Automatic imageannotation using group sparsity". S. Zhang,J. Huang,Y. Huang,Y. Yu,H. Li,D. N. Metaxas. Computer Vision and Pattern Recognition (CVPR) . 2010
[4]  
Assistive tagging[J] . Meng Wang,Bingbing Ni,Xian-Sheng Hua,Tat-Seng Chua. &nbspACM Computing Surveys (CSUR) . 2012 (4)
[5]  
A review on automatic image annotation techniques[J] . Dengsheng Zhang,Md. Monirul Islam,Guojun Lu. &nbspPattern Recognition . 2011 (1)
[6]   Knowledge Based Image Annotation Refinement [J].
Jin, Yohan ;
Khan, Latifur ;
Prabhakaran, B. .
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2010, 58 (03) :387-406
[7]  
Supervised Learning of Semantic Classes for Image Annotation and Retrieval. Gustavo Carneiro,,Antoni B Chan,Pedro J. Moreno,Nuno Vasconcelos. IEEE Transactions on Pattern Analysis and Machine Intelligence . 2007
[8]  
Image annotations by combining multiple evidence&Wordnet. Jin Y,Khan L,Wang L,Awad M. Proc.of the ACM Int’’l Conf.on Multimedia . 2005
[9]  
A new baseline for image annotation. Makadia A,Pavlovic V,Kumar S. Proc.of the European Conf.on Computer Vision . 2008
[10]  
Composite optimization:Second order conditions,value functions and sensityvity. Ioffe A. Analysis and Optimization of Systems . 1992