Ubiquitous home: Retrieval of experiences in a home environment

被引：7

作者：

De Silva, Gamhewage C. ^{[1
]}

Yamasaki, Toshihiko ^{[2
]}

Aizawa, Kiyoharu ^{[2
]}

机构：

[1] Univ Tokyo, Intelligent Modeling Lab, Tokyo 1138656, Japan

[2] Univ Tokyo, Dept Informat & Commun Engn, Tokyo 1138656, Japan

来源：

IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS | 2008年 / E91D卷 / 02期

关键词：

multimedia; personal experiences; life-log; video retrieval; ubiquitous environment; floor sensors;

D O I：

10.1093/ietisy/e91-d.2.330

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Automated capture and retrieval of experiences at home is interesting due to the wide variety and personal significance of such experiences. We present a system for retrieval and summarization of continuously captured multimedia data from Ubiquitous Home, a two-room house consisting of a large number of cameras and microphones. Data from pressure based sensors on the floor are analyzed to segment footsteps of different persons. Video and audio handover are implemented to retrieve continuous video streams corresponding to moving persons. An adaptive algorithm based on the rate of footsteps summarizes these video streams. A novel method for audio segmentation using multiple microphones is used for video retrieval based on sounds with high accuracy. An experiment, in which a family lived in this house for twelve days, was conducted. The system was evaluated by the residents who used the system for retrieving their own experiences; we report and discuss the results.

引用

页码：330 / 340

页数：11

共 15 条

[1]

ABOWD GD, 2002, P AM ASS ART INT AAI

[2]

AIZAWA K, 2004, ACM CARPE

[3]

Chin J., 1988, CHI 88 P SIGCHI C HU, DOI DOI 10.1145/57167.57203

[4]

Davis M, 2004, ACM MULTIMEDIA 2004, P188

[5]

de Silva G. C., 2005, 13th Annual ACM International Conference on Multimedia, P820, DOI 10.1145/1101149.1101329

[6]

DESILVA GC, 2005, ICME 2005

[7]

DESILVA GC, 2005, CIVR

[8]

JAIMES A, 2005, ACM MIR 2005

[9]

JAIMES A, 2004, CARPE 04, P74

[10]

Liu MC, 2001, 2001 INTERNATIONAL DATABASE ENGINEERING & APPLICATIONS SYMPOSIUM, PROCEEDINGS, P339, DOI 10.1109/IDEAS.2001.938102

← 1 2 →