The rapid development of the internet and multimedia technology in recent years has continued to push foreign language education in the direction of modern education. Multimodal education is becoming more and more important in the field of English education as an advanced educational concept in the field of language education. As a result, many English teachers have begun to emphasize the use of multimodal teaching theory in their classrooms. This paper investigates a multimodal model that incorporates text and image features, based on multimodal discourse theory, systemic functional linguistics theory, and foreign language teaching theory. This paper develops a multimodal model that can search for images and texts from various perspectives. We use an image feature bias term in the log-bilinear natural language model to influence the probability of predicting the next word based on the context, resulting in a multimodal model. The experimental results show that the proposed model, as an image-text relationship evaluation index system, has a slower search speed than other models but better search accuracy.
机构:
Jilin Univ Finance & Econ, Foreign Language Teaching & Res Inst, Jilin, Jilin, Peoples R ChinaJilin Univ Finance & Econ, Foreign Language Teaching & Res Inst, Jilin, Jilin, Peoples R China
Hu, Lin
Yao, Wei
论文数: 0引用数: 0
h-index: 0
机构:
Wuhan Univ Technol, Foreign Language Sch, Wuhan 430070, Hubei, Peoples R ChinaJilin Univ Finance & Econ, Foreign Language Teaching & Res Inst, Jilin, Jilin, Peoples R China
机构:
Harbin Normal Univ, Sch Western Languages & Cultures, Harbin 150025, Peoples R ChinaHarbin Normal Univ, Sch Western Languages & Cultures, Harbin 150025, Peoples R China
机构:
Taiyuan Univ, Foreign Language Dept, Taiyuan 030012, Shanxi, Peoples R ChinaTaiyuan Univ, Foreign Language Dept, Taiyuan 030012, Shanxi, Peoples R China
机构:
Shangqiu Normal Univ, Sch Foreign Languages, Shangqiu 476000, Henan, Peoples R ChinaShangqiu Normal Univ, Sch Foreign Languages, Shangqiu 476000, Henan, Peoples R China
Huang, Qichao
WIRELESS COMMUNICATIONS & MOBILE COMPUTING,
2022,
2022