Artificial intelligence snapchat: Visual conversation agent

Artificial intelligence snapchat: Visual conversation agent

Sasa Arsovski, Adrian David Cheok, Kirthana Govindarajoo, Nurizzaty Salehuddin, Somaiyeh Vedadi

Publication Date:
2020/7
Journal:
Applied Intelligence
Volume:
50
Issue:
7
Pages:
2040-2049
Publisher:
Springer US
Description:
 

Visual conversation is a dialog in which parties exchange visual information. The key novelty presented in this paper is an artificial intelligence-driven visual conversation automation method. We will present a state of the art Artificial Intelligence Snapchat Visual Conversation Agent (AISVCA). AISVCA uses our proposed artificial intelligence-driven visual conversation automation method to create received image caption and generate an appropriate reasonable visual response. These functionalities are achieved by using a combination of Convolutional Neural Network (CNN), Long Short-Term Memory Neural Network (LSTM) and, Latent Semantic Indexing method (LSI). CNN and LSTM are used to create image captions and, LSI is used to assess the semantic similarity between captions generated from personalized image dataset, and captions that are extracted from the received image content. We will show that …