Please use this identifier to cite or link to this item:
Title: Multimodal bridge for conversational agents
Authors: Abdel Massih, Hanna
Advisors: Karam, Walid 
Keywords: Chatbot, Conversational Agents, Multimodality, Multimodal Feedback, Context Aware, Smart Environment, Rule Engine, Fissions
Subjects: Multimodality
Human Machine Interactions (HMI)
Human-machine systems--Design
University of Balamand--Dissertations
Dissertations, Academic
Issue Date: 2022
Smart environments are heavily utilized by users to fulfill their daily activities. The interaction between humans and machines witnessed an increase in modalities and providing an efficient user interaction relies on achieving multimodality. This thesis proposes a design mixing multimodality and smart environments in a contextaware system, intending to enhance the user experience by selecting the most efficient response mode, specifically in applications requiring interaction with conversational agents. The suggested solution is based on a fission engine, driven by gathered context and data, resulting in the generation of multimodal feedback. A preliminary prototype was implemented and tested to create a rule based model in charge of selecting between visual and auditory modalities. A second study was done to compare the rule based model with the hybrid one.
Includes bibliographical references (p. 45-48)
Rights: This object is protected by copyright, and is made available here for research and educational purposes. Permission to reuse, publish, or reproduce the object beyond the personal and educational use exceptions must be obtained from the copyright holder
Ezproxy URL: Link to full text
Type: Thesis
Appears in Collections:UOB Theses and Projects

Show full item record

Record view(s)

checked on Feb 2, 2023

Google ScholarTM


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.