#

multimodal-interactions

Here are 24 public repositories matching this topic...

geut / plusultra_whitepaper

Technical Draft: A platform to augment web applications with multimodal interactions

research-project multimodal-interactions geut-labs

Updated Aug 13, 2015
TeX

jcornaz / hesso.mpri.hmm

Travail de groupe pour le cours MPRI de la HES-SO

master schoolwork multimodal-interactions hes-so

Updated Apr 5, 2018
MATLAB

jcornaz / hesso.mpri.kemboko

Challenge of gesture recognition for the course : "Multimodal Processing Recognition and Interaction" of the HES-SO university (Switzerland)

challenge machine-learning master school-project multimodal-interactions hes-so

Updated Apr 5, 2018
MATLAB

xuxingya / talkingdraw

Using voice and pen to draw diagrams quickly with automatically suggested icons and texts by AI in talking.

artificial-intelligence speech-recognition user-interface sequence-to-sequence gesture-recognition multimodal-interactions

Updated May 23, 2018
JavaScript

tiagohpf / im-2018-assign4

Control of some Spotify's functionalities with gestures and speech

spotify-api speech-recognition academic-project kinect-v2 multimodal-interactions

Updated Jun 14, 2018
C#

tiagohpf / im-2018-assign2

Control of some Spotify's functionalities by voice

spotify-api speech-recognition academic-project multimodal-interactions

Updated Jul 6, 2018
C#

tiagohpf / im-2018-assign3

Control of some Spotify's functionalities with gestures

spotify-api academic-project kinect-v2 multimodal-interactions

Updated Jul 6, 2018
C#

Techievena / Numbers_Trivia

A multimodal skill built with Amazon Alexa Skills Kit that educates children on the importance of numbers and dates.

alexa amazon-web-services multimodal-interactions numbersapi

Updated Dec 30, 2018
Python

erunseelie / MMIyo

Repository to contain MMI development during UTA CSE REU 2019. Makes use of Open-Myo, a module to get data from a Myo armband using a generic BLE interface.

research bluetooth-low-energy emg myo-armband multimodal-interactions

Updated Jul 30, 2019
Python

emanuelegiona / MI2020

Project for Multimodal Interaction course (A.Y. 2019/2020), GesturePad

python text-editor voicetext google-cloud-speech multimodal-interactions sapienza-university gesture-control mediapipe

Updated Jul 2, 2020
Python

PrithivirajDamodaran / vision-language-modelling-series

Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations

multimodal-interactions vision-and-language multimodal-deep-learning multimodal-representation vision-and-language-navigation vision-and-language-pre-training

Updated Aug 16, 2022
Jupyter Notebook

umdsquare / data-at-hand-mobile

Mobile application for exploring fitness data using both speech and touch interaction.

visualization navigation fitbit speech mobile-app fitness-tracker multimodal-interactions smartphones visual-data

Updated Dec 10, 2022
TypeScript

declare-lab / hfusion

Multimodal sentiment analysis using hierarchical fusion with context modeling

sentiment-analysis fusion emotion-analysis emotion-detection emotion-recognition data-fusion multimodal-interactions multimodal-sentiment-analysis multimodal-fusion

Updated Mar 14, 2023
Python

declare-lab / contextual-utterance-level-multimodal-sentiment-analysis

Context-Dependent Sentiment Analysis in User-Generated Videos

sentiment-analysis keras lstm lstm-neural-networks multimodal-interactions multimodal-sentiment-analysis

Updated Mar 14, 2023
Python

declare-lab / multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

multimodal-interactions multimodal-learning multimodal-sentiment-analysis multimodal-deep-learning

Updated Mar 15, 2023
OpenEdge ABL

ML-PersRef

amrgomaaelhady / ML-PersRef

Code for ICMI2020 and ICMI2021 papers: "Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle" and "ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle"

automotive gesture-recognition multimodal-interactions multimodal-learning

Updated Jun 2, 2023
Jupyter Notebook

zshafique25 / QUIZLY-APP

Developed a multimodal interactive quiz app allowing users to select answers via hand gestures. Created a user-friendly UI/UX in Figma and built the front end with React Native, using MongoDB for data management. Implemented a backend with Express and Node.js, and trained CNN models in Python for gesture recognition, enhancing user engagement.

nodejs python machine-learning react-native mongodb expressjs figma multimodal-interactions cnn-classification handgesture-recognition

Updated Aug 24, 2023
JavaScript

declare-lab / awesome-emotion-recognition-in-conversations

A comprehensive reading list for Emotion Recognition in Conversations

natural-language-processing dialogue-systems emotion-recognition conversational-ai multimodal-interactions multimodal-deep-learning emotion-recognition-in-conversation

Updated Feb 6, 2024

declare-lab / MELD

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

sentiment-analysis chatbot dialogue emotion dialogue-systems emotion-detection personality-profiling emotion-recognition personality-traits conversational-ai multimodal-interactions multimodal-sentiment-analysis multimodal-emotion-recognition emotion-recognition-in-conversation

Updated Mar 10, 2024
Python

thuiar / UMC

Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances (ACL 2024)

clustering discovery intent multimodal-interactions multimodal-deep-learning acl2024

Updated Jun 21, 2024
Python

Improve this page

Add a description, image, and links to the multimodal-interactions topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multimodal-interactions topic, visit your repo's landing page and select "manage topics."