Skip to content

Commit

Permalink
Merge pull request #28 from enricobu96/feature/last-refactor
Browse files Browse the repository at this point in the history
finished
  • Loading branch information
enricobu96 authored Sep 5, 2021
2 parents c8faa0c + 9eb1a0d commit ea42baa
Show file tree
Hide file tree
Showing 3 changed files with 16 additions and 118 deletions.
17 changes: 16 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,20 @@
# vcs-project
# Smart Assistant Interaction through Visual Gesture Recognition using a Kinect Sensor

Project for Vision and Cognitive Services course @ UniPD
Master's Course in Computer Science, A.Y. 2020-2021.

## Disclaimer

This repo is distributed under GPLv3 license, and this means that you can use and modify the code as you prefer; nevertheless, we don't assume any kind of responsibility on the use you will do of it, you're responsible for yourself and yourself only.

## Abstract

In the last decade, the raise of smart assistant devices played a key role for the everyday life as they help to retrieve information from the web, manage other home devices and execute routines independently.
Even though the vocal interaction is getting more and more efficient, not always the commands are interpreted correctly.
Moreover, looking at deaf people and/or people with speech disabilities, the effective interaction is drastically reduced, thus limiting the use of this kind of devices.
The main goal of this project is to use the visible body parts of a person to interact with smart devices like Google Home through human pose estimation and gesture recognition.
During our work we compared two different solutions – Google MediaPipe and NiTE2 middleware for Kinect –, and for both of these use-cases we tried different classification algorithms: multinomial logistic regression, ridge regression, random forest, support vector machines and multilayer perceptron.
Through intensive trial and error experiments we were able to get F1-scores in a range between 0.71 and 0.97 for the different use-cases and classification algorithms, with an average accuracy never below 0.70.

## Installation

Expand Down
117 changes: 0 additions & 117 deletions extra/oldcode.py

This file was deleted.

Binary file added extra/paper/VCS-project_Buratto-Sciacco.pdf
Binary file not shown.

0 comments on commit ea42baa

Please sign in to comment.