Skip to content

Facial detection and text-to-speech helper for RaspberryPi device. For people with memory loss disabilites.

Notifications You must be signed in to change notification settings

danilo-archive/dontForget

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

dontForget

Facial detection, voice commands, and text-to-speech helper for people with memory loss.

dontForget

Entry for Royal Hackaway v2.0 ||| DEVPOST


What is it💡

While the potential of this system is limitless, right now it has three main commands:

  • A panic command, that alerts a selected number with the system's location.
  • A facial recognition sensor, that also says who the camera is looking at out loud.
  • A location detector, that says out loud where the system is based on IP address geolocation.

All of these are connected to a react web app that can broadcast messages to the system, add new people to the facial recognition system, and track the location of the system in near real time.

Why ❓

Alzheimer's patients suffer from chronic memory loss amongst other things, and are sometimes unable to remember even their loved ones, or find themselves in situations where they don't know what to do or where they are. This project provides a simple-to-use system that solves all three of these.


How to use it 👨‍👩‍💻

on the frontend client:

The dasbhoard is hosted on localhost:3000

To run it

node app.js
on the RaspberryPi:

For facial recognition and text-to-speech run the main.py:

python3 main.py

For speech-to-text fucntionality (voice commands such as the panic command):

python3 main2.py

For communication with the client (dasboard)

sudo node client.js

⚠WARNING⚠

This build is highly unstable as it was developed in 24 hours.

All the developers were high on ☕☕ caffeine ☕☕ and barely made it out alive.

Use at your own risk.

(Almost) No front-end developers were hurt during the development process.

About

Facial detection and text-to-speech helper for RaspberryPi device. For people with memory loss disabilites.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published