Skip to content

MediaPipe is a cross-platform framework for building multimodal applied machine learning pipelines

License

Notifications You must be signed in to change notification settings

sne21star/mediapipe

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Installation

Follow these instructions.

Getting started

See mobile, desktop, web and Google Coral examples.

Documentation

We will soon create Documentation to help understand the changes we made in this framework. MediaPipe Read-the-Docs or docs.mediapipe.dev

Check out the Examples page for tutorials on how to use MediaPipe. Concepts page for basic definitions

Visualizing MediaPipe graphs

A web-based visualizer is hosted on viz.mediapipe.dev. Please also see instructions here.

Google Open Source Code search

Search MediaPipe Github repository using Google Open Source code search

Videos

MediaPipe

This project is part of a senior design project at Purdue University. My team and I are attempting to create an ASL translator using the Mediapipe Framework. We have so far been able to translator ASL letters. We are going to attempt to interpret words as well in ASL.

Real-time Hand Tracking

"MediaPipe has made it extremely easy to track the hands of the user. We take the data and interpret it into the ASL letter it is likely to be"

ML Solutions in MediaPipe

  • Hand Tracking hand_tracking This shows the handtracking Mediapipe has already created.

ASL Translator App

Android (Google Pixel 2)

Real-time Hand Tracking

iOS (7th Generation, 10.0+)

Real-time Hand Tracking Gifs of each category came from this database: https://asl-lex.github.io/asl-lex/index.html

Dynamic Sign Translation

Architecture was based off of this repo: https://github.com/Tachionstrahl/SignLanguageRecognition

Converted model to work on CPU, translate ASL phrases, and work on MacOS Real-time Hand Tracking Real-time Hand Tracking Real-time Hand Tracking

About

MediaPipe is a cross-platform framework for building multimodal applied machine learning pipelines

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C++ 86.0%
  • Starlark 5.0%
  • Python 1.9%
  • Java 1.7%
  • Objective-C++ 1.5%
  • Objective-C 1.0%
  • Other 2.9%