Week 4 2020 Fall

Homework:

• Reading:

  • face-api.js — JavaScript API for Face Recognition in the Browser with tensorflow.js
  • Introducing BodyPix: Real-time Person Segmentation in the Browser with TensorFlow.js

• Coding:

  • Build an interactive browser experiment on face or hand data
  • Publish your project on GitHub or your own blog, or record a video and put it on your blog. Add your project link below.

See demos live

• Face-api
  • FaceApi_Image_Landmarks
  • FaceApi_Video_Landmarks
• Face Mesh
  • Facemesh_Image
  • Facemesh_Webcam
• HandPose
  • Handpose_Image
  • Handpose_Webcam

Resource

• ml5js - faceapi
• ml5js - faceMesh source
• ml5js - handPose source
• tfjs - faceapi-js
• tfjs - faceMesh
• tfjs - handPose

Projects

• LipSync game using Face Mesh model

Questions?

• add your question here

Add your name / link to your assignment below

• Ji Park, Anti surveillance application
• Julie Lizardo, Face Matrix, Dancing Pumpkin Character
• Sihan Zhang, Falling Bubbles
• Michelle Sun, Rock Paper Scissors (Now it only detects your gesture)/ Painter
• Philip Cadoux, Faces Among Us
• Tianjun, Chattingroom with audio input
• KJ Ha, Random Word Generator
• Jeeyoon Hyun, Multidimensional Faces
• Rae Ruilin Huang, Hand color picker
• Zoe Gao, Silent Movie Nose