Difference between revisions of "Openface"

From OnnoWiki
Jump to navigation Jump to search
(Created page with "Sumber: https://github.com/TadasBaltrusaitis/OpenFace/wiki Over the past few years, there has been an increased interest in automatic facial behavior analysis and understand...")
 
Line 1: Line 1:
−
Sumber: https://github.com/TadasBaltrusaitis/OpenFace/wiki
+
Sumber:
−
 
+
* https://github.com/TadasBaltrusaitis/OpenFace/wiki
−
 
+
* https://cmusatyalab.github.io/openface/
−
Over the past few years, there has been an increased interest in automatic facial behavior analysis and understanding. We present OpenFace – a tool intended for computer vision and machine learning researchers, affective computing community and people interested in building interactive applications based on facial behavior analysis. OpenFace is the first toolkit capable of facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation with available source code for both running and training the models. The computer vision algorithms which represent the core of OpenFace demonstrate state-of-the-art results in all of the above mentioned tasks. Furthermore, our tool is capable of real-time performance and is able to run from a simple webcam without any specialist hardware
 
−
 
 
−
OpenFace is an implementation of a number of research papers from the Multicomp group, Language Technologies Institute at the Carnegie Mellon University and Rainbow Group, Computer Laboratory, University of Cambridge. The founder of the project and main developer is Tadas Baltrušaitis.
 
−
 
 
−
Special thanks goes to Louis-Philippe Morency and his MultiComp Lab at Carnegie Mellon University for help in writing and testing the code, Erroll Wood for the gaze estimation work, and Amir Zadeh and Yao Chong Lim on work on the CE-CLM model.
 
−
Functionality
 
−
 
 
−
The system is capable of performing a number of facial analysis tasks:
 
−
 
 
−
    Facial Landmark Detection
 
−
 
 
−
Sample facial landmark detection image
 
−
 
 
−
    Facial Landmark and head pose tracking (links to YouTube videos)
 
−
 
 
−
Multiple Face Tracking Multiple Face Tracking
 
−
 
 
−
    Facial Action Unit Recognition
 
−
 
 
−
    Gaze tracking (image of it in action)
 
−
 
 
−
    Facial Feature Extraction (aligned faces and HOG features)
 
−
 
 
−
Sample aligned face and HOG image
 
−
Installation
 
−
 
 
−
Windows
 
−
 
 
−
Ubuntu
 
−
 
 
−
Mac
 
−
 
 
−
Docker image Somewhat outdated version, but easy to use as no installation needed
 
−
Use
 
−
 
 
−
Command line interface
 
−
 
 
−
GUI for Windows
 
−
 
 
−
Messaging server (Coming soon)
 
−
Citation
 
  
−
If you use any of the resources provided on this page in any of your publications we ask you to cite the following work and the work for a relevant submodule you used.
 
−
Overall system
 
  
−
OpenFace 2.0: Facial Behavior Analysis Toolkit Tadas Baltrušaitis, Amir Zadeh, Yao Chong Lim, and Louis-Philippe Morency, IEEE International Conference on Automatic Face and Gesture Recognition, 2018
+
OpenFace adalah implementasi pengenalan wajah menggunakan Python dan Torch dengan deep neural network dan berdasarkan pada CVPR 2015 paper FaceNet: A Unified Embedding for Face Recognition and Clustering oleh Florian Schroff, Dmitry Kalenichenko, dan James Philbin di Google. Torch memungkinkan jaringan dieksekusi pada CPU atau dengan CUDA.
−
Facial landmark detection and tracking
 
  
−
Convolutional experts constrained local model for facial landmark detection A. Zadeh, T. Baltrušaitis, and Louis-Philippe Morency. Computer Vision and Pattern Recognition Workshops, 2017
+
Dibuat oleh Brandon Amos, Bartosz Ludwiczuk, dan Mahadev Satyanarayanan.
  
−
Constrained Local Neural Fields for robust facial landmark detection in the wild Tadas Baltrušaitis, Peter Robinson, and Louis-Philippe Morency. in IEEE Int. Conference on Computer Vision Workshops, 300 Faces in-the-Wild Challenge, 2013.
+
* Source tersedia di GitHub pada cmusatyalab/openface.
−
Eye gaze tracking
+
* Ada dokumentasi API
 +
* Bergabung pada group cmu-openface atau gitter chat untuk diskusi dan masalah instanasi.
  
−
Rendering of Eyes for Eye-Shape Registration and Gaze Estimation Erroll Wood, Tadas Baltrušaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, and Andreas Bulling in IEEE International. Conference on Computer Vision (ICCV), 2015
+
Penelitian ini di dukung oleh National Science Foundation (NSF) under grant number CNS-1518865. Additional support was provided by the Intel Corporation, Google, Vodafone, NVIDIA, and the Conklin Kistler family fund. Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and should not be attributed to their employers or funding sources.
−
Facial Action Unit detection
 
  
−
Cross-dataset learning and person-specific normalisation for automatic Action Unit detection Tadas Baltrušaitis, Marwa Mahmoud, and Peter Robinson in Facial Expression Recognition and Analysis Challenge, IEEE International Conference on Automatic Face and Gesture Recognition, 2015
+
Isn't face recognition a solved problem?
−
Commercial license
 
  
−
For inquiries about the commercial licensing of the OpenFace toolkit please visit https://www.flintbox.com/public/project/50632/
+
No! Accuracies from research papers have just begun to surpass human accuracies on some benchmarks. The accuracies of open source face recognition systems lag behind the state-of-the-art. See our accuracy comparisons on the famous LFW benchmark.
−
Final remarks
+
Please use responsibly!
  
−
I did my best to make sure that the code runs out of the box but there are always issues and I would be grateful for your understanding that this is research code and a research project. If you encounter any problems/bugs/issues please contact me on github or by emailing me at tadyla@gmail.com for any bug reports/questions/suggestions. I prefer questions and bug reports on github as that provides visibility to others who might be encountering same issues or who have the same questions.
+
We do not support the use of this project in applications that violate privacy and security. We are using this to help cognitively impaired users sense and understand the world around them.
−
Copyright
+
Overview
  
−
Copyright can be found in the Copyright.txt
+
The following overview shows the workflow for a single input image of Sylvestor Stallone from the publicly available LFW dataset.
  
−
You have to respect boost, TBB, dlib, OpenBLAS, and OpenCV licenses.
+
    Detect faces with a pre-trained models from dlib or OpenCV.
 +
    Transform the face for the neural network. This repository uses dlib's real-time pose estimation with OpenCV's affine transformation to try to make the eyes and bottom lip appear in the same location on each image.
 +
    Use a deep neural network to represent (or embed) the face on a 128-dimensional unit hypersphere. The embedding is a generic representation for anybody's face. Unlike other face representations, this embedding has the nice property that a larger distance between two face embeddings means that the faces are likely not of the same person. This property makes clustering, similarity detection, and classification tasks easier than other face recognition techniques where the Euclidean distance between features is not meaningful.
 +
    Apply your favorite clustering or classification techniques to the features to complete your recognition task. See below for our examples for classification and similarity detection, including an online web demo.
  
−
Furthermore you have to respect the licenses of the datasets used for model training - https://github.com/TadasBaltrusaitis/OpenFace/wiki/Datasets
 
  
−
    © 2018 GitHub, Inc.
 
−
    Terms
 
−
    Privacy
 
−
    Security
 
−
    Status
 
−
    Help
 
  
−
    Contact GitHub
 
−
    API
 
−
    Training
 
−
    Shop
 
−
    Blog
 
−
    About
 
  
−
Press h to open a hovercard with more details.
 
  
  
Line 96: Line 40:
  
 
* https://github.com/TadasBaltrusaitis/OpenFace/wiki
 
* https://github.com/TadasBaltrusaitis/OpenFace/wiki
 +
* https://cmusatyalab.github.io/openface/

Revision as of 17:24, 24 May 2018

Sumber:


OpenFace adalah implementasi pengenalan wajah menggunakan Python dan Torch dengan deep neural network dan berdasarkan pada CVPR 2015 paper FaceNet: A Unified Embedding for Face Recognition and Clustering oleh Florian Schroff, Dmitry Kalenichenko, dan James Philbin di Google. Torch memungkinkan jaringan dieksekusi pada CPU atau dengan CUDA.

Dibuat oleh Brandon Amos, Bartosz Ludwiczuk, dan Mahadev Satyanarayanan.

  • Source tersedia di GitHub pada cmusatyalab/openface.
  • Ada dokumentasi API
  • Bergabung pada group cmu-openface atau gitter chat untuk diskusi dan masalah instanasi.

Penelitian ini di dukung oleh National Science Foundation (NSF) under grant number CNS-1518865. Additional support was provided by the Intel Corporation, Google, Vodafone, NVIDIA, and the Conklin Kistler family fund. Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and should not be attributed to their employers or funding sources.

Isn't face recognition a solved problem?

No! Accuracies from research papers have just begun to surpass human accuracies on some benchmarks. The accuracies of open source face recognition systems lag behind the state-of-the-art. See our accuracy comparisons on the famous LFW benchmark. Please use responsibly!

We do not support the use of this project in applications that violate privacy and security. We are using this to help cognitively impaired users sense and understand the world around them. Overview

The following overview shows the workflow for a single input image of Sylvestor Stallone from the publicly available LFW dataset.

   Detect faces with a pre-trained models from dlib or OpenCV.
   Transform the face for the neural network. This repository uses dlib's real-time pose estimation with OpenCV's affine transformation to try to make the eyes and bottom lip appear in the same location on each image.
   Use a deep neural network to represent (or embed) the face on a 128-dimensional unit hypersphere. The embedding is a generic representation for anybody's face. Unlike other face representations, this embedding has the nice property that a larger distance between two face embeddings means that the faces are likely not of the same person. This property makes clustering, similarity detection, and classification tasks easier than other face recognition techniques where the Euclidean distance between features is not meaningful.
   Apply your favorite clustering or classification techniques to the features to complete your recognition task. See below for our examples for classification and similarity detection, including an online web demo.





Referensi