Skip to content
This repository has been archived by the owner on Nov 22, 2020. It is now read-only.
/ Facemoji Public archive

๐Ÿ˜† A voice chatbot that can imitate your expression. OpenCV+Dlib+Live2D+Moments Recorder+Turing Robot+Iflytek IAT+Iflytek TTS

License

Notifications You must be signed in to change notification settings

huihut/Facemoji

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

63 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Facemoji

A voice chatbot that can imitate your expression.

This is a Unity project (just for Android now), which has two modules.

English | ็ฎ€ไฝ“ไธญๆ–‡

Releases

Setup

  • Download shape_predictor_68_face_landmarks.dat(Facial Landmark Detector) and Facemoji_Plugins_Assets_1.5.0.unitypackage(Streamlined OpenCV, Dlib, Live2D and Iflytek Assets Library) from Drive.Google or Pan.Baidu
  • git clone https://github.com/huihut/Facemoji.git
  • Create new Unity project (called FacemojiDemo)
  • Copy Facemoji/Assets and Facemoji/ProjectSettings to your unity project (FacemojiDemo/)
  • Copy shape_predictor_68_face_landmarks.dat to your FacemojiDemo/Assets/StreamingAssets/
  • Import Facemoji_Plugins_Assets_1.5.0.unitypackage
  • Select Android platform
  • Build & Run

Usage

FaceTracking

Using OpenCV and Dlib to detects facial expressions, converts them into Live2D model.

She can move with your face and you can try shaking your head.

Record gif

The middle of the above is the record button, you can record 3 seconds gif.

Recorder State : Recording(Ready to record) -> PreProcessing(Is recording) -> Paused(Compressing gif) -> Recording(Ready to record)

Save the gif in Application.dataPath

(Android in /storage/emulated/0/Android/data/com.huihut.facemoji/files/)

Voice and text chat (chatbot? She said she is AI, not Robot! hhhh...)

Using Turing Robot, Iflytek IAT and Iflytek TTS.

You can chat with her by voice or text.

She's a great AI (robot), and she can:

  • Chat
  • Encyclopedia
  • Calculate
  • Tell a story
  • Tell a joke
  • Idiom Solitaire
  • Horoscope
  • Weather forecast
  • ...

But because she is a Chinese robot(Turing robot only supports Chinese), she can only chat in Chinese.

She will chat in English later.

Preview

Gif

  • Come On !

  • No~ No~

  • Wink !

License

GPL v3.0