lipreading-in-the-wild-experiments

This repository contains my experiments with lip reading using deep learning in Keras. I train and test on the LRW dataset.

process-lrw/

Codes to convert the videos in LRW Dataset to: - frames pertaining to words - mouth area of those frames - audio

Instructions are provided in README file in directory.

Directory to place the "shape_predictor_68_face_landmarks.dat" file, required by process-lrw and head-pose

Codes and files --- considering the lipreader as an image retrieval system

Codes and files --- to compute head pose in all frames in LRW dataset (extracted using process-lrw)

Head pose is determined using voletiv/deepgaze (my fork of deepgaze).

Instructions are provided in README file in directory.

Name		Name	Last commit message	Last commit date
Latest commit History 207 Commits
assessor		assessor
head-pose		head-pose
image-retrieval		image-retrieval
process-lrw		process-lrw
shape-predictor		shape-predictor
.gitignore		.gitignore
README.md		README.md
histogram_of_number_of_frames_per_sample.png		histogram_of_number_of_frames_per_sample.png
histogram_of_number_of_frames_per_sample_per_set.png		histogram_of_number_of_frames_per_sample_per_set.png
lrw_mean_word_durations.png		lrw_mean_word_durations.png
lrw_vocabulary.txt		lrw_vocabulary.txt
lrw_vocabulary_phonetics.txt		lrw_vocabulary_phonetics.txt
requirements.txt		requirements.txt