This project was designed for learning tensorflow by just one example for beginners. More specifically, it's aimmed to achive the goal as follows:

• Understanding the key concepts of addressing compuation in tensorflow
• Implementing your machine learning, especially deep learning, model using this concepts.
• Learn to debug the problem and optimize the program under the tensorflow framework.

In order to achive this goal, I play attention on a pratical task and dig deep it instead of a wide of examples. By this way, I want to share the process of doing my research or task, and hope to help beginners to build a overview of modeling the machine learning problem using tensorflow.

This project choice face recongnition problem as the task, actually face verification model. The model was trained on the CASIA-WEBFACE and tested on the LFW. More details about the dataset are here.

The project can be logically divided into three parts of different levels.

• the key concepts of tensorflow program and components that constitude the model were introduced.
• a basic model taking advantages of both the key concepts and compoents was implemented and the softmax loss was used to learn the feature.
• the optimization was made to improve the basic model as far as both training speed and test accuracy were concerned.
  • data management and multi-gpu were utilized to speed up the training
  • a more powerful network and new loss called Large Margin Cosine Loss were used to improve the accuracy.

0. Introduction

   • Requirements
   • Overview
   • Installation
   • Resources

1. The key concepts

   • Graph
   • Session
   • Tensor
   • Operation

2. Components

   • Variables
   • Name and scope
   • Optimizer and trainer
   • Convolution network
   • Save and restore
   • Tensorboard
   • Customized layer

3. Work togother

   • Modularization
   • Project template
   • Code togother

4. Optimization

   • Speed:
     • Timeline
     • Data management
     • Multi-gpu
   • accuracy
     • Modify the network structure
     • CosFace

A Practical Guide for Debugging TensorFlow Codes

Please look here.

1. TensorFlow Examples
2. Effective Tensorflow
3. Tensorflow sphereface
4. tensorflow cookbook
5. tensorflow sphereface