Multi-Task Deep Neural Networks for Natural Language Understanding

In MT-BERT we reproduce a neural language understanding model which implements a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple NLU tasks.

Implementation of a slim multi-task learner DNN with 3 tasks (heads). Detects shape type, color, the position of the midpoint of the shape.