Overview of self-supervised learning of tiny models, including distillation-based methods (aks. self-supervised distillation) and non-distillation methods.

Testing the Moondream tiny vision model

Phi-3-Vision model test - running locally