[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
-
Updated
Aug 12, 2024 - Python
#
vision-language
Here are 145 public repositories matching this topic...
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
image-captioning visual-reasoning visual-question-answering vision-language vision-language-transformer image-text-retrieval vision-and-language-pre-training
-
Updated
Aug 5, 2024 - Jupyter Notebook
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
search-engine machine-learning natural-language-processing information-retrieval deep-learning transformers machinelearning gpt visual-search multi-modal clip knn semantic-search hacktoberfest hnsw vector-search vision-language large-language-models tensor-search chatgpt
-
Updated
Dec 11, 2024 - Python
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
nlp computer-vision deep-learning transformers pytorch chinese pretrained-models multi-modal clip coreml-models contrastive-loss vision-language multi-modal-learning image-text-retrieval vision-and-language-pre-training
-
Updated
Aug 6, 2024 - Python
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
prompt chinese image-captioning pretrained-models visual-question-answering multimodal text-to-image-synthesis vision-language pretraining referring-expression-comprehension prompt-tuning
-
Updated
Apr 24, 2024 - Python
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
ocr computer-vision artificial-intelligence text-recognition document text-detection document-analysis end-to-end-ocr multimodal scene-text-recognition multimodal-deep-learning scene-text-detection vision-language document-understanding scene-text-detection-recognition document-recognition document-intelligence documentai vision-language-transformer vision-language-model
-
Updated
Nov 22, 2024 - C++
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
chatbot llama clip mulit-modal vision-language vicuna gpt-4 vision-language-pretraining llava video-chatboat video-conversation
-
Updated
Aug 27, 2024 - Python
日本語LLMまとめ - Overview of Japanese LLMs
japanese generative-model japanese-language language-models language-model generative-models multimodal vision-and-language vision-language foundation-models large-language-models llm llms generative-ai large-language-model vision-language-model japanese-llm japanese-language-model llm-japanese
-
Updated
Dec 8, 2024 - TypeScript
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
representation-learning multimodal vision-and-language contrastive-loss vision-language vision-transformer foundation-models audio-language
-
Updated
Oct 6, 2024 - Python
[ECCV 2024 Oral] DriveLM: Driving with Graph Visual Question Answering
autonomous-driving vision-language large-language-models llm prompt-engineering prompting chain-of-thought tree-of-thoughts graph-of-thoughts
-
Updated
Oct 9, 2024 - HTML
Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)
-
Updated
Nov 7, 2023 - Jupyter Notebook
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
conversation lmms vision-language llm llava llama3 phi3 llava-llama3 llava-phi3 llama3-llava phi3-llava llama-3-vision phi3-vision llama-3-llava phi-3-llava llama3-vision phi-3-vision
-
Updated
Jul 10, 2024 - Python
[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
machine-learning deep-learning vision-and-language vision-language vision-transformer vision-language-model
-
Updated
Jul 30, 2024 - Jupyter Notebook
A Framework of Small-scale Large Multimodal Models
-
Updated
Dec 1, 2024 - Python
[ICLR 2024] Controlling Vision-Language Models for Universal Image Restoration. 5th place in the NTIRE 2024 Restore Any Image Model in the Wild Challenge.
deep-learning prompt pytorch image-denoising image-restoration image-deblurring low-level-vision shadow-removal image-dehazing face-inpainting vision-language diffusion-models low-light-image-enhancement image-deraining jpeg-artifacts-removal image-desnowing
-
Updated
Aug 7, 2024 - Python
Official implementation of SEED-LLaMA (ICLR 2024).
-
Updated
Sep 21, 2024 - Python
This is the third party implementation of the paper Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection.
-
Updated
Jun 25, 2024 - Python
CLIPort: What and Where Pathways for Robotic Manipulation
natural-language-processing computer-vision deep-learning robotics pytorch vision manipulation clip rearrangement grounding vision-language
-
Updated
Nov 2, 2023 - Jupyter Notebook
多模态中文LLaMA&Alpaca大语言模型（VisualCLA）
-
Updated
Jul 27, 2023 - Python
CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
natural-language-processing computer-vision deep-learning robotics pytorch vision manipulation vision-and-language grounding vision-language
-
Updated
Dec 5, 2024 - Python
Improve this page
Add a description, image, and links to the vision-language topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vision-language topic, visit your repo's landing page and select "manage topics."