【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
-
Updated
Nov 29, 2024 - Python
#
video-language-understanding
Here are 17 public repositories matching this topic...
【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models
action-recognition video-understanding video-recognition cross-modal-learning video-language-understanding
-
Updated
Sep 9, 2024 - Python
EditWorld: Simulating World Dynamics for Instruction-Following Image Editing
image-editing text-to-image instruction-following large-language-models video-language-understanding
-
Updated
Jun 23, 2024 - Python
Can I Trust Your Answer? Visually Grounded Video Question Answering (CVPR'24, Highlight)
videoqa video-grounding video-question-answering video-language-understanding trustworthy-vqa visual-evidence-grounding
-
Updated
Jul 1, 2024 - Python
Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
-
Updated
Sep 19, 2024 - Python
A Survey on video and language understanding.
machine-learning deep-learning paper dataset multimodal-deep-learning awesome-papers video-language video-language-pretraining video-language-understanding
-
Updated
Apr 21, 2023
Video Graph Transformer for Video Question Answering (ECCV'22)
-
Updated
Jun 8, 2023 - Python
[2021 MultiMedia] CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrieval
-
Updated
Sep 23, 2021 - Python
Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
-
Updated
May 23, 2023 - Python
[AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.
cross-modal-retrieval cross-modal-learning video-text-retrieval prompt-tuning parameter-efficient-tuning video-language-understanding
-
Updated
Oct 14, 2024 - Python
[2023 ACL] CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding
-
Updated
Aug 5, 2023 - Python
[NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
navigation perception summarization reasoning visual-reasoning egocentric-videos gpt-4 multiple-choice-questions benchmark-dataset video-language-understanding multimodal-large-language-models evals gemini-pro spatial-intelligence neurips-2024 1-hour-video-language-understanding long-form-video-language-understanding long-context-understanding
-
Updated
Dec 2, 2024 - Jupyter Notebook
Contrastive Video Question Answering via Video Graph Transformer (IEEE T-PAMI'23)
videoqa video-question-answering contrastive-learning dynamic-visual-graph video-language-understanding
-
Updated
Mar 9, 2024 - Python
Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)
-
Updated
Jan 12, 2023 - Python
The champion solution for Ego4D Natural Language Queries Challenge in CVPR 2023
-
Updated
Jan 23, 2024 - Python
The official GitHub page for the survey paper "Self-Supervised learning for Videos: A survey"
computer-vision action-recognition pre-training text-to-video video-language video-language-pretraining video-language-understanding video-to-video
-
Updated
Jul 19, 2023
A repository of Video Language papers, code and datasets.
-
Updated
Jan 28, 2024
Improve this page
Add a description, image, and links to the video-language-understanding topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the video-language-understanding topic, visit your repo's landing page and select "manage topics."