X-PLUG

All

12 repositories

mPLUG-Owl
Public
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
video chatbot dialogue pytorch transformer llama gpt alpaca visual-recognition multimodal
Python
•
MIT License
•176•2.3k•95•1•Updated Oct 15, 2024Oct 15, 2024
SocialBench
Public
RoleInteract: Evaluating the Social Interaction of Role-Playing Agents
Python
•4•45•2•0•Updated Oct 12, 2024Oct 12, 2024
mPLUG-DocOwl
Public
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
multimodal table-understanding document-understanding mllm multimodal-large-language-models chart-understanding
Python
•
Apache License 2.0
•101•1.6k•59•1•Updated Sep 28, 2024Sep 28, 2024
MobileAgent
Public
Mobile-Agent: The Powerful Mobile Device Operation Assistant Family
android agent harmony ios app gui automation mobile copilot multimodal
Python
•
MIT License
•280•3k•44•1•Updated Sep 26, 2024Sep 26, 2024
MM_StoryAgent
Public
Python
•
Apache License 2.0
•0•6•0•0•Updated Aug 23, 2024Aug 23, 2024
Multi-LLM-Agent
Public
Python
•24•195•5•0•Updated Apr 23, 2024Apr 23, 2024
mPLUG-HalOwl
Public
mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
benchmark contrastive-learning hallucinations mllm multimodal-large-language-models multimodal-hallucination
Python
•
MIT License
•2•79•6•0•Updated Jan 29, 2024Jan 29, 2024
Youku-mPLUG
Public
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
benchmark video dataset chinese youku multimodal video-retrieval video-question-answering multimodal-pretraining mllm
Python
•
Apache License 2.0
•11•285•23•0•Updated Jan 8, 2024Jan 8, 2024
ChatPLUG
Public
A Chinese Open-Domain Dialogue System
chat chatbot dialogue chinese personality encoder-decoder pretraining large-language-models knowledge-augment chatgpt
Python
•
Apache License 2.0
•28•314•0•0•Updated Aug 16, 2023Aug 16, 2023
mPLUG-2
Public
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)
video vqa image-retrieval multimodal video-retrieval video-question-answering foundation-models multimodal-pretraining mllm mplug
Python
•
Apache License 2.0
•18•220•17•0•Updated Jul 21, 2023Jul 21, 2023
CValues
Public
面向中文大模型价值观的评估与对齐研究
benchmark evaluation safety responsibility human-values multi-choice llms chinese-llms
Python
•
Apache License 2.0
•20•480•2•0•Updated Jul 20, 2023Jul 20, 2023
mPLUG
Public
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)
pytorch transformer vqa image-captioning visual-language image-text multimodal pretraining image-text-retrieval
Python
•6•83•10•0•Updated May 8, 2023May 8, 2023