[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
chatbot llama multi-modal clip vision-language gpt-4 foundation-models visual-prompting llava llama2 cvpr2024 gpt-4-vision
-
Updated
Jul 17, 2024 - Python
#
visual-prompting
Here are 20 public repositories matching this topic...
Language: All
Filter by language
Sort: Most stars
Sort options
Exploring Visual Prompts for Adapting Large-Scale Models
-
Updated
Jun 6, 2022 - Python
[TPAMI] Searching prompt modules for parameter-efficient transfer learning.
deep-learning pytorch transfer-learning pre-trained-model domain-generalization prompt-tuning visual-prompting
-
Updated
Dec 8, 2023 - Python
[ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass
-
Updated
Aug 1, 2023 - Python
[NeurIPS2023] Official implementation and model release of the paper "What Makes Good Examples for Visual In-Context Learning?"
-
Updated
Mar 4, 2024 - Python
Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"
transfer-learning black-box-optimization prompt-tuning foundation-models parameter-efficient-tuning visual-prompting
-
Updated
Aug 14, 2023 - Python
[ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models
visual-prompting prompting vision-language-model large-vision-language-model large-vision-language-models large-multimodal-models vision-language-models
-
Updated
Oct 10, 2024 - Python
👀 Visual Instruction Inversion: Image Editing via Visual Prompting (NeurIPS 2023)
-
Updated
Dec 19, 2023 - Python
[CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval
-
Updated
Feb 28, 2023
A curated list of awesome papers, resources, and tools for Visual Prompt Tuning (VPT).
-
Updated
Oct 21, 2025 - Python
[ICLR24] AutoVP: An Automated Visual Prompting Framework and Benchmark
efficient-inference finetuning reprogramming model-agnostic downstream-tasks low-data-regime foundation-models visual-prompt visual-prompting ood-robustness
-
Updated
Sep 18, 2025 - Python
[ICML 2024] Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Models
deep-learning similarity-score image-text-matching zero-shot-classification large-language-models visual-prompting vision-language-model visual-text-alignment textual-prompting
-
Updated
Sep 3, 2024 - Python
V2P-Bench: Evaluating Video-Language Understanding with Visual Prompts for Better Human-Model Interaction
-
Updated
May 23, 2025 - Python
[arXiv] "Uncovering the Hidden Cost of Model Compression" by Diganta Misra, Agam Goyal, Bharat Runwal, and Pin-Yu Chen
sparsity calibration pruning transfer-learning linear-probing lottery-tickets lottery-ticket-hypothesis adversarial-reprograming visual-prompting
-
Updated
Mar 14, 2024 - Python
A simple GUI for experimenting with visual prompting
-
Updated
Apr 28, 2024 - Python
[IEEE BigData'24] Code used in Paper "Benchmarking Human and Automated Prompting in the Segment Anything Model"
-
Updated
Oct 30, 2024 - Python
Visual thinking for coding with AI
-
Updated
Aug 2, 2025 - TypeScript
Parameter-Efficient Adaptation of mPLUG-Owl2 via Pixel-Level Visual Prompts for NR-IQA
machine-learning computer-vision finetuning image-quality-assessment visual-prompting multimodal-large-language-models
-
Updated
Sep 4, 2025 - Python
These notes and resources are compiled from the crash course Prompt Engineering for Vision Models offered by DeepLearning.AI.
computer-vision image-processing cnn video-processing vit generative-models fine-tuning diffusion-models convnets vision-models visual-prompting prompt-engineering vision-language-model large-vision-language-models meta-sam large-vision-models vision-model-prompting
-
Updated
Aug 20, 2024 - Jupyter Notebook
Vision-Zephyr: a multimodal LLM for Visual Commonsense Reasoning—CLIP-ViT + Zephyr-7B with visual prompting; code, training scripts, and VCR evaluation.
python computer-vision transformers pytorch clip vcr zephyr visual-commonsense-reasoning vision-language visual-prompting multimodal-llms
-
Updated
Aug 25, 2025 - Python
Improve this page
Add a description, image, and links to the visual-prompting topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the visual-prompting topic, visit your repo's landing page and select "manage topics."