Pooled VLM

A codebase to finetune a VLM to use pooled embeddings; this allows for vector arithmetic with images that produce a caption, etc.

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
.ipynb_checkpoints		.ipynb_checkpoints
.gitignore		.gitignore
README.md		README.md
__init__.py		__init__.py
app.py		app.py
blank.png		blank.png
config.py		config.py
configuration_intern_vit.py		configuration_intern_vit.py
configuration_internvl_chat.py		configuration_internvl_chat.py
configuration_phi3.py		configuration_phi3.py
conversation.py		conversation.py
data.py		data.py
embed.jpg		embed.jpg
inference.ipynb		inference.ipynb
internvl2_patches.py		internvl2_patches.py
model.py		model.py
modeling_intern_vit.py		modeling_intern_vit.py
modeling_phi3.py		modeling_phi3.py
requirements.txt		requirements.txt
sol.jpg		sol.jpg
train.py		train.py

Provide feedback