VRAM Requirements for Inference and Fine-tuning

[dannygit0]

Hello, thank you for releasing such an interesting project!

I would like to ask if there are any recommended or minimum VRAM requirements for performing inference and fine-tuning with the MAGMA model. This information would be very helpful for planning experiments and allocating GPU resources. If possible, could you also share any references regarding the VRAM usage and performance of different fine-tuning approaches (if applicable)?

Thank you again for your team's great work and contributions!

[jwyang]

Hi, @dannygit0 , thanks for your interests! I will prepare a mininum requirements table for inference and finetuning shortly.