LMM4LMM: Benchmarking and Evaluating Large-multimodal Image Generation with LMMs

How to evaluate Text to Image Generation Model properly?

T2V Model Ranks

LMM-T2V Models

LMM-VQA Models

EvalMi-50K Download

huggingface-cli download wangjiarui/EvalMi-50K --repo-type dataset --local-dir ./EvalMi-50K

Citation

If you find our work useful, please cite our paper as:

@misc{wang2025lmm4lmmbenchmarkingevaluatinglargemultimodal,
      title={LMM4LMM: Benchmarking and Evaluating Large-multimodal Image Generation with LMMs}, 
      author={Jiarui Wang and Huiyu Duan and Yu Zhao and Juntong Wang and Guangtao Zhai and Xiongkuo Min},
      year={2025},
      eprint={2504.08358},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2504.08358}, 
}