publications

2025

1. ArXiv

   

   Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models

   Yuxiang Lin, Jingdong Sun, Zhi-Qi Cheng, and 7 more authors

   arXiv preprint arXiv:2504.07521, 2025

   Abs HTML PDF Code

   This paper presents EIBench, a comprehensive benchmark for evaluating Vision-Language Large Models’ ability to interpret and reason about emotions across multiple modalities.

2024

1. NeurIPS

   

   Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

   Zebang Cheng, Zhi-Qi Cheng, Jun-Yan He, and 5 more authors

   In Advances in Neural Information Processing Systems (NeurIPS), 2024

   Abs PDF Code

   This paper introduces Emotion-LLaMA, a multimodal large language model for emotion recognition and reasoning with instruction tuning. The model achieves state-of-the-art performance on multiple emotion recognition benchmarks.

2. CVIU

   

   Invisible Gas Detection: An RGB-Thermal Cross Attention Network and A New Benchmark

   Jue Wang, Yuxiang Lin, Qi Zhao, and 4 more authors

   Computer Vision and Image Understanding, 2024

   Abs HTML PDF Code

   This paper proposes an RGB-Thermal Cross Attention Network (RT-CAN) for invisible gas detection and introduces a new benchmark dataset for this task.

2023

1. ACMMM

   

   Semi-Supervised Multimodal Emotion Recognition with Expression MAE

   Zebang Cheng, Yuxiang Lin, Zhaoru Chen, and 6 more authors

   In Proceedings of the 31st ACM International Conference on Multimedia (ACM MM), 2023

   Abs PDF Slides

   This paper presents Expression MAE, a semi-supervised approach for multimodal emotion recognition that achieved runner-up in the MER 2023 Grand Challenge at ACM MM.