Rui Yan

Assistant Researcher
Department of Computer Science and Technology, Nanjing University
Office: Room 819, Building of Computer Science and Technology, Xianlin Campus of Nanjing University, Nanjing 210023, China
Email: ruiyan _at_ nju.edu.cn
CVGoogle ScholarGithubTwitter


Intro

Currently, I am an Assistant Researcher of Department of Computer Science and Technology at Nanjing University and working with Tieniu Tan. I obtained Ph.D. degree at Intelligent Media Analysis Group (IMAG), Nanjing University of Science and Technology, under the supervision of Prof. Jinhui Tang. During Jan. 2022 - Aug. 2022, I worked as a Research Intern (Part-time) at ByteDance. During Sep. 2021 - Dec. 2021, I worked as a Research Intern (Part-time) at Tencent with Yixiao Ge. During Dec. 2018 - Dec. 2019, I worked as a Research Intern at HUAWEI NOAH'S ARK LAB with Lingxi Xie and Prof. Qi Tian (IEEE Fellow). I am working closely with Mike Shou and Xiangbo Shu. My research mainly focus on Complex Human Behavior Understanding and Video-Language Understanding.

News

All Publications
Selected Publications
2020
Progressive Instance-aware Feature Learning for Compositional Action Recognition
Rui Yan, Lingxi Xie, Xiangbo Shu, Liyan Zhang, and Jinhui Tang
TPAMI, 2023
[PDF][Code]
All in One: Exploring Unified Video-language Pre-training
Jinpeng Wang, Yixiao Ge, Rui Yan, Xudong Lin, Guanyu Cai, Jianping Wu, Ying Shan, Xiaohu Qie, Mike Zheng Shou
CVPR 2023
[PDF][Code]
Video-Text Pre-training with Learned Regions for Retrieval
Rui Yan, Mike Zheng Shou, Yixiao Ge, Alex Jinpeng Wang, Xudong Lin, Guanyu Cai, and Jinhui Tang
AAAI 2023
[PDF][Code]
Egocentric Video-Language Pretraining
Kevin Qinghong Lin, Alex Jinpeng Wang, Mattia Soldan, Michael Wray, Rui Yan, Eric Zhongcong Xu, Difei Gao, Rongcheng Tu, Wenzhe Zhao, Weijie Kong, Chengfei Cai, Hongfa Wang, Dima Damen, Bernard Ghanem, Wei Liu, Mike Zheng Shou
NeurIPS 2022 (Spotlight)
[PDF][Code]
Look Less Think More: Rethinking Compositional Action Recognition
Rui Yan, Peng Huang, Xiangbo Shu, Junhao Zhang, Yonghua Pan, Jinhui Tang
ACM MM 2022
[PDF][Split]
Dual-AI: Dual-path Actor Interaction Learning for Group Activity Recognition
Mingfei Han, David Junhao Zhang, Yali Wang, Rui Yan, Lina Yao, Xiaojun Chang, and Yu Qiao
CVPR 2022 (Oral)
[PDF][Code]
Magi-Net: Meta Negative Network for Early Activity Prediction
Wenqian Wang, Faliang Chang, David Junhao Zhang, Rui Yan, Chunsheng Liu, Bin Wang, Mike Zheng Shou
IEEE Transactions on Image Processing 2023
[PDF][Code]
Object-aware Video-language Pre-training for Retrieval
Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, and Mike Zheng Shou
CVPR 2022
[PDF][Code]
Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition
Xiangbo Shu, Jiawen Yang, Rui Yan (Corresponding Author), and Yan Song
TCSVT 2022
[PDF]
HiGCIN: Hierarchical Graph-based Cross Inference Network for Group Activity Recognition
Rui Yan, Lingxi Xie, Jinhui Tang, Xiangbo Shu, and Qi Tian
TPAMI, 2020
[PDF][Code]
Social Adaptive Module for Weakly-supervised Group Activity Recognition
Rui Yan, Lingxi Xie, Jinhui Tang, Xiangbo Shu, and Qi Tian
ECCV 2020
[PDF][Project][Code]
Coherence Constrained Graph LSTM for Group Activity Recognition
Jinhui Tang, Xiangbo Shu, Rui Yan, and Liyan Zhang
TPAMI, 2019
[PDF]
Participation-Contributed Temporal Dynamic Model for Group Activity Recognition
Rui Yan, Jinhui Tang, Xiangbo Shu, Zechao Li and Qi Tian
ACM MM 2018 (Oral) ~8.5% (Journal version is accepted by TNNLS)
[PDF][Code][Slides]

Awards & Honors

  • 江苏省青年科技人才托举工程 2024
  • 南京理工大学优秀博士论文 2024
  • 南京大学-毓秀青年学者 2023
  • 国家资助博士后 2023
  • 江苏省卓越博士后 2023
  • The Outstanding PhD of Nanjing University of Science and Technology 2020
  • ACM Multimedia Student Travel Grant 2018
  • The First Prize Scholarship of Nanjing University of Science and Technology 2017, 2018
  • Excellent Undergraduate Thesis of Jiangsu Province 2018
  • Top Ten Outstanding Youth of Nanjing Forestry University 2017
  • The Second prize of National University Students Computer Design Competition 2016
  • The National Encouragement Scholarship 2014, 2015, 2016
  • Merit Student of Nanjing Forestry University 2014, 2015, 2016

Grants

  • 国家自然科学基金面上项目, 2025.1-2028.12
  • 国家自然科学基金青年科学基金项目, 2024.1-2024.12
  • 国家资助博士后项目, 2023-2025
  • 中国博士后科学基金第73批面上资助, 2023-2025
  • 中国博士后科学基金特别资助, 2023-2025
  • 江苏省卓越博士后资助, 2023-2025
  • 中央高校基本科研业务费-揭榜挂帅, 2023
  • 中央高校基本科研业务费-揭榜挂帅, 2024

Professional Services

  • 中国图像图形学会多媒体专业委员会委员
  • Reviewer for CVPR/ICCV/ECCV/NeurIPS/AAAI/IJCAI/MM, TPAMI/TIP/TNNLS/TCSVT/PR/Neurocomputing/Information Sciences.
Source stolen from here