Rui Yan

PhD student
School of Computer Science and Engineering, Nanjing University of Science and Technology
Office: Room 2003, CSE Building
Email: ruiyan _at_ njust.edu.cn
CV • Google Scholar • Github • Twitter

Intro

I am a Ph.D. student at Intelligent Media Analysis Group (IMAG) supervised by Prof. Jinhui Tang. From Jan. 2022, I will work as a Research Intern (Part-time) at ByteDance with Song Bai. During Sep. 2021 - Dec. 2021, I worked as a Research Intern (Part-time) at Tencent with Yixiao Ge. During Dec. 2018 - Dec. 2019, I worked as a Research Intern at HUAWEI NOAH'S ARK LAB, supervised by Lingxi Xie and Prof. Qi Tian (IEEE Fellow). Now, I am working closely with Mike Shou, and Xiangbo Shu. My research mainly focuses on Complex Activity Understanding and Video-Language Understanding.

News

2022.06: Our team achieves the First Place Award in Object State Change Classification Track, the Second Place Award in Natural Language Queries for Episodic Memory Track, and the Third Place Award in PNR Temporal Localization Track of EGO4D Challenge (CVPR 2022).
2022.06: Our team achieves the First Place Award in Multi-Instance Action Retrieval Track of EPIC-Kitchens Dataset Challenges (CVPR 2022).
2022.03: Two papers are accepted by CVPR 2022.
2022.01: One paper is accepted by TCSVT.
2021.12: I give a talk about Video-Language Pre-training at PCG, Tencent.
2021.08: I will work with Prof. Mike Shou at Show Lab, National University of Singapore.
2020.05.19: One paper is accepted by TNNLS.
2020.12.08: One paper is accepted by ACM MM Asia 2020.
2020.10.20: One paper is accepted by T-PAMI.
2020.07.03: One paper is accepted by ECCV 2020.
2020.05: Selected as the Outstanding PhD of NJUST.
2019.05: I give a talk about GAR at the Noah's Ark Lab, Huawei Inc.

All Publications

Selected Publications

2020

Dual-AI: Dual-path Actor Interaction Learning for Group Activity Recognition
Mingfei Han, David Junhao Zhang, Yali Wang, Rui Yan, Lina Yao, Xiaojun Chang, and Yu Qiao
CVPR 2022 (Oral)
[PDF][Code]

Object-aware Video-language Pre-training for Retrieval
Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, and Mike Zheng Shou
CVPR 2022
[PDF][Code]

Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition
Xiangbo Shu, Jiawen Yang, Rui Yan (Corresponding Author), and Yan Song
TCSVT
[PDF]

Interactive Fusion of Multi-level Features for Compositional Activity Recognition
Rui Yan, Lingxi Xie, Xiangbo Shu, and Jinhui Tang
Under Review, 2020
[PDF][Code]

HiGCIN: Hierarchical Graph-based Cross Inference Network for Group Activity Recognition
Rui Yan, Lingxi Xie, Jinhui Tang, Xiangbo Shu, and Qi Tian
IEEE T-PAMI, 2020
[PDF][Code]

Social Adaptive Module for Weakly-supervised Group Activity Recognition
Rui Yan, Lingxi Xie, Jinhui Tang, Xiangbo Shu, and Qi Tian
ECCV 2020
[PDF][Project][Code]

Coherence Constrained Graph LSTM for Group Activity Recognition
Jinhui Tang, Xiangbo Shu, Rui Yan, and Liyan Zhang
IEEE T-PAMI, 2019
[PDF]

Participation-Contributed Temporal Dynamic Model for Group Activity Recognition
Rui Yan, Jinhui Tang, Xiangbo Shu, Zechao Li and Qi Tian
ACM MM 2018 (Oral) ~8.5% (Journal version is accepted by TNNLS)
[PDF][Code][Slides]

Honors

The Outstanding PhD of Nanjing University of Science and Technology 2020
ACM Multimedia Student Travel Grant 2018
The First Prize Scholarship of Nanjing University of Science and Technology 2017, 2018
Excellent Undergraduate Thesis of Jiangsu Province 2018
Top Ten Outstanding Youth of Nanjing Forestry University 2017
The Second prize of National University Students Computer Design Competition 2016
The National Encouragement Scholarship 2014, 2015, 2016
Merit Student of Nanjing Forestry University 2014, 2015, 2016

Professional Services

TPC for IEEE MIPR 2020 and BigMM 2021.
Reviewer for Information Sciences, TIP, TNNLS, TCSVT, PR, Neurocomputing, Multimedia Systems, The Visual Computer, KSII Transactions on Internet and Information Systems.
Reviewer for ECCV 2022, CVPR 2022, ICCV 2021, IJCNN 2021/2022, PCM 2018, ICMBD 2018.