Yu Liu's academic page
News
Job positions and PhD program are open for talents interested in AIGC, super HUGE model for NLP and CV and Game AI.
[2023] Our OpenDILab achieves 10,000+ stars on GitHub!
[2023] We release our AIGC service MiaoHua , have a try!
[2023] My team have 18 papers published on TPAMI/ICCV/ICLR/NeurIPS/IROS/AAAI in 2023
[2023] My team won the championship of CARLA Autonomous Driving Challenge
[2022] My team have 9 papers published on ECCV/CoRL/NeurIPS/AAAI in 2022
[2022] We release DI-Star , an implementation of AlphaStar in pyTorch, beating pro players with 6000+ MMR.
[2021] My team won the best paper of ICCV21 MFR workshop
[2021] My team won 3 championships of ICCV21 The Masked Face Recognition Challenge
[2021] We release OpenDILab , an open source decision intelligence platform
[2020] 5 papers with 1 oral got published on CVPR/ECCV 2020
[2020] My team won 2 championships of ActivityNet on the Spatio-temporal Action Localization (AVA) track and the Trimmed Activity Recognition (Kinetics) track
[2020] My team won the championship of NIST FRVT 1:N , a 12-million-level commercial facial recognition benchmark held by US government.
Read more
[2019] 7 papers with 4 oral presentations published on ICCV/CVPR/AAAI in 2019
[2019] I won 4 champions in 4 ICCV AI challenges:MMIT (solutions ), OpenImage Instance Segmentation Challenge (solutions ), OpenImage Object Detection Challenge (solutions ), LFR 2019 (model and report )
[2019] I was granted the Google PhD Fellowship 2019 .
[2018] 4 papers published by CVPR/ECCV/IJCV/AAAI in 2018.
[2017] 6 papers published on CVPR/ICCV/NIPS/AAAI/T-PAMI in 2017.
[2016] We win the 1st place in ECCV-MOT16 Challenge! code
[2016] We win the 1st place in ImageNet Challenge 2016 ! code
About me
I am currently the Senior Director of Research in SenseTime Group, and the GM of ADG Business Unit. Previously I obtain my PhD from MMLab , CUHK, supervised by Prof. Xiaogang Wang .
When I was young, I devoted myself to various cutting-edge AI research problems and published dozens of papers in top-tier conferences. However, with a deeper understanding of technology, I am now more focused on tackling problems that can truly advance the field and make AI serve all of humanity. Therefore, since 2020, I have not been concerned with the quantity of "research papers", and have instead formed a team of over 100 researchers and product developers. With over 4,000 GPUs at our disposal, we are committed to creating top-notch technology and products based on super HUGE NLP and CV models that can serve the public. Contact me if you are interested .
Working Experience
Publications
See full list at Google Scholar .
*equal contribition + corresponding author
Teach-DETR: Better Training DETR with Teachers
Linjiang Huang, Kaixin Lu, Guanglu Song, Liang Wang, Si Liu, Yu Liu , Hongsheng Li
2023 TPAMI
RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Paths
Zeyue Xue, Guanglu Song, Qiushan Guo, Boxiao Liu, Zhuofan Zong, Yu Liu+ , Ping Luo
2023 NIPS
LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios , Code
Yazhe Niu, Yuan Pu, Zhenjie Yang, Xueyan Li, Tong Zhou, Jiyuan Ren, Shuai Hu, Hongsheng Li, Yu Liu
(Spotlight) 2023 NIPS
Theoretically Guaranteed Policy Improvement Distilled from Model-Based Planning
Chuming Li, Ruonan Jia, Jie Liu, Yinmin Zhang, Yazhe Niu, Yaodong Yang, Yu Liu , Wanli Ouyang
2023 ECAI
Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Prediction
Zhuofan Zong, Dongzhi Jiang, Guanglu Song, Zeyue Xue, Jingyong Su, Hongsheng Li, Yu Liu+
2023 ICCV
DETRs with Collaborative Hybrid Assignments Training
Zhuofan Zong, Guanglu Song, Yu Liu+
2023 ICCV
Decoupled DETR: Spatially Disentangling Localization and Classification for Improved End-to-End Object Detection
Manyuan Zhang, Guanglu Song, Yu Liu , Hongsheng Li
2023 ICCV
Masked Autoencoders Are Stronger Knowledge Distillers for Object Detectors
Shanshan Lao, Guanglu Song, Boxiao Liu, Yu Liu , Yujiu Yang
2023 ICCV
UniKD: Universal Knowledge Distillation for Mimicking Homogeneous or Heterogeneous Object Detectors
Shanshan Lao, Guanglu Song, Boxiao Liu, Yu Liu , Yujiu Yang
2023 ICCV
Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D Understanding
Jihao Liu, Tai Wang, Boxiao Liu, Qihang Zhang, Yu Liu , Hongsheng Li
2023 ICCV
Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skills
Tong Zhou, Letian Wang, Ruobing Chen, Wenshuo Wang, Yu Liu+
2023 IROS
UniFormer: Unifying Convolution and Self-Attention for Visual Recognition
Kunchang Li, Yali Wang, Junhao Zhang, Peng Gao, Guanglu Song, Yu Liu , Hongsheng Li, Yu Qiao
2023 TPAMI
Theoretically Guaranteed Policy Improvement Distilled from Model-Based Planning
Chuming Li, Ruonan Jia, JIAWEI YAO, Jie Liu, Yinmin Zhang, Yazhe Niu, Yaodong Yang, Yu Liu , Wanli Ouyang
2023 IJCAI - PRL workshop
Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors
Letian Wang, Jie Liu, Hao Shao, Wenshuo Wang, Ruobing Chen, Yu Liu+ , Steven L. Waslander
2023 RSS
ReasonNet: End-to-End Driving with Temporal and Global Reasoning
Hao Shao, Letian Wang, Ruobing Chen, Steven L. Waslander, Hongsheng Li, Yu Liu+
(CARLA 2022 Champion) 2023 CVPR
MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers
Jihao Liu, Xin Huang, Jinliang Zheng, Yu Liu+ , Hongsheng Li
2023 CVPR
GoBigger: A Scalable Platform for Cooperative-Competitive Multi-Agent Interactive Simulation , Project , Challenge
Ming Zhang, Shenghan Zhang, Zhenjie Yang, Lekai Chen, Jinliang Zheng, Chao Yang, Chuming Li, Hang Zhou, Yazhe Niu, Yu Liu+
2023 ICLR
Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency
Chuming Li, Jie Liu, Yinmin Zhang, Yuhong Wei, Yazhe Niu, Yaodong Yang, Yu Liu+ , Wanli Ouyang
2023 AAAI
Large-batch Optimization for Dense Visual Predictions , Code
Zeyue Xue, Jianming Liang, Guanglu Song, Zhuofan Zong, Liang Chen, Yu Liu+ , Ping Luo+
2022 NeurIPS
Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer
Hao Shao, Letian Wang, Ruobing Chen, Hongsheng Li, Yu Liu+
2022 CoRL
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP
Jihao Liu, Xin Huang, Guanglu Song, Hongsheng Li+ , Yu Liu+
2022 ECCV
Self-slimmed Vision Transformer
Zhuofan Zong, Kunchang Li, Guanglu Song, Yali Wang, Yu Qiao, Biao Leng, Yu Liu+
2022 ECCV
TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers
Jihao Liu, Boxiao Liu, Hang Zhou, Hongsheng Li+ , Yu Liu+
2022 ECCV
Unifying Visual Perception by Dispersible Points Learning
Jianming Liang, Guanglu Song, Biao Leng, Yu Liu+
2022 ECCV
Towards Robust Face Recognition with Comprehensive Search
Manyuan Zhang, Guanglu Song, Yu Liu+ , Hongsheng Li
2022 ECCV
Rethinking Robust Representation Learning Under Fine-grained Noisy Faces
Bingqi Ma, Guanglu Song, Boxiao Liu, Yu Liu+
2022 ECCV
UniFormer: Unified Transformer for Efficient Spatial-Temporal Representation Learning , Code
Kunchang Li, Yali Wang, Peng Gao, Guanglu Song, Yu Liu , Hongsheng Li, Yu Qiao
2022 ICLR
Switchable K-class Hyperplanes for Noise-robust Representation Learning
Boxiao Liu, Guanglu Song, Manyuan Zhang, Haihang You, Yu Liu+
2021 ICCV
Actor-Context-Actor Relation Network for Spatio-Temporal Action Localization
Junting Pan, Siyu Chen, Mike Zheng Shou, Yu Liu , Jing Shao, Hongsheng Li
2021 CVPR
Discriminability Distillation in Group Representation Learning
Manyuan Zhang, Guanglu Song, Hang Zhou, Yu Liu+
2020 ECCV
Learning Where to Focus for Efficient Video Object Detection
Zhengkai Jiang, Yu Liu+ , Ceyuan Yang, Jihao Liu, Gao Peng, Qian Zhang, Shiming Xiang, Chunhong Pan
2020 ECCV
Search to Distill: Pearls are Everywhere but not the Eyes
Yu Liu , Xuhui Jia, Mingxing Tan, Raviteja Vemulapalli, Yukun Zhu, Bradley Green, Xiaogang Wang
(Oral) 2020 CVPR
Revisiting the Sibling Head in Object Detector
Guanglu Song, Yu Liu+ , Xiaogang Wang
(OpenImage 2019 Champion) 2020 CVPR
Rotate-and-Render: Unsupervised Photorealistic Face Rotation from Single-View Images
Hang Zhou, Jihao Liu, Ziwei Liu, Yu Liu+ , Xiaogang Wang
2020 CVPR
KPNet: Towards Minimal Face Detector
Guanglu Song, Yu Liu+ , Yuhang Zang, Xiaogang Wang, Biao Leng, Qingsheng Yuan
(Oral) 2020 AAAI
Temporal Interlacing Network
Hao Shao, Shengju Qian, Yu Liu+
2020 AAAI
Differentiable Kernel Evolution
Yu Liu , Jihao Liu, Ailing Zeng, Xiaogang Wang
2019 IEEE ICCV
Towards Flops-constrained Face Recognition , Code
Yu Liu* , Guanglu Song*, Manyuan Zhang*, Jihao Liu*, Yucong Zhou, Junjie Yan
(Top-1 Solution) 2019 ICCV Lightweight Face Recognition Challenge & Workshop
Gradient Harmonized Single-stage Detector ,Code
Buyu Li*, Yu Liu* , Xiaogang Wang
(Oral) 2019 AAAI
Conditional Adversarial Generative Flow for Controllable Image Synthesis
Rui Liu, Yu Liu , Xinyu Gong, Xiaogang Wang, Hongsheng Li
2019 CVPR
Exploring Disentangled Feature Representation Beyond Face Identification
Yu Liu , Fangyin Wei, Jing Shao, Lv Sheng, Junjie Yan, Xiaogang Wang
2018 CVPR
Transductive Centroid Projection for Semi-supervised Large-scale Recognition
Yu Liu , Guanglu Song, Jing Shao, Xiao Jin, Xiaogang Wang
2018 ECCV
Rethinking Feature Discrimination and Polymerization for Large-scale Recognition
Yu Liu , Hongyang Li, Xiaogang Wang
2017 NIPS deep learning workshop
Recurrent Scale Approximation for Object Detection in CNN , Code
Yu Liu , Hongyang Li, Junjie Yan et al.
2017 IEEE ICCV
Beyond Trade-off: Accelerate FCN-based Face Detector with Higher Accuracy
Guanglu Song*, Yu Liu* , Ming Jiang, Yujie Wang, Junjie Yan, Biao Leng
2018 CVPR
Quality Aware Network for Set to Set Recognition , Code
Yu Liu , Junjie Yan, Wanli Ouyang
2017 CVPR
Knowledge Distillation via Route Constrained Optimization
Xiao Jin, Baoyun Peng, Yichao Wu, Yu Liu , Jiaheng Liu, Ding Liang, Junjie Yan, Xiaolin Hu
(Oral) 2019 IEEE ICCV
Correlation Congruence for Knowledge Distillation
Baoyun Peng, Xiao Jin, Jiaheng Liu, Shunfeng Zhou, Yichao Wu, Yu Liu , Dongsheng Li, Zhaoning Zhang
2019 IEEE ICCV
Talking Face Generation by Adversarially Disentangled Audio-Visual Representation , Code
Hang Zhou, Yu Liu , Ziwei Liu, Ping Luo, Xiaogang Wang
(Oral) 2019 AAAI
Zoom Out-and-In Network with Map Attention Decision for Region Proposal and Object Detection , Code
Hongyang Li, Yu Liu , W Ouyang, X Wang
2018 IJCV
Region-based Quality Estimation Network for Large-Scale Person Re-identification
Guanglu Song, Biao Leng, Yu Liu , Congrui Hetang, Shaofan Cai
2018 AAAI
Learning Deep Features via Congenerous Cosine Loss for Person Recognition , Code
Yu Liu , Hongyang Li, Xiaogang Wang
arxiv:1702.06890, 2017
Scale-Aware Face Detection
Zekun Hao, Yu Liu , Hongwei Qin, Junjie Yan
2017 CVPR
POI: Multiple Object Tracking with High Performance Detection and Appearance Feature
F Yu, W Li, Q Li, Y Liu , X Shi, J Yan
(Top-1 Solution) 2016 ECCV workshop
Crafting GBD-Net for Object Detection
X Zeng, W Ouyang, J Yan, H Li, T Xiao, K Wang, Y Liu , Y Zhou, B Yang, ...
T-PAMI
3D object understanding with 3D Convolutional Neural Networks
B Leng, Y Liu , K Yu, X Zhang, Z Xiong
Information Sciences 366, 188-201, 2016
Projects & Datasets
GitHub
OpenDILab , a generalized Decision Intelligence engine.
X-Temporal , Easily implement SOTA video understanding methods with PyTorch on multiple machines and GPUs
CaffeMex v2.3 , a multi-GPU & memory-reduced MAT-Caffe on LINUX and WINDOWS
Labeled Pedestrains in the Wild ,a large scale pedestrain re-identification benchmark