Biography

I am currently a researcher at Shanghai AI Lab, focusing on the research of multimodal large language models and multimodal data algorithms. Prior to joining Shanghai AI Lab, I was engaged in data algorithm research at SenseTime Group Inc. (2020-2022). I obtained my Ph.D. from the University of Chinese Academy of Sciences in 2020. Between 2018 and 2019, I participated in the National Natural Science Foundation of China’s joint Ph.D. training program at the University of Central Florida, under the supervision of Professors Yongdong Zhang and Guo-Jun Qi.

🔥 News

• 2024.09:  🎉🎉 InternLM-XComposer2-4KHD is accepted by NeurIPS 2024.
• 2024.07:  🔥🔥🔥 has received 3500+ GitHub stars within one month.

• 2024.07:  🔥🔥🔥 has received 4200+ GitHub stars and ranked #1 on the GitHub Trending list.

• 2024.07:  🎉🎉 CLIP-Parrot-Bias is accepted by ECCV 2024 (Oral).
• 2024.02:  🎉🎉 OPERA is accepted by CVPR 2024.
• 2023.12:  🎉🎉 VIGC is accepted by AAAI 2024.
• 2023.12:  🎉🎉 One paper is accepted by IJAEOG 2024.
• 2023.08:  🎉🎉 DropQueries is accepted by TMM 2023.
• 2023.08:  🎉🎉 V3Det is accepted by ICCV 2023 (Oral).

🚀 Project

Github Repo

PDF-Extract-Kit: A Comprehensive Toolkit for High-Quality PDF Content Extraction

Models(Hugging Face) | Models(ModelScope) | Github

Github Repo

MinerU: An Open-Source Solution for Precise Document Content Extraction | Github

📝 Publications

ECCV 2024

Parrot Captions Teach CLIP to Spot Text

Yiqi Lin^*, Conghui He^*, Alex Jinpeng Wang^*, Bin Wang^*, Weijia Li, Mike Zheng Shou

ECCV 2024 Oral, | Project | Github

AAAI 2024

VIGC: Visual Instruction Generation and Correction

Bin Wang, Fan Wu, Xiao Han, Jiahui Peng, Huaping Zhong, Pan Zhang, Xiaoyi Dong, Weijia Li, Wei Li, Jiaqi Wang, Conghui He

AAAI 2024, | Project | Github

IJAEOG 2024

Exploring the user guidance for more accurate building segmentation from high-resolution remote sensing images

Dinghao Yang^*, Bin Wang^*, Weijia Li, Conghui He

IJAEOG 2024, | Github

TMM 2023

DropQueries: A Simple Way to Discover Comprehensive Segment Representations

Haojie Ding, Bin Wang, Guoliang Kang, Weijia Li, Conghui He, Yao Zhao, and Yunchao Wei

TMM 2023

ICCV 2023

V3Det: Vast Vocabulary Visual Detection Dataset

Jiaqi Wang, Pan Zhang, Tao Chu, Yuhang Cao, Yujie Zhou, Tong Wu, Bin Wang, Conghui He, and Dahua Lin

ICCV 2023 Oral, | Project | Github

IJCAI 2019

Boundary perception guidance: A scribble-supervised semantic segmentation approach

Bin Wang, Guojun Qi, Sheng Tang, Tianzhu Zhang, Yunchao Wei, Linghui Li, and Yongdong Zhang

IJCAI 2019

MICCAI 2019

Spatiotemporal Breast Mass Detection Network(MD-Net) in 4D DCE-MRI Images

Lixi Deng, Sheng Tang, Huazhu Fu, Bin Wang, and Yongdong Zhang

MICCAI 2019

MICCAI 2018

Automated pulmonary nodule detection: High sensitivity with few candidates

Bin Wang, Guojun Qi, Sheng Tang, Liheng Zhang, Lixi Deng, and Yongdong Zhang

MICCAI 2018

🎖 Honors and Awards

• 2020.06, Zhu Li Yuehua Outstanding Ph.D. student Scholarship, Chinese Academy of Sciences (CAS).
• 2016.09, Won 3rd place in the ILSVRC 2016 VID task (Object Detection from Video).

🏢 Work Experience

• 2020.07 - 2022.08, Researcher, SenseTime, Shenzhen, China.

📖 Education

• 2015.09 - 2020.06, Ph.D., University of Chinese Academy of Sciences, Beijing, China.
• 2013.09 - 2015.06, M.S., Beijing Jiaotong University, Beijing, China.