I am now an associate professor at Institute of Automation, Chinese Academy of Sciences. I received my PhD from the University of Chinese Academy of Sciences (UCAS) in 2016. My advisor is Prof. Jun Zhao. My research areas are natural language processing, knowledge graph and large language model and mainly focus on question answering, knowledge reasoning and collaborative learning of large and small models.
I have published over 60 papers in top international conferences and journals such as ACL, NeurIPS, AAAI, ICLR, EMNLP, and Google Scholar has cited more than 7800 times, 2 papers were selected as Paper Digest High Impact Papers and won the Best Paper Award multiple times (NLP-NABD 2016, CCKS 2019).
🔥 News
- 2024.09: 🎉 One paper is accepted by NeurIPS 2024.
- 2024.09: 🎉 Four papers are accepted by EMNLP 2024.
- 2024.06: 🎉 Our organized workshop on “Bridging Neurons and Symbols for NLP and Knowledge Graph Reasoning” has been accepted by COLING 2025.
- 2024.05: 🎉 Two papers are accepted by ACL 2024.
- 2024.03: 🎉 One paper is accepted by ICLR 2024.
📝 Publications
2024
NeurIPS 2024
From Instance Training to Instruction Learning: Task Adapters Generation from Instructions, Huanxuan Liao, Shizhu He, Yao Xu, Yuanzhe Zhang, Yanchao Hao, Shengping Liu, Kang Liu, Jun Zhao.EMNLP 2024
Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering, Yao Xu, Shizhu He, Jiabei Chen, Zihao Wang, Yangqiu Song, Hanghang Tong, Guang Liu, Jun Zhao, Kang Liu.EMNLP 2024
DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models, Yiming Huang, Jianwen Luo, Yan Yu, Yitong Zhang, Fangyu Lei, Yifan Wei, Shizhu He, Lifu Huang, Xiao Liu, Jun Zhao, Kang Liu.EMNLP 2024
Does Large Language Model Contain Task-Specific Neurons?, Ran Song, Shizhu He, Shuting Jiang, Yantuan Xian, Shengxiang Gao, Kang Liu, Zhengtao Yu.EMNLP 2024
Instance-Level Dynamic LoRAs Composition for Cross-Task Generalization, WangZhiqi, Shizhu He, Kang Liu, Jun Zhao.ACL 2024
Teaching Small Language Models to Reason for Knowledge-Intensive Multi-Hop Question Answering, Xiang Li, Shizhu He, Fangyu Lei, Jun Yang, Tianhuang Su, Kang Liu, Jun Zhao.ACL 2024
ItD: Large Language Models Can Teach Themselves Induction through Deduction, Wangtao Sun, Haotian Xu, Xuanqing Yu, Pei Chen, Shizhu He, Jun Zhao, Kang Liu.ICLR 2024
Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural Networks, Yixuan Weng, Minjun Zhu, Fei Xia, Bin Li, Shizhu He, Kang Liu, Jun Zhao.NAACL 2024
S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model, Fangyu Lei, Qian Liu, Yiming Huang, Shizhu He, Jun Zhao, Kang Liu.COLING 2024
MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts, Xiang Li, Shizhu He, Jiayu Wu, Zhao Yang, Yao Xu, Jun Yang, Haifeng Liu, Kang Liu, Jun Zhao.COLING 2024
Towards Graph-hop Retrieval and Reasoning in Complex Question Answering over Textual Database, Minjun Zhu, Yixuan Weng, Shizhu He, Kang Liu, Haifeng Liu, Jun Yang, Jun Zhao.COLING 2024
BP4ER: Bootstrap Prompting for Explicit Reasoning in Medical Dialogue Generation, Yuhong He, Yongqi Zhang, Shizhu He, Jun Wan.JCST
Unsupervised Domain Adaptation on Sentence Matching Through Self-Supervision, Guirong Bai, Qingbin Liu, Shizhu He, Kang Liu, Jun Zhao.
2023
JAS
A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development, Tianyu Wu, Shizhu He, Jingping Liu, Siqi Sun, Kang Liu, Qing-Long Han, Yang Tang.EMNLP 2023
Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs, Yao Xu, Shizhu He, Cunguang Wang, Li Cai, Kang Liu, Jun Zhao.EMNLP 2023
Large Language Models are Better Reasoners with Self-Verification, Yixuan Weng, Minjun Zhu, Fei Xia, Bin Li, Shizhu He, Shengping Liu, Bin Sun, Kang Liu, Jun Zhao.EMNLP 2023
ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook, Wangtao Sun, Xuanqing Yu, Shizhu He, Jun Zhao, Kang Liu, Jun Zhao.EMNLP 2023
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models, Zhiyuan Fan, Shizhu He.EMNLP 2023
Bipartite Graph Pre-training for Unsupervised Extractive Summarization with Graph Convolutional Auto-Encoders, Qianren Mao, Shaobo Zhao, Jiarui Li, Xiaolei Gu, Shizhu He, Bo Li, Jianxin Li.CoNLL 2023
On the Effects of Structural Modeling for Neural Semantic Parsing, Xiang Zhang, Shizhu He, Kang Liu, Jun Zhao.ACL 2023
Prediction and Calibration: Complex Reasoning over Knowledge Graph with Bi-directional Directed Acyclic Graph Neural Network, Yao Xu, Shizhu He, Li Cai, Kang Liu, Jun Zhao.ACL 2023
Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints, Ran Song, Shizhu He, Shengxiang Gao, Li Cai, Kang Liu, Zhengtao Yu, Jun Zhao.ACL 2023
S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering, Fangyu Lei, Xiang Li, Yifan Wei, Shizhu He, Yiming Huang, Jun Zhao, Kang Liu.ACL 2023
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks, Qingbin Liu, Yanchao Hao, Xiaolong Liu, Bo Li, Dianbo Sui, Shizhu He, Kang Liu, Jun Zhao, Xi Chen, Ningyu Zhang, Jiaoyan Chen.ICASSP 2023
Learning to Build Reasoning Chains by Reliable Path Retrieval, Minjun Zhu, Yixuan Weng, Shizhu He, Cunguang Wang, Kang Liu, Li Cai, Jun Zhao.EACL 2023
Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model, Fei Xia, Yixuan Weng, Shizhu He, Kang Liu, Jun Zhao.TALLIP
Bidirectional Sentence Ordering with Interactive Decoding, Guirong Bai, Shizhu He, Kang Liu, Jun Zhao.JCST
Unsupervised Dialogue State Tracking for End-to-End Task-Oriented Dialogue with a Multi-Span Prediction Network, Qingbin Liu, Shizhu He, Cao Liu, Kang Liu, Jun Zhao.
2022
EMNLP 2022
MedConQA: Medical Conversational Question Answering System based on Knowledge Graphs, Fei Xia, Bin Li, Yixuan Weng, Shizhu He, Kang Liu, Bin Sun, Shutao Li, Jun Zhao.ACL 2022
Leveraging Explicit Lexico-logical Alignments in Text-to-SQL Parsing, Runxin Sun, Shizhu He, Chong Zhu, Yaohan He, Jinlong Li, Jun Zhao, Kang Liu.ACL 2022
Incremental intent detection for medical domain with contrast replay networks, Guirong Bai, Shizhu He, Kang Liu, Jun Zhao.COLING 2022
Decoupling Mixture-of-Graphs: Unseen Relational Learning for Knowledge Graph Completion by Fusing Ontology and Textual Experts, Ran Song, Shizhu He, Suncong Zheng, Shengxiang Gao, Kang Liu, Zhengtao Yu, Jun Zhao.COLING 2022
Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder, Fangyu Lei, Shizhu He, Xiang Li, Jun Zhao, Kang Liu.
2021
EMNLP 2021
Domain-lifelong learning for dialogue state tracking via knowledge preservation networks, Qingbin Liu, Pengfei Cao, Cao Liu, Jiansong Chen, Xunliang Cai, Fan Yang, Shizhu He, Kang Liu, Jun Zhao.TALLIP
Using Pre-trained Language Model to Enhance Active Learning for Sentence Matching, Guirong Bai, Shizhu He, Kang Liu, Jun Zhao.JCST
A Unified Shared-Private Network with Denoising for Dialogue State Tracking, Qingbin Liu, Shizhu He, Kang Liu, Shengping Liu, Jun Zhao.KBS
Heterogeneous relational graph neural networks with adaptive objective for end-to-end task-oriented dialogue, Qingbin Liu, Guirong Bai, Shizhu He, Cao Liu, Kang Liu, Jun Zhao.BMC
Path-based knowledge reasoning with textual semantic information for medical knowledge graph completion, Yinyu Lan, Shizhu He, Xiangrong Zeng, Shengping Liu, Kang Liu, Jun Zhao.
2020
COLING 2020
Pre-trained Language Model Based Active Learning for Sentence Matching, Guirong Bai, Shizhu He, Kang Liu, Jun Zhao, Zaiqing Nie.
2019
AAAI 2019
Learning to Align Question and Answer Utterances in Customer Service Conversation with Recurrent Pointer Networks, Shizhu He, Kang Liu, Weiting An.EMNLP 2019
Learning the Extraction Order of Multiple Relational Facts in a Sentence with Reinforcement Learning, Xiangrong Zeng, Shizhu He, Daojian Zeng, Kang Liu, Shengping Liu, Jun Zhao.EMNLP 2019
Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss, Cao Liu, Kang Liu, Shizhu He, Zaiqing Nie, Jun Zhao.CoNLL 2019
Incorporating Interlocutor-Aware Context into Response Generation on Multi-Party Chatbots, Cao Liu, Kang Liu, Shizhu He, Zaiqing Nie, Jun Zhao.ACL 2019
Vocabulary Pyramid Network: Multi-Pass Encoding and Decoding with Multi-Level Vocabularies for Response Generation, Cao Liu, Shizhu He, Kang Liu, Jun Zhao.ACL 2019
AdaNSP: Uncertainty-driven adaptive decoding in neural semantic parsing, Xiang Zhang, Shizhu He, Kang Liu, Jun Zhao.
2018
AAAI 2018
Large Scaled Relation Extraction With Reinforcement Learning, Xiangrong Zeng, Shizhu He, Kang Liu, Jun Zhao.IJCAI 2018
Curriculum Learning for Natural Answer Generation, Cao Liu, Shizhu He, Kang Liu, Jun Zhao.ACL 2018
Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism, Xiangrong Zeng, Daojian Zeng, Shizhu He, Kang Liu, Jun Zhao.COLING 2018
Pattern-revising Enhanced Simple Question Answering over Knowledge Bases, Yanchao Hao, Hao Liu, Shizhu He, Kang Liu, Jun Zhao.
2017
ACL 2017
Generating Natural Answers by Incorporating Copying and Retrieving Mechanisms in Sequence-to-Sequence Learning, Shizhu He, Cao Liu, Kang Liu, Jun Zhao.ACL 2017
An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge, Yanchao Hao, Yuanzhe Zhang, Kang Liu, Shizhu He, Zhanyi Liu, Hua Wu, Jun Zhao.EACL 2017
Which is the Effective Way for Gaokao: Information Retrieval or Neural Networks?, Shangmin Guo, Xiangrong Zeng, Shizhu He, Kang Liu, Jun Zhao.AAAI 2017
Distant Supervision for Relation Extraction with Sentence-Level Attention and Entity Descriptions,Guoliang Ji, Kang Liu, Shizhu He, Jun Zhao.
2016 and Before
EMNLP 2016
Learning to Represent Review with Tensor Decomposition for Spam Detection, Xuepeng Wang, Kang Liu, Shizhu He, Jun Zhao.ACL 2016
Leveraging FrameNet to Improve Automatic Event Detection, Shulin Liu, Yubo Chen, Shizhu He, Kang Liu, Jun Zhao.IJCAI 2016
Employing External Rich Knowledge for Machine Comprehension, Bingning Wang, Shangmin Guo, Kang Liu, Shizhu He, Jun Zhao.Intelligent Systems
How to Generate a Good Word Embedding, Siwei Lai, Kang Liu, Shizhu He, Jun Zhao.AAAI 2016
A Probabilistic Soft Logic Based Approach to Exploiting Latent and Global Information in Event Classification, Shunlin Liu, Kang Liu, Shizhu He, Jun Zhao..AAAI 2016
A Joint Model for Question Answering over Multiple Knowledge Bases, Yuanzhe Zhang, Shizhu He, Kang Liu, Jun Zhao.AAAI 2016
Knowledge Graph Completion with Adaptive Sparse Transfer Matrix, Guoliang Ji, Kang Liu, Shizhu He, Jun Zhao.CIKM 2015
Learning to Represent Knowledge Graphs with Gaussian Embedding, Shizhu He, Kang Liu, Guoliang Ji, Jun Zhao.Intelligent Systems
Question Answering over Knowledge Bases, Kang Liu, Jun Zhao, Shizhu He, Yuanzhe Zhang.ACL 2015
Knowledge Graph Embedding via Dynamic Mapping Matrix, Guoliang Ji, Shizhu He, Liheng Xu, Kang Liu, Jun Zhao.EMNLP 2014
Question Answering over Linked Data Using First-order Logic, Shizhu He, Kang Liu, Yuanzhe Zhang, Liheng Xu, Jun Zhao.
🎓 Educations
- 2012.09 - 2016.06, Institute of Automation, Chinese Academy of Sciences, Pattern Recognition and Intelligent System, Beijing, Ph.D.
- 2008.09 - 2011.06, Jiangxi Normal University, School of Computer Information Engineering, Nanchang, Jiangxi, Master.
🌴 Teaching
- 2024-2025, Knowledge Engineering (undergraduate), University of Chinese Academy of Sciences.
- 2023-2024, Knowledge Engineering (undergraduate), University of Chinese Academy of Sciences.
- 2022-2023, Knowledge Graph (postgraduate), University of Chinese Academy of Sciences.
- 2021-2022, Knowledge Graph (postgraduate), University of Chinese Academy of Sciences.
- 2020-2021, Knowledge Graph (postgraduate), University of Chinese Academy of Sciences (Excellent courses at the school level).
- 2019-2020, Knowledge Graph and Semantic Computing (postgraduate), University of Chinese Academy of Sciences (Excellent courses at the college level).
- 2018-2019, Knowledge Graph and Semantic Computing (postgraduate), University of Chinese Academy of Sciences.
- 2017-2018,Natural Language Processing in Deep Learning: Theory and Practice (postgraduate), University of Chinese Academy of Sciences.
♻️ Books
- Knowledge Graph, Higher Education Press, 2018-10, 3rd author.
- Natural Language Processing, Higher Education Press, 2021-11, chapter author.
- Knowledge Graph: Algorithms and Practices, Higher Education Press, 2022-03, 3rd author.