About me
I'm a 1st-year PhD student at the Legal Tech group of Technical University of Munich (TUM), under the supervision of Prof. Matthias Grabmair. My research interests include (Legal) Information Retrieval for Large Language Models, Multi-agent System, and Large Reasoning Models.
Before that, I obtained my master's degree in Robotics, Cognition, Intelligence at Technical University of Munich (TUM) and my bachelor's degree in Mechanical Engineering at Southeast University, Nanjing, China.
Research Interests
- (Legal) Information Retrieval for Large Language Models – Efficient retrieval and ranking tailored to legal domains.
- Multi-Agent Systems – Coordinated, distributed reasoning and task execution among intelligent agents.
- Large Reasoning Models – Developing models for improved logical reasoning capabilities, especially in legal scenarios.
News
Feb. 2025 - The preprint of my master thesis: "On Relation-Specific Neurons in Large Language Models" is available on arXiv!
Previous Projects
Detecting Multi-Lingual Relation Specific Neurons in LLMs
Ludwig-Maximilians-Universität | 07.2024 - 02.2025 | Master Thesis
Large Language Models, Mechanistic Interpretability, Multilingual NLP
- Identification and characterization of neurons that store explicit knowledge about semantic relations, with a particular focus on multilingual contexts.
- Development of a methodological pipeline for localizing relation-specific neurons using a tailored dataset and validation by controlled generation experiments.
- Detailed analysis of the neuronal activation patterns in the Llama-2 (7B & 13B) model to examine their distribution and inherent properties.
- Achievements: Creation of a comprehensive relation-specific neuron set for Llama-2 model and a planned submission to a top NLP conference.