I am a PhD student at the University of Technology Sydney (UTS), supervised by Prof. Chengqi Zhang and Dr Jing Jiang. Before joining UTS, I was a visiting scholar at the Southern University of Science and Technology (SUSTech), working with Dr Jing Jiang and Prof. Xuan Song. I received my Master’s Degree and Bachelor’s Degree from the School of Data and Computer Science, Sun Yat-sen University (SYSU) in 2020 and 2017 respectively, under the supervision of Prof. Chang-Dong Wang.

• 🎓 Google Scholar
• 📘 Zhihu
• 🌵 Github
• 👨‍🎓 CV
• 🤝 Linkedin

Research

My current research focuses on causal reinforcement learning (RL), an emerging subfield of RL that incorporates prior knowledge and assumptions to analyze the underlying causal mechanisms of actions and their consequences. By harnessing causal relationships, agents gain insights into complex environments and tasks, facilitating informed decision-making. If you share my enthusiasm for this exciting topic and are interested in collaboration or exploring research ideas, please feel free to reach out to me！ 😉

News

• Our survey paper on causal reinforcement learning is accepted by Transactions on Machine Learning Research!
• Our paper on offline RL is accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (CORE A*, IF=24.314)!
• We just present a tutorial on causal reinforcement learning at ADMA 2023. Please check our presentation here.
• Our survey paper on causal reinforcement learning is now available on arxiv.
• One new paper on offline RL is on arxiv now.
• One paper on offline RL has been accepted by ICLR 2022 (Spotlight).
• One paper on session-based recommender systems has been accepted by TNNLS (SCI Q1).
• One paper on deep learning-based recommender systems has been accepted by AAAI 2019 (Oral).
• Our paper on serendipitous recommendation was accepted by TCYB (SCI Q1).