Summary

I am a first year MIIS (Master of Science in Intelligent Information Systems) student in the Language Technologies Institute at Carnegie Mellon University. My research interest is using NLP technologies to understand social problems and improve human well-being. I am currently working with Professor Mona Diab on responsible AI at Carnegie Mellon University. Previously I worked in the LIT group at the University of Michigan, advised by Professor Rada Mihalcea and Zhijing Jin. In addition, I have also had a great time working with Professor Wei Hu on improving the worst-group robustness.

Interests
  • Large Language Models
  • NLP for Social Good
  • Robust, trustworthy and fair NLP
Education
  • Master of Science in Intelligent Information Systems, Sept 2023 - Dec 2024 (Expected)

    Carnegie Mellon University, Pittsburgh

  • BSE in Computer Science, Sept 2021 - May 2023

    University of Michigan, Ann Arbor

  • BSE in Electrical and Computer Engineering, Sept 2019 - Aug 2023

    Shanghai Jiao Tong University

Projects

*
FAD: Feature Alignment Discriminator for Abstractive Text Summarization
EECS-487 Natural language processing course project.
Existing abstractive approaches for automatic text summarization have shown low preciseness and coherence in their generated summaries. In this project, we present a special fine-tuning process for text generators like BART with the FAD, the Feature Alignment Discriminator. We propose that with the token replacement detecting mechanism in feature space, the FAD greatly addresses problems of discreteness in adversarial learning for NLP and better captures the word distribution of the original texts. With extensive experiments, we find that using the first layer of BART decoder as the feature results in better performance. It is also shown that on the DailyMail/CNN dataset, that our FAD model outperforms BART base model in by 0.2 perplexity score and 0.3-0.5% ROUGE score and matches the S.O.T.A R-Drop model. We claim that the FAD structure has shown great applicability and can be used for other general text generation tasks.
FAD: Feature Alignment Discriminator for Abstractive Text Summarization
Prior factors of a Food System: Money or Balance? Case Studies on China, USA, and Ethiopia
Finalist Winner in (Top 2%) in the Interdisciplinary Contest in Modelling, 2021.
Prior factors of a Food System: Money or Balance? Case Studies on China, USA, and Ethiopia