Junyi Jessy Li

Publications

• QuaLLM-Health: An Adaptation of an LLM-Based Framework for Quantitative Data Extraction from Online Health Discussions
  Ramez Kouzy, Roxanna Attar-Olyaee, Michael K Rooney, Comron J Hassanzadeh, Junyi Jessy Li and Osama Mohamad
  ArXiv 2024

• Generating Exceptional Behavior Tests with Large Language Models
  Jiyang Zhang, Yu Liu, Pengyu Nie, Junyi Jessy Li and Milos Gligoric
  International Conference on Software Engineering (ICSE), 2025 (to appear)

• Which questions should I answer? Salience Prediction of Inquisitive Questions [repo]
  Yating Wu, Ritika Mangla, Alexandros G. Dimakis, Greg Durrett and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024 (Outstanding Paper Award)

• Detection and Measurement of Syntactic Templates in Generated Text [webpage]
  Chantal Shaib, Yanai Elazar, Junyi Jessy Li and Byron Wallace
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024

• Do they mean ‘us’? Interpreting Referring Expressions in Intergroup Bias [repo]
  Venkata S Govindarajan, Matianyu Zang, Kyle Mahowald, David Beaver and Junyi Jessy Li
  Findings of EMNLP, 2024

• Learning to Refine with Fine-Grained Natural Language Feedback [repo]
  Manya Wadhwa, Xinyu Zhao, Junyi Jessy Li and Greg Durrett
  Findings of EMNLP, 2024

• Interpretable by Design: Wrapper Boxes Combine Neural Performance with Faithful Explanations [repo]
  Yiheng Su, Junyi Jessy Li and Matthew Lease
  Workshop on analyzing and interpreting neural networks for NLP (BlackboxNLP), 2024

• Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning CodeLLMs
  Zichao Hu, Junyi Jessy Li, Arjun Guha and Joydeep Biswas
  ArXiv 2024

• Using Natural Language Explanations to Rescale Human Judgments [code and data]
  Manya Wadhwa, Jifan Chen, Junyi Jessy Li and Greg Durrett
  Conference on Language Modeling (COLM), 2024

• Large Language Models are Capable of Offering Cognitive Reappraisal, if Guided [data]
  Hongli Zhan, Allen Zheng, Yoon Kyung Lee, Jina Suh, Junyi Jessy Li and Desmond C. Ong
  Conference on Language Modeling (COLM), 2024

• Large Language Models Produce Responses Perceived to be Empathic
  Yoon Kyung Lee, Jina Suh, Hongli Zhan, Junyi Jessy Li and Desmond C. Ong
  International Conference on Affective Computing and Intelligent Interaction (ACII), 2024

• FactPICO: Factuality Evaluation for Plain Language Summarization of Medical Evidence [bib] [data]
  Sebastian Joseph, Lily Chen, Jan Trienes, Hannah Louisa Göke, Monika Coers, Wei Xu, Byron C. Wallace and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2024

• InfoLossQA: Characterizing and Recovering Information Loss in Text Simplification [bib] [webpage with demo, code, data]
  Jan Trienes, Sebastian Joseph, Jörg Schlötterer, Christin Seifert, Kyle Lo, Wei Xu, Byron C. Wallace and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2024

• Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion [bib] [data]
  Smriti Singh, Cornelia Caragea and Junyi Jessy Li
  North American Chapter of the Association for Computational Linguistics (NAACL), 2024

• Sarcasm Detection in a Disaster Context [bib]
  Tiberiu Sosea, Junyi Jessy Li and Cornelia Caragea
  Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), 2024

• QUDeval: The Evaluation of Questions Under Discussion Discourse Parsing [bib] [data]
  Yating Wu, Ritika Mangla, Greg Durrett and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023

• Elaborative Simplification as Implicit Questions Under Discussion [bib] [data and code]
  Yating Wu, William Sheffield, Kyle Mahowald and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023

• Multilingual Simplification of Medical Texts [bib] [data]
  Sebastian Joseph, Kathryn Kazanas, Keziah Reina, Vishnesh J. Ramanathan, Wei Xu, Byron Wallace and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023

• Evaluating Subjective Cognitive Appraisals of Emotions from Large Language Models [bib] [data]
  Hongli Zhan, Desmond Ong and Junyi Jessy Li
  Findings of EMNLP, 2023

• Multilingual Code Co-Evolution Using Large Language Models [code]
  Jiyang Zhang, Pengyu Nie, Junyi Jessy Li and Milos Gligoric
  ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 2023

• Unsupervised Summarization of Emotion Triggers [bib] [data and code]
  Tiberiu Sosea, Hongli Zhan, Junyi Jessy Li and Cornelia Caragea
  Association for Computational Linguistics (ACL), 2023

• Summarizing, Simplifying, and Synthesizing Medical Evidence using GPT-3 (with Varying Success) [bib] [data]
  Chantal Shaib, Millicent Li, Sebastian Joseph, Iain Marshall, Junyi Jessy Li and Byron Wallace
  Association for Computational Linguistics (ACL), 2023

• Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under Discussion [bib] [code]
  Wei-Jen Ko, Yating Wu, Cutter Dalton, Dananjay Srinivas, Greg Durrett and Junyi Jessy Li
  Findings of the Association for Computational Linguistics (Findings of ACL), 2023

• Counterfactual Probing for the Influence of Affect and Specificity on Intergroup Bias [bib]
  Venkata Subrahmanyan Govindarajan, David I. Beaver, Kyle Mahowald and Junyi Jessy Li
  Findings of the Association for Computational Linguistics (Findings of ACL), 2023

• How people talk about each other: Modeling Generalized Intergroup Bias and Emotion [bib] [data and code]
  Venkata Subrahmanyan Govindarajan, Katherine Atwell, Barea Sinno, Malihe Alikhani, David I. Beaver and Junyi Jessy Li
  European Chapter of the Association for Computational Linguistics (EACL), 2023

• Learning Deep Semantics for Test Completion [code and data]
  Pengyu Nie, Rahul Banerjee, Junyi Jessy Li, Raymond Mooney and Milos Gligoric
  International Conference on Software Engineering (ICSE), 2023

• Automatic Essay Scoring Systems Are Both Overstable And Oversensitive: Explaining Why And Proposing Defenses
  Yaman Kumar Singla, Swapnil Parekh, Somesh Singh, Junyi Jessy Li, Rajiv Ratn Shah and Changyou Chen
  Dialogue and Discourse, Vol. 14 No. 1, 2023

• News Summarization and Evaluation in the Era of GPT-3 [data]
  Tanya Goyal, Junyi Jessy Li and Greg Durrett
  ArXiv 2022

• Discourse Comprehension: A Question Answering Framework to Represent Sentence Connections [bib] [data]
  Wei-Jen Ko, Cutter Dalton, Mark Simmons, Eliza Fisher, Greg Durrett and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022

• Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Posts [bib] [data and code]
  Hongli Zhan, Tiberiu Sosea, Cornelia Caragea and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022

• SNaC: Coherence Error Detection for Narrative Summarization [bib] [data]
  Tanya Goyal, Junyi Jessy Li and Greg Durrett
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022

• Using Developer Discussions to Guide Fixing Bugs in Software [bib] [data]
  Sheena Panthaplackel, Milos Gligoric, Junyi Jessy Li and Raymond Mooney
  Findings of EMNLP, 2022

• FALTE: A Toolkit for Fine-grained Annotation for Long Text Evaluation [bib] [demo] [code]
  Tanya Goyal, Junyi Jessy Li and Greg Durrett
  Demo, Conference on Empirical Methods in Natural Language Processing (EMNLP-Demo), 2022

• Text Simplification of College Admissions Instructions: A Professionally Simplified and Verified Corpus [bib] [data]
  Zachary W. Taylor, Maximus H. Chu and Junyi Jessy Li
  International Conference on Computational Linguistics (COLING), 2022

• The Role of Context and Uncertainty in Shallow Discourse Parsing [bib] [code]
  Katherine Atwell, Remi Choi, Junyi Jessy Li and Malihe Alikhani
  International Conference on Computational Linguistics (COLING), 2022

• CoditT5: Pretraining for Source Code and Natural Language Editing [bib, code and data]
  Jiyang Zhang, Sheena Panthaplackel, Pengyu Nie, Junyi Jessy Li and Milos Gligoric
  IEEE/ACM International Conference on Automated Software Engineering (ASE), 2022

• Political Ideology and Polarization of Policy Positions: A Multi-dimensional Approach [bib] [code and data]
  Barea Sinno, Bernardo Oviedo, Katherine Atwell, Malihe Alikhani and Junyi Jessy Li
  North American Chapter of the Association for Computational Linguistics (NAACL), 2022

• longhorns at DADC 2022: How many linguists does it take to fool a Question Answering model? A systematic approach to adversarial attacks. [bib]
  Venelin Kovatchev, Trina Chatterjee, Venkata Subrahmanyan Govindarajan, Jifan Chen, Eunsol Choi, Gabriella Chronis, Anubrata Das, Katrin Erk, Matthew Lease, Junyi Jessy Li, Yating Wu and Kyle Mahowald
  The First Workshop on Dynamic Adversarial Data Collection (DADC), 2022

• Emotion analysis and detection during COVID-19 [bib] [data]
  Tiberiu Sosea, Chau Pham, Alexander Tekle, Cornelia Caragea and Junyi Jessy Li
  International Conference on Language Resources and Evaluation (LREC), 2022

• Evaluating Factuality in Text Simplification [bib] [code and data]
  Ashwin Devaraj, William Sheffield, Byron Wallace and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2022 (Outstanding Paper Award)

• ProtoTEx: Explaining Model Decisions with Prototype Tensors [bib] [code]
  Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2022

• How do we answer complex questions: Discourse structure of long form answers [bib] [code and data]
  Fangyuan Xu, Junyi Jessy Li and Eunsol Choi
  Association for Computational Linguistics (ACL), 2022

• Impact of Evaluation Methodologies on Code Summarization [bib] [code and data]
  Pengyu Nie, Jiyang Zhang, Junyi Jessy Li, Raymond J. Mooney and Milos Gligoric
  Association for Computational Linguistics (ACL), 2022

• Learning to Describe Solutions for Bug Reports Based on Developer Discussions [bib] [code and data]
  Sheena Panthaplackel, Junyi Jessy Li, Milos Gligoric and Raymond J. Mooney
  Findings of the Association for Computational Linguistics (Findings of ACL), 2022

• Training Dynamics for Text Summarization Models [bib] [code]
  Tanya Goyal, Jiacheng Xu, Junyi Jessy Li and Greg Durrett
  Findings of the Association for Computational Linguistics (Findings of ACL), 2022

• Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems
  Anubha Kabra, Mehar Bhatia, Yaman Kumar, Junyi Jessy Li and Rajiv Ratn Shah
  Joint International Conference on Data Science & Management of Data (CODS-COMAD), 2022

• The Case for Claim Difficulty Assessment in Automatic Fact Checking
  Prakhar Singh, Anubrata Das, Junyi Jessy Li and Matthew Lease
  ArXiv 2021

• Elaborative Simplification: Content Addition and Explanation Generation in Text Simplification [bib] [code+annotations]
  Neha Srikanth and Junyi Jessy Li
  Findings of the Association for Computational Linguistics (Findings of ACL), 2021.

• Where Are We in Discourse Relation Recognition? [bib] [data]
  Katherine Atwell, Junyi Jessy Li and Malihe Alikhani
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2021.

• Did they answer? Subjective acts and intents in conversational discourse [bib] [data and code]
  Elisa Ferracane, Greg Durrett, Junyi Jessy Li and Katrin Erk
  North American Chapter of the Association for Computational Linguistics (NAACL), 2021.

• Paragraph-level Simplification of Medical Texts [bib] [data and code]
  Ashwin Devaraj, Iain Marshall, Byron Wallace and Junyi Jessy Li
  North American Chapter of the Association for Computational Linguistics (NAACL), 2021.

• Roosterize: Suggesting Lemma Names for Coq Verification Projects Using Deep Learning [bib and code]
  Pengyu Nie, Karl Palmskog, Junyi Jessy Li and Milos Gligoric
  International Conference on Software Engineering, Demonstrations Track (ICSE DEMO), 2021

• How to apply for financial aid: Exploring perplexity and jargon in texts for non-expert audiences
  Laura Manor, Yiran Su, Zachary W. Taylor and Junyi Jessy Li
  Society for Computation in Linguistics (SCiL) abstract, 2021

• Deep Just-In-Time Inconsistency Detection Between Comments and Source Code [bib, code and data]
  Sheena Panthaplackel, Junyi Jessy Li, Milos Gligoric and Raymond J. Mooney
  The AAAI Conference on Artificial Intelligence (AAAI), 2021

• Learning to Generate Code Comments from Class Hierarchies
  Jiyang Zhang, Sheena Panthaplackel, Pengyu Nie, Raymond J. Mooney, Junyi Jessy Li and Milos Gligoric
  ArXiv 2021

• Assessing Discourse Relations in Language Generation from GPT-2 [bib]
  Wei-Jen Ko and Junyi Jessy Li
  International Conference on Natural Language Generation (INLG), 2020

• Inquisitive Question Generation for High Level Text Comprehension [bib] [data]
  Wei-Jen Ko, Te-Yuan Chen, Yiyan Huang, Greg Durrett and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020

• Help! Need Advice on Identifying Advice [bib] [code and data]
  Venkata Subrahmanyan Govindarajan, Benjamin Chen, Rebecca Warholic, Katrin Erk and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020

• On the Naturalness of Hardware Descriptions [bib, code and data]
  Jaeseong Lee, Pengyu Nie, Junyi Jessy Li, and Milos Gligoric
  ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 2020

• Detecting Perceived Emotions in Hurricane Disasters [bib] [code and data]
  Shrey Desai, Cornelia Caragea and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2020

• Learning to Update Natural Language Comments Based on Code Changes [bib] [code and data]
  Sheena Panthaplackel, Pengyu Nie, Milos Gligoric, Junyi Jessy Li and Raymond Mooney
  Association for Computational Linguistics (ACL), 2020

• An Annotated Dataset of Discourse Modes in Hindi Stories [bib] [data]
  Swapnil Dhanwal, Hritwik Dutta, Hitesh Nankani, Nilay Shrivastava, Yaman Kumar, Junyi Jessy Li, Debanjan Mahata, Rakesh Gosangi, Haimin Zhang, Rajiv Ratn Shah and Amanda Stent
  International Conference on Language Resources and Evaluation (LREC), 2020

• Deep Generation of Coq Lemma Names Using Elaborated Terms [bib, code and data]
  Pengyu Nie, Karl Palmskog, Junyi Jessy Li and Milos Gligoric
  International Joint Conference on Automated Reasoning (IJCAR), 2020

• Learning to Format Coq Code Using Language Models
  Pengyu Nie, Karl Palmskog, Junyi Jessy Li, and Milos Gligoric
  The Coq Workshop, 2020

• Discourse Level Factors for Sentence Deletion in Text Simplification
  Yang Zhong, Chao Jiang, Wei Xu and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2020

• Associating Natural Language Comment and Source Code Entities [bib, code and data]
  Sheena Panthaplackel, Milos Gligoric, Raymond Mooney and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2020

• Adaptive Ensembling: Unsupervised Domain Adaptation for Political Document Analysis [bib] [code and data]
  Shrey Desai, Barea Sinno, Alex Rosenfeld and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

• Unsupervised Adversarial Domain Adaptation for Implicit Discourse Relation Classification [bib]
  Hsin-Ping Huang and Junyi Jessy Li
  Conference on Computational Natural Language Learning (CoNLL), 2019

• A Framework for Writing Trigger-Action Todo Comments in Executable Format [bib] [code]
  Pengyu Nie, Rishabh Rai, Junyi Jessy Li, Sarfraz Khurshid, Raymond Mooney and Milos Gligoric
  ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 2019 (ACM SIGSOFT Distinguished Paper Award)

• Evaluating Discourse in Structured Text Representations [bib] [code]
  Elisa Ferracane, Greg Durrett, Junyi Jessy Li and Katrin Erk
  Association for Computational Linguistics (ACL), 2019

• Linguistically-Informed Specificity and Semantic Plausibility for Dialog Generation [bib] [code]
  Wei-Jen Ko, Greg Durrett and Junyi Jessy Li
  North American Chapter of the Association for Computational Linguistics (NAACL), 2019

• Plain English Summarization of Contracts [bib] [data]
  Laura Manor and Junyi Jessy Li
  NAACL Workshop on Natural Legal Language Processing (NLLP), 2019

• From News to Medical: Cross-domain Discourse Segmentation [bib] [code and data]
  Elisa Ferracane, Titan Page, Junyi Jessy Li and Katrin Erk
  NAACL Workshop on Rhetorical Structure Theory and Related Formalisms (DISRPT), 2019

• Domain Agnostic Real-Valued Specificity Prediction [bib] [code and data]
  Wei-Jen Ko, Greg Durrett and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2019

• Predicting and Analyzing Language Specificity in Social Media Posts [bib] [code and data]
  Yifan Gao, Yang Zhong, Daniel Preoţiuc-Pietro and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2019

• Why Swear? Analyzing and Inferring the Intentions of Vulgar Expressions [bib] [data] [video by Isabel Cachola]
  Eric Holgate, Isabel Cachola, Daniel Preoţiuc-Pietro and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2018

• Expressively vulgar: The socio-dynamics of vulgarity and its effects on sentiment analysis in social media [bib] [data/code]
  Isabel Cachola, Eric Holgate, Daniel Preoţiuc-Pietro and Junyi Jessy Li
  International Conference on Computational Linguistics (COLING), 2018 (Area Chair Favorite)

• A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literature [bib] [webpage]
  Benjamin Nye, Junyi Jessy Li, Roma Patel, Yinfei Yang, Iain Marshall, Ani Nenkova and Byron Wallace
  Association for Computational Linguistics (ACL), 2018

• Natural Language Processing and Program Analysis for Supporting Todo Comments as Software Evolves [bib]
  Pengyu Nie, Junyi Jessy Li, Sarfraz Khurshid, Raymond Mooney, and Milos Gligoric
  AAAI Workshop on NLP for Software Engineering (NL4SE), 2018

• Aggregating and Predicting Sequence Labels from Crowd Annotations [bib] [code] [data]
  An Thanh Nguyen, Byron Wallace, Junyi Jessy Li, Ani Nenkova, and Matthew Lease
  Association for Computational Linguistics (ACL), 2017

• Autism Quotient Scores Modulate the Perception and Production of Text Specificity in Adult Females
  Junyi Jessy Li, Julia Parish-Morris, Leila Bateman and Ani Nenkova
  International Meeting for Autism Research (IMFAR), abstract, 2017

• From Discourse Structure to Text Specificity: Studies of Coherence Preferences
  Junyi Jessy Li
  Ph.D. thesis, University of Pennsylvania, 2017

• The Role of Discourse Units in Near-Extractive Summarization [bib] [code] [data]
  Junyi Jessy Li, Kapil Thadani and Amanda Stent
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2016 (Best Paper Nominee)

• The Instantiation Discourse Relation: A Corpus Analysis of Its Properties and Improved Detection [bib]
  Junyi Jessy Li and Ani Nenkova
  North American Chapter of the Association for Computational Linguistics (NAACL), 2016

• Improving the Annotation of Sentence Specificity [bib] [data]
  Junyi Jessy Li, Bridget O’Daniel, Yi Wu, Wenli Zhao, Ani Nenkova
  International Conference on Language Resources and Evaluation (LREC), 2016

• Estimating Text Intelligibility via Information Packaging Analysis [bib]
  Junyi Jessy Li, AAAI/SIGAI Doctoral Consortium at AAAI 2016

• Detecting Content-Heavy Sentences: A Cross-Language Case Study [bib]
  Junyi Jessy Li and Ani Nenkova
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2015

• Fast and Accurate Prediction of Sentence Specificity [bib] [code]
  Junyi Jessy Li and Ani Nenkova
  The AAAI Conference on Artificial Intelligence (AAAI), 2015

• Cross-lingual Discourse Relation Analysis: A corpus study and a semi-supervised classification system [bib]
  Junyi Jessy Li, Marine Carpuat and Ani Nenkova
  International Conference on Computational Linguistics (COLING), 2014

• Assessing the Discourse Factors that Influence the Quality of Machine Translation [bib]
  Junyi Jessy Li, Marine Carpuat and Ani Nenkova
  Association for Computational Linguistics (ACL), 2014

• Addressing Class Imbalance for Improved Recognition of Implicit Discourse Relations [bib]
  Junyi Jessy Li and Ani Nenkova
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014

• Reducing Sparsity Improves the Recognition of Implicit Discourse Relations [bib]
  Junyi Jessy Li and Ani Nenkova
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014