Junyi Jessy Li

I am an Assistant Professor in the Linguistics Department at The University of Texas at Austin where I work on computational linguistics and natural language processing. More specifically, my research focuses on discourse processing, language generation, and NLP in social contexts. I obtained my Ph.D. from the Department of Computer and Information Science at the University of Pennsylvania in 2017, advised by Ani Nenkova. Usually, I go by Jessy.

Some of the topics that I am currently researching include:

• Discourse organization: A text is more than the sum of its sentences; what else is going on and what are the implications for existing models? We investigate some of the high-level devices at play, including discourse (rhetorical) structure, language specificity, and pragmatic functions.
• Text intelligibility: Language is often subject to change depending on the context in which communication takes place. We work towards finding discourse aspects that impact text intelligibility for a target audience and addressing them in generation models.
• Language and society: We seek to understand how people use language in social media to achieve their communication goals, and how major events impact language use in both conventional media and social media.
• Language and code: Together with researchers in UT’s CS and ECE departments, we model natural language (e.g., comments, method names) and linguistic characteristics (e.g., coreference) in programming languages and software repositories.

Activities and Service

• ACL 2022 Outstanding Paper: Evaluating Factuality in Text Simplification

• NSF CAREER Award, 2022

• Program co-chair of SIGDIAL 2022.
• Senior Area Chair of Disourse and Pragmatics at ACL 2022; Area Chair of AAAI 2022
• Co-organizer of the 2nd Workshop on Computational Approaches to Discourse (CODI) co-located w/ EMNLP 2021

• Co-organizer of the The First Workshop on Natural Language Processing for Programming (NLP4Prog) co-located w/ ACL-IJCNLP 2021

• Action editor for ACL Rolling Review
• Associated editor for the Dialogue and Discourse journal
• Standing reviewer of TACL, CL

Publications

• CoditT5: Pretraining for Source Code and Natural Language Editing
  Jiyang Zhang, Sheena Panthaplackel, Pengyu Nie, Junyi Jessy Li and Milos Gligoric
  IEEE/ACM International Conference on Automated Software Engineering (ASE), 2022 (to appear)

• Political Ideology and Polarization of Policy Positions: A Multi-dimensional Approach
  Barea Sinno, Bernardo Oviedo, Katherine Atwell, Malihe Alikhani and Junyi Jessy Li
  North American Chapter of the Association for Computational Linguistics (NAACL), 2022

• longhorns at DADC 2022: How many linguists does it take to fool a Question Answering model? A systematic approach to adversarial attacks.
  Venelin Kovatchev, Trina Chatterjee, Venkata S Govindarajan, Jifan Chen, Eunsol Choi, Gabriella Chronis, Anubrata Das, Katrin Erk, Matthew Lease, Junyi Jessy Li, Yating Wu and Kyle Mahowald
  The First Workshop on Dynamic Adversarial Data Collection (DADC), 2022

• Emotion analysis and detection during COVID-19 [preprint]
  Tiberiu Sosea, Chau Pham, Alexander Tekle, Cornelia Caragea and Junyi Jessy Li
  International Conference on Language Resources and Evaluation (LREC), 2022

• Evaluating Factuality in Text Simplification [bib] [code and data]
  Ashwin Devaraj, William Sheffield, Byron Wallace and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2022 (Outstanding Paper Award)

• ProtoTEx: Explaining Model Decisions with Prototype Tensors [bib] [code]
  Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2022

• How do we answer complex questions: Discourse structure of long form answers [bib] [code and data]
  Fangyuan Xu, Junyi Jessy Li and Eunsol Choi
  Association for Computational Linguistics (ACL), 2022

• Impact of Evaluation Methodologies on Code Summarization [bib] [code and data]
  Pengyu Nie, Jiyang Zhang, Junyi Jessy Li, Raymond J. Mooney and Milos Gligoric
  Association for Computational Linguistics (ACL), 2022

• Learning to Describe Solutions for Bug Reports Based on Developer Discussions [bib] [code and data]
  Sheena Panthaplackel, Junyi Jessy Li, Milos Gligoric and Raymond J. Mooney
  Findings of the Association for Computational Linguistics (Findings of ACL), 2022

• Training Dynamics for Text Summarization Models [bib] [code]
  Tanya Goyal, Jiacheng Xu, Junyi Jessy Li and Greg Durrett
  Findings of the Association for Computational Linguistics (Findings of ACL), 2022

• Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems
  Anubha Kabra, Mehar Bhatia, Yaman Kumar, Junyi Jessy Li, Di Jin and Rajiv Ratn Shah
  Joint International Conference on Data Science & Management of Data (CODS-COMAD), 2022

• Elaborative Simplification: Content Addition and Explanation Generation in Text Simplification [bib] [code+annotations]
  Neha Srikanth and Junyi Jessy Li
  Findings of the Association for Computational Linguistics (Findings of ACL), 2021.

• Where Are We in Discourse Relation Recognition? [bib] [data]
  Katherine Atwell, Junyi Jessy Li and Malihe Alikhani
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2021.

• Did they answer? Subjective acts and intents in conversational discourse [bib] [data and code]
  Elisa Ferracane, Greg Durrett, Junyi Jessy Li and Katrin Erk
  North American Chapter of the Association for Computational Linguistics (NAACL), 2021.

• Paragraph-level Simplification of Medical Texts [bib] [data and code]
  Ashwin Devaraj, Iain Marshall, Byron Wallace and Junyi Jessy Li
  North American Chapter of the Association for Computational Linguistics (NAACL), 2021.

• Roosterize: Suggesting Lemma Names for Coq Verification Projects Using Deep Learning [bib and code]
  Pengyu Nie, Karl Palmskog, Junyi Jessy Li and Milos Gligoric
  International Conference on Software Engineering, Demonstrations Track (ICSE DEMO), 2021

• How to apply for financial aid: Exploring perplexity and jargon in texts for non-expert audiences
  Laura Manor, Yiran Su, Zachary W. Taylor and Junyi Jessy Li
  Society for Computation in Linguistics (SCiL) abstract, 2021

• Deep Just-In-Time Inconsistency Detection Between Comments and Source Code [bib, code and data]
  Sheena Panthaplackel, Junyi Jessy Li, Milos Gligoric and Raymond J. Mooney
  The AAAI Conference on Artificial Intelligence (AAAI), 2021

• Assessing Discourse Relations in Language Generation from GPT-2 [bib]
  Wei-Jen Ko and Junyi Jessy Li
  International Conference on Natural Language Generation (INLG), 2020

• Inquisitive Question Generation for High Level Text Comprehension [bib] [data]
  Wei-Jen Ko, Te-Yuan Chen, Yiyan Huang, Greg Durrett and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020

• Help! Need Advice on Identifying Advice [bib] [code and data]
  Venkata Subrahmanyan Govindarajan, Benjamin Chen, Rebecca Warholic, Katrin Erk and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020

• On the Naturalness of Hardware Descriptions [bib, code and data]
  Jaeseong Lee, Pengyu Nie, Junyi Jessy Li, and Milos Gligoric
  Symposium on the Foundations of Software Engineering (FSE), 2020

• Detecting Perceived Emotions in Hurricane Disasters [bib] [code and data]
  Shrey Desai, Cornelia Caragea and Junyi Jessy Li
  Association for Computational Linguistics (ACL), 2020

• Learning to Update Natural Language Comments Based on Code Changes [bib] [code and data]
  Sheena Panthaplackel, Pengyu Nie, Milos Gligoric, Junyi Jessy Li and Raymond Mooney
  Association for Computational Linguistics (ACL), 2020

• An Annotated Dataset of Discourse Modes in Hindi Stories [bib] [data]
  Swapnil Dhanwal, Hritwik Dutta, Hitesh Nankani, Nilay Shrivastava, Yaman Kumar, Junyi Jessy Li, Debanjan Mahata, Rakesh Gosangi, Haimin Zhang, Rajiv Ratn Shah and Amanda Stent
  International Conference on Language Resources and Evaluation (LREC), 2020

• Deep Generation of Coq Lemma Names Using Elaborated Terms [bib, code and data]
  Pengyu Nie, Karl Palmskog, Junyi Jessy Li and Milos Gligoric
  International Joint Conference on Automated Reasoning (IJCAR), 2020

• Learning to Format Coq Code Using Language Models
  Pengyu Nie, Karl Palmskog, Junyi Jessy Li, and Milos Gligoric
  The Coq Workshop, 2020

• Discourse Level Factors for Sentence Deletion in Text Simplification
  Yang Zhong, Chao Jiang, Wei Xu and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2020

• Associating Natural Language Comment and Source Code Entities [bib, code and data]
  Sheena Panthaplackel, Milos Gligoric, Raymond Mooney and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2020

• Adaptive Ensembling: Unsupervised Domain Adaptation for Political Document Analysis [bib] [code and data]
  Shrey Desai, Barea Sinno, Alex Rosenfeld and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

• Unsupervised Adversarial Domain Adaptation for Implicit Discourse Relation Classification [bib]
  Hsin-Ping Huang and Junyi Jessy Li
  Conference on Computational Natural Language Learning (CoNLL), 2019

• A Framework for Writing Trigger-Action Todo Comments in Executable Format [bib] [code]
  Pengyu Nie, Rishabh Rai, Junyi Jessy Li, Sarfraz Khurshid, Raymond Mooney and Milos Gligoric
  Symposium on the Foundations of Software Engineering (FSE), 2019 (ACM SIGSOFT Distinguished Paper Award)

• Evaluating Discourse in Structured Text Representations [bib] [code]
  Elisa Ferracane, Greg Durrett, Junyi Jessy Li and Katrin Erk
  Association for Computational Linguistics (ACL), 2019

• Linguistically-Informed Specificity and Semantic Plausibility for Dialog Generation [bib] [code]
  Wei-Jen Ko, Greg Durrett and Junyi Jessy Li
  North American Chapter of the Association for Computational Linguistics (NAACL), 2019

• Plain English Summarization of Contracts [bib] [data]
  Laura Manor and Junyi Jessy Li
  NAACL Workshop on Natural Legal Language Processing (NLLP), 2019

• From News to Medical: Cross-domain Discourse Segmentation [bib] [code and data]
  Elisa Ferracane, Titan Page, Junyi Jessy Li and Katrin Erk
  NAACL Workshop on Rhetorical Structure Theory and Related Formalisms (DISRPT), 2019

• Domain Agnostic Real-Valued Specificity Prediction [bib] [code and data]
  Wei-Jen Ko, Greg Durrett and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2019

• Predicting and Analyzing Language Specificity in Social Media Posts [bib] [code and data]
  Yifan Gao, Yang Zhong, Daniel Preoţiuc-Pietro and Junyi Jessy Li
  The AAAI Conference on Artificial Intelligence (AAAI), 2019

• Why Swear? Analyzing and Inferring the Intentions of Vulgar Expressions [bib] [data] [video by Isabel Cachola]
  Eric Holgate, Isabel Cachola, Daniel Preoţiuc-Pietro and Junyi Jessy Li
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2018

• Expressively vulgar: The socio-dynamics of vulgarity and its effects on sentiment analysis in social media [bib] [data/code]
  Isabel Cachola, Eric Holgate, Daniel Preoţiuc-Pietro and Junyi Jessy Li
  International Conference on Computational Linguistics (COLING), 2018 (Area Chair Favorite)

• A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literature [bib] [webpage]
  Benjamin Nye, Junyi Jessy Li, Roma Patel, Yinfei Yang, Iain Marshall, Ani Nenkova and Byron Wallace
  Association for Computational Linguistics (ACL), 2018

• Natural Language Processing and Program Analysis for Supporting Todo Comments as Software Evolves [bib]
  Pengyu Nie, Junyi Jessy Li, Sarfraz Khurshid, Raymond Mooney, and Milos Gligoric
  AAAI Workshop on NLP for Software Engineering (NL4SE), 2018

• Aggregating and Predicting Sequence Labels from Crowd Annotations [bib] [code] [data]
  An Thanh Nguyen, Byron Wallace, Junyi Jessy Li, Ani Nenkova, and Matthew Lease
  Association for Computational Linguistics (ACL), 2017

• Autism Quotient Scores Modulate the Perception and Production of Text Specificity in Adult Females
  Junyi Jessy Li, Julia Parish-Morris, Leila Bateman and Ani Nenkova
  International Meeting for Autism Research (IMFAR), abstract, 2017

• From Discourse Structure to Text Specificity: Studies of Coherence Preferences
  Junyi Jessy Li
  Ph.D. thesis, University of Pennsylvania, 2017

• The Role of Discourse Units in Near-Extractive Summarization [bib] [code] [data]
  Junyi Jessy Li, Kapil Thadani and Amanda Stent
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2016 (Best Paper Nominee)

• The Instantiation Discourse Relation: A Corpus Analysis of Its Properties and Improved Detection [bib]
  Junyi Jessy Li and Ani Nenkova
  North American Chapter of the Association for Computational Linguistics (NAACL), 2016

• Improving the Annotation of Sentence Specificity [bib] [data]
  Junyi Jessy Li, Bridget O’Daniel, Yi Wu, Wenli Zhao, Ani Nenkova
  International Conference on Language Resources and Evaluation (LREC), 2016

• Estimating Text Intelligibility via Information Packaging Analysis [bib]
  Junyi Jessy Li, AAAI/SIGAI Doctoral Consortium at AAAI 2016

• Detecting Content-Heavy Sentences: A Cross-Language Case Study [bib]
  Junyi Jessy Li and Ani Nenkova
  Conference on Empirical Methods in Natural Language Processing (EMNLP), 2015

• Fast and Accurate Prediction of Sentence Specificity [bib] [code]
  Junyi Jessy Li and Ani Nenkova
  The AAAI Conference on Artificial Intelligence (AAAI), 2015

• Cross-lingual Discourse Relation Analysis: A corpus study and a semi-supervised classification system [bib]
  Junyi Jessy Li, Marine Carpuat and Ani Nenkova
  International Conference on Computational Linguistics (COLING), 2014

• Assessing the Discourse Factors that Influence the Quality of Machine Translation [bib]
  Junyi Jessy Li, Marine Carpuat and Ani Nenkova
  Association for Computational Linguistics (ACL), 2014

• Addressing Class Imbalance for Improved Recognition of Implicit Discourse Relations [bib]
  Junyi Jessy Li and Ani Nenkova
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014

• Reducing Sparsity Improves the Recognition of Implicit Discourse Relations [bib]
  Junyi Jessy Li and Ani Nenkova
  Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014

Students

• Current graduate students:
  • Sheena Panthaplackel (PhD Computer Science, co-advised with Ray Mooney)
  • Venkata S. Govindarajan (PhD Linguistics, co-advised with David Beaver)
  • Hongli Zhan (PhD Linguistics)
  • Smriti Singh (MS Computer Science)
• Current undergraduate students:
  • Lokesh Pugalenthi, Computer Science and French.
  • Sebastian Joseph, Computer Science.
  • William Sheffield, Linguistics and Maths.
  • Yian Wong, Computer Science.
• Former graduate students:
  • Wei-Jen Ko, PhD 2022, Computer Science, co-advised with Greg Durrett.

  • Elisa Ferracane, PhD 2020, Linguistics, co-advised with Katrin Erk.

  • Ashwin Devaraj, MS thesis 2022, Computer Science.
  • Neha Srikanth, MS thesis 2021, Computer Science.

  • Laura Manor, MS thesis 2020, Linguistics.

  • Anurag Patil (Spring-Summer 2021) MS, Computational Data Science.
  • Prakhar Singh (Spring 2020), MS, Computer Science, co-advised with Matt Lease.
  • Yiran (Erin) Su (Spring 2020), MS, Electrical and Computer Engineering.
  • Te-Yuan Chen (Spring 2020), MS, School of Information.
  • Yiyan Huang (Spring 2020), MS, School of Information.
  • Hsin-Ping Huang (Spring-Summer 2018), MS, Computer Science.
• Former undergraduate students:
  • Anna Alvis, Linguistics.
  • Kathryn Kazanas, Linguistics.
  • Keziah Kaylyn Reina, Linguistics.
  • Apollo Reyes, Linguistics.
  • Ian Shin, Computer Science and Maths 2023.
  • Maximus Chu, Computer Science, 2022.
  • John Henry Cruz, Computer Science 2022.
  • Bernardo Oviedo, Computer Science 2022.
  • William Sheffield, Linguistics and Maths, 2022.
  • Chau Pham, CRA DREU 2020, Colgage Class of 1966 Endowed Internship Summer 2021, Computer Science, Colgate University.
  • Cutter Dalton, Linguistics 2021.
  • Gauraang Dhamankar, Computer Science 2021.
  • Lisa DiSalvo, CRA DREU 2021, Computer Science & Graphic Design, Arcadia University.
  • Eliza Fisher, Linguistics 2021.
  • Arjun Kunjilwar, Computer Science 2021.
  • Mark Simmons, Linguistics 2021.
  • Alexander Tekle, Electrical and Computer Engineering 2021.
  • Benjamin Chen, Computer Science 2020.
  • Shrey Desai, Computer Science 2020.
  • Isabel Cachola, Maths 2019.
  • Yifan Gao, Maths 2019.
  • Rebecca Warholic, CRA DREU 2019, Computer Science and Italian Studies, Smith College.
  • Yang Zhong, Maths 2019.
  • Victor Mena, Linguistics 2018.

Teaching

• Spring 2022:
  • LIN 373N: Machine Learning Toolbox for Text Analysis
  • LIN 389C: Research in Computational Linguistics
• Spring 2021:
  • LIN 373N: Machine Learning Toolbox for Text Analysis
  • LIN 389C: Research in Computational Linguistics
• Fall 2020:
  • LIN 313: Language and Computers
  • LIN 393: Discourse Processing and Natural Language Generation
  • LIN 389C: Research in Computational Linguistics (instructor on record: Katrin Erk)
• Spring 2020:
  • LIN 373: Machine Learning Toolbox for Text Analysis
  • LIN 389C: Research in Computational Linguistics
• Fall 2019:
  • LIN 313: Language and Computers
  • LIN 393: Computational Linguistics with Minimal Supervision
  • LIN 389C: Research in Computational Linguistics (instructor on record: Katrin Erk)
• Spring 2019:
  • LIN 373: Machine Learning Toolbox for Text Analysis
  • LIN 389C: Research in Computational Linguistics
• Fall 2018:
  • LIN 313: Language and Computers
  • LIN 393S: Computational Discourse
  • LIN 389C: Research in Computational Linguistics (instructor on record: Katrin Erk)
• Spring 2018:
  • LIN 313: Language and Computers
  • LIN 389C: Research in Computational Linguistics
• Fall 2012, Fall 2013, Fall 2014:
  • CIS 430/530: Computational Linguistics (TA, University of Pennsylvania)
• Spring 2011:
  • CIS 120: Programming Languages and Techniques I (TA, University of Pennsylvania)
• Spring 2009:
  • VG 101: Introduction to Programming (TA, Shanghai Jiao Tong University)