LING 575 I: Topics in Computational Linguistics

Spring 2022
Meeting:
W 3:30pm - 5:50pm / SMI 309
SLN:
16569
Section Type:
Lecture
Joint Sections:
LING 575 E , LING 575 F
ANALYZING NEURAL LANGUAGE MODELS TWO RECENT TRENDS IN NLP---THE APPLICATION OF DEEP NEURAL NETWORKS AND THE USE OF TRANSFER LEARNING--- HAVE RESULTED IN MANY MODELS THAT ACHIEVE HIGH PERFORMANCE ON IMPORTA TASKS BUT WHOSE BEHAVIOR ON THOSE TASKS IS DIFFICULT TO INTERPR IN THIS SEMINAR, WE WILL LOOK AT METHODS INSPIRED BY LINGUISTICS COGNITIVE SCIENCE FOR ANALYZING WHAT LARGE NEURAL LANGUAGE MODELS H IN FACT LEARNED: DIAGNOSTIC/PROBING CLASSIFIERS, ADVERSARIAL TEST SETS, AND ARTIFICI LANGUAGES, AMONG OTHERS. PARTICULAR ATTENTION WILL BE PAID TO PROBING THESE MODELS' _SEMANTIC_ KNOWLEDGE, WHICH HAS RECEIVED COMPARABLY LITTLE ATTENTION COMPARED TO THEIR SYNTACTIC KNOWLEDGE. STUDENTS WILL ACQUIRE RELEVANT SKILLS AND (IN SMA GROUPS) DESIGN AND EXECUTE A LINGUISTICALLY-INFORMED ANALYSIS EXPERIMENT, RESULTING IN A REPORT I THE FORM OF A PUBLISHABLE CONFERENC PAPER. CONTACT INSTRUCTOR FOR ADD CODE.
Catalog Description:
In-depth study of a particular area of computational linguistics, with hands-on experience. Prerequisite: LING 570 and 571, or permission of instructor. Offered: WSp.
Credits:
3.0
Status:
Active
Last updated:
March 28, 2024 - 4:00 pm