TUW NLP seminar

NLP seminar at TU Wien

Time and place

Every Tuesday, 14.15 - 15.45, Room HD0215

TUW course

194.135 Research topics in natural language processing

TISS page: 2024SS, 2023WS, 2023SS

Instructor

Gabor Recski

Schedule and reading material

Date	Topic	Required reading	Additional reading	Presenter	Slides
3/5/2024	Introduction, scheduling
3/12/2024	Mixture Of Experts LLMs	Zoph et al. 2022, Du et al. 2022	Jiang et al. 2024, Xue et al. 2024	Ilya Lasy
3/19/2024	Low-rank adaptation of LLMs	Hu et al. 2022	Hennings 2023	Roman Grebnev
3/26/2024	No class (spring break)
4/2/2024	No class (spring break)
4/9/2024	Biographical Relation Extraction	own research		Varvara Arzt
4/16/2024	LLM Quantization	Lin et al. 2023, Ma et al. 2024		Ilya Lasy
4/23/2024	Information Extraction at Kontron Transportation	own research		Mehdin Masinovic
4/30/2024	The Importance of Context in the Evaluation of Word Embeddings	Fodor et al. 2023		Iva Pezo
5/7/2024	Relational Knowledge in Language Models	Hernandez et al. 2024		Varvara Arzt
5/14/2024	Extracting Winners and Losers from Legislative Texts	Davoodi et al. 2022		Kasra Zarinehbaf Asadi
5/21/2024	No class (Pentecost break)
5/28/2024	Explainable AI in NLP	Danilevsky et al. 2020		Mirta Medak
6/4/2024	Semantic shifts of words	Yao et al. 2018	Kutuzov et al. 2018	Kristian Ristic
6/11/2024	Synthetic data for language models	Liu et al. 2024		Aditi Chauhan
6/18/2024	SongComposer: A Large Language Model for Lyric and Melody Composition in Song Generation	Ding et al. 2024		Fabian Ombui
6/25/2024	Sarcasm detection in NLP	Kumar & Garg 2019	Farha et al. 2022	Dario Bogenreiter

Past semesters

2023WS

Date	Topic	Required reading	Additional reading	Presenter	Slides
10/3/2023	Introduction, scheduling
10/10/2023	No class
10/17/2023	Word embeddings, temporal embeddings	SLP3 Ch 6: Vector semantics and embeddings	Mikolov et al. 2013, Collobert et al. 2011	Paul Schmitt	Slides
10/24/2023	Transformers and BERT	Vaswani et al. 2017, Devlin et al. 2019	Rogers et al. 2020	Valentin Peter, Carlos Vargas	Slides
10/31/2023	Problems with distributional models	Bender et al. 2021, Bender & Koller 2020		Luiza Corpaci	Slides
11/7/2023	No class
11/14/2023	No class
11/21/2023	Model evaluation with contrast sets	Gardner et al. 2020		Varvara Arzt
11/28/2023	Large Language Models I	Touvron et al. 2023		Varvara Arzt, Mahdi Azarbeik
12/5/2023	Large Language Models II	Borgeaud et al. 2022		Ilya Lasy	Slides
12/12/2023	Relation extraction	Wadhwa et al. 2023		Varvara Arzt
12/19/2023	Cancelled due to illness
1/9/2024	Ethical Issues in NLP	Bender & Friedman 2018		Silvia Bonomi	Slides
1/16/2024	Discourse Representation Parsing	van Noord et al. 2018	van Noord et al. 2020	Christian Obereder	Slides
1/23/2024	Information extraction	Fei et al. 2022		Tilman Kerl

2023SS

Date	Topic	Required reading	Additional reading	Presenter
3/7/2023	Introduction, scheduling
	Overview of NLP tasks, task types, methods
3/21/2023	Word embeddings	Mikolov et al. 2013	Collobert et al. 2011, Pennington et al. 2014	Lukas Arnhold
	Transformer-based language models	Vaswani et al. 2017, Devlin et al. 2019	Rogers et al. 2020	Gerald Weber
4/4/2023	Easter break
4/18/2023	Problems with distributional models	Bender et al. 2021		Ana Terović
	Explainability	Ribeiro et al. 2016, Jain & Wallace 2019, DeYoung et al. 2020	Jacovi & Goldberg 2020	Thais Beham
5/2/2023	Understanding and semantics	Bender & Koller 2020, Emerson 2020		Lukas Hofstetter
	Semantic parsing and representation	Banarescu et al. 2013, Poelman et al. 2022		Mina Jafari
5/16/2023	Semantics-based information extraction	Kovács et al. 2022b	Kovács et al. 2022a
	Graph-based Open Information Extraction	Léchelle et al. 2019	Gashteovski et al. 2017	Fabian Gabelberger
5/30/2023	Pentecost break
6/13/2023	Semantic textual similarity of English legal text			Peter Walchhofer
	Using AutoGPT to create a virtual assistant			Lukas Hofstetter
6/27/2022	Detecting bias in Transformer-based models			Tilman Kerl
	End-of-semester update round

Earlier semesters

For the schedule of earlier semesters see this page