Marion Di Marco (née Weller)

Post-Doc Researcher at TUM (School of Computation, Information and Technology)

Teaching

Sommer Semester 2025

Generative Models on TextLarge Language Models

Large Language Models (such as GPT2, GPT3, GPT4, Llama, T5) and Intelligent Chatbots (such as ChatGPT, Claude, Gemini and Copilot) are a very timely topic.

Contents: N-gram language models, neural language modeling, word2vec, RNNs, Transformers, BERT, RLHF, ChatGPT, multilingual alignment, prompting, transfer learning, domain adaptation, linguistic knowledge in large language models


Location: Room D.2.11

Time: Tuesday 16:15 – 17:45


Lectures

Lecture 1: Organization and Introduction to Linguistic Concepts

Lecture 2: N-gram Models (without section 3.7) Slides

Lecture 3: Bengio et al. (2003): A Neural Probabilistic Language Model.

Lecture 4: Talk by Prof. Victoria Nash: AI and the Evolution of Digital Childhood.
       May 20, 2025  16:15-18:00  in Room D.0.0.1


Literature

Speech and Language Processing
Dan Jurafsky and James H. Martin (2024; 3rd ed. draft)


Paper Presentations