Generative AI and LLMs: Architecture and Data Preparation

This intermediate-level course dives deep into the foundational architecture of Generative AI and Large Language Models (LLMs). Students will learn about various LLM architectures, including the Transformer, and understand their underlying mechanisms, strengths, and limitations. A significant focus is placed on data preparation techniques crucial for training and fine-tuning LLMs, covering tokenization, dataset curation, and ethical considerations. The course combines theoretical knowledge with practical insights, preparing developers, AI engineers, and data scientists to build and deploy effective Generative AI applications.