Generative AI with Large Language Models (LLMs)
2-day highly intensive training outline
Why this course
This course is a highly intensive, advanced training program designed for experienced developers to dive deep into the world of Generative AI, specifically focusing on Large Language Models (LLMs) such as Llama2, Claude 2, MPT-7B, and others. The training will cover not only the practical application of these models using Python but also the underlying mathematics and theory that enable their functionality. Additionally, we will explore tools like LangChain, Pinecone, Python-dotenv, and GPT wrappers, which are essential in deploying these AI models effectively.
Learning outcomes
By the end of this training, participants will be able to:
- Understand the mathematical and theoretical foundations of Generative AI and LLMs.
- Implement and manipulate open-source LLMs using Python for various applications.
- Integrate LLMs with retrieval-augmented generation (RAG) and alternatives to create end-to-end solutions.
- Utilize LangChain for chaining together components of language model applications.
- Implement Pinecone for vector search in AI applications.
- Configure and manage environment variables securely using Python-dotenv.
- Employ GPT wrappers for efficient interaction with Generative AI models.
- Troubleshoot and optimize the performance of LLMs in different scenarios.
Prerequisites
- Proficiency in Python programming, including familiarity with Python's advanced features and standard libraries.
- Solid understanding of machine learning concepts, including neural networks, backpropagation, and loss functions.
- Basic knowledge of Natural Language Processing (NLP) and text preprocessing techniques.
- Experience with data handling and manipulation using libraries such as NumPy, Pandas, and PyTorch/TensorFlow.
- Familiarity with command-line tools and version control systems (e.g., Git).
- Basic understanding of web APIs and application integration.
- Comfort with mathematical concepts, including linear algebra, calculus, and probability theory.
- Access to a computer with high processing power, a good internet connection, and permissions to install various packages and software.
8 modules
01Generative AI and LLMs Overview3 topics
- Evolution of AI and the generative model landscape
- The architecture of transformer-based models
- Comparative analysis of Llama2, Claude 2, MPT-7B, etc.
02Mathematical Foundations3 topics
- Deep dive into the math of transformers: attention mechanisms
- Probability, Perplexity, and Loss Functions
- Optimization techniques and gradient descent variations
03Setting Up the Development Environment3 topics
- Python environment setup (virtual environments, Jupyter notebooks)
- Introduction to Python-dotenv for environment variable management
- Version control and collaborative development best practices
04Working with Open Source LLMs3 topics
- Downloading, installing, and configuring LLMs
- Best practices for model fine-tuning and parameter adjustment
- Advanced text generation techniques
05Implementing RAG Alternatives3 topics
- Understanding the RAG approach and its limitations
- Integrating databases and knowledge sources
- Customizing LLM’s responses for specific use cases
06LangChain for AI Application Chaining3 topics
- Introduction to LangChain library
- Building language model chains for complex tasks
- Advanced feature exploration and custom component creation
07Vector Search with Pinecone3 topics
- Basics of vector search and its relevance to AI
- Setting up and using Pinecone in AI applications
- Indexing and querying vectors for large-scale data
08GPT Wrappers and API Interaction3 topics
- Overview of GPT wrappers for Python
- Building and consuming REST APIs with LLMs
- Error handling and rate limiting strategies
This outline provides a structured pathway for highly experienced developers to not only grasp the intricate workings of LLMs and related technologies but also to apply this knowledge in creating sophisticated AI-driven solutions.
A programme built around your team.
Share your training goals and requirements.