Skip to content

LLM Zoomcamp - a free online course about building a Q&A system

Notifications You must be signed in to change notification settings

DataTalksClub/llm-zoomcamp

Repository files navigation

LLM Zoomcamp

LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base.

2024 cohort

Pre-requisites

  • Comfortable with programming and Python
  • Comfortable with command line
  • Docker
  • No previous exposure to AI or ML is required

Syllabus

We encourage Learning in Public

Pre-course workshops

Implement a search engine: Video, code

  • LLMs and RAG
  • Preparing the environment
  • Retrieval and the basics of search
  • OpenAI API
  • Simple RAG with Open AI
  • Text search with Elasticsearch
  • Getting an environment with a GPU
  • Open-source models from HuggingFace Hub
  • Running LLMs on a CPU with Ollama
  • Creating a simple UI with Streamlit
  • Vector search
  • Creating and indexing embeddings
  • Vector search with Elasticsearch
  • Offline evaluation of retrieval
  • Offline evaluation of RAG
  • Cosine and LLM-as-a-Judge metrics
  • Tracking chat history and user feedback
  • Creating dashboards with Grafana for visualization
  • Ingesting data with Mage
  • Techniques to improve RAG pipeline
  • Hybrid search
  • Document reranking
  • Hybrid search with LangChain
  • Building an end-to-end fitness assistant project
  • Examples of pre-processing text datasets

LLM Zoomcamp 2024 Competition

More details

Instructors

Asking questions

The best way to get support is to use DataTalks.Club's Slack. Join the #course-llm-zoomcamp.

To make discussions in Slack more organized:

Supporters and partners

Thanks to the course sponsors for making it possible to run this course

Do you want to support our course and our community? Please reach out to [email protected]