KalyanKS-NLP/llm-engineer-toolkit

LLM Engineer Toolkit is a curated list of over 120 libraries for working with Large Language Models (LLMs) — the technology behind chatbots and text generators. The list is organized by category, so you can quickly find tools for specific tasks like training, building apps, or evaluating models.

What it contains:

• Categories cover the full LLM workflow: training and fine-tuning, application development, retrieval-augmented generation (RAG), inference, serving, data extraction, agents, evaluation, monitoring, prompts, structured outputs, safety, embedding models, and more.
• Each entry includes the library name, a short description, and a link to its GitHub repository.
• Examples of listed tools: Unsloth for faster fine-tuning, LangChain for building LLM apps, vLLM for efficient inference, and many others.

How it's organized:

• The README has quick links at the top to jump to each category.
• Categories are presented as tables with columns for Library, Description, and Link.

Additional resources:

• The author (Kalyan KS) also maintains related repositories for interview questions, prompt engineering techniques, and survey papers.
• There's a paid book on LLM interview questions (with a discount coupon) and a free newsletter for updates on Generative AI.

In short, it's a one-stop reference for anyone exploring the LLM ecosystem, saving time by grouping the most useful open-source tools by purpose.