cloudwego/eino-ext

Various extensions for the Eino framework: https://github.com/cloudwego/eino

What it solves

It provides a comprehensive set of official extensions for the Eino framework, allowing developers to easily integrate various LLM providers, data sources, and observability tools without writing boilerplate integration code.

How it works

The project acts as a library of pre-built components that plug into the Eino framework. It provides official implementations for core AI application building blocks, including:

  • Chat Models: Integrations for OpenAI, Claude, Gemini, Ark, and Ollama.
  • Retrieval & Indexing: Support for Elastic Search and Volc VikingDB.
  • Retrieval Tools: Google Search and Duck Duck Go.
  • Data Processing: Document loaders for WebURL, Amazon S3, and files, and transformers like HTMLSplitter.
  • Observability: Callback handlers for tracing tools like Langfuse.

Who it’s for

Developers building LLM applications using the Eino framework who need ready-made integrations for popular AI models and infrastructure.

Highlights

  • Wide Model Support: Official implementations for multiple leading LLM providers.
  • Integrated RAG Pipeline: Includes loaders, transformers, indexers, and retrievers for building retrieval-augmented generation systems.
  • DevOps Support: Includes IDE plugins for visual debugging and graph editing.
  • Callback Integration: Built-in support for tracing and monitoring via callback handlers.

Related

  • Project
  • Project
  • Project
  • Project
  • Project