quarkiverse/quarkus-langchain4j

What it solves

It simplifies the process of integrating Large Language Models (LLMs) into Java applications built with the Quarkus framework, removing the need for manual boilerplate code when connecting to AI services.

How it works

The project provides a set of Quarkus extensions that bridge the Quarkus ecosystem with the LangChain4j library. It allows developers to define AI services declaratively and connect to various LLM providers (such as OpenAI, Hugging Face, and Ollama) and document stores (such as Redis, Chroma, and Infinispan) through configuration.

Who it’s for

Java developers using the Quarkus framework who want to add AI capabilities like chat, embeddings, and tool-use to their applications.

Highlights

• Declarative AI services: Simplifies the definition of AI-driven logic.
• Multi-LLM support: Works with OpenAI GPTs, Hugging Face, and Ollama.
• Document store integration: Supports Redis, Chroma, and Infinispan for RAG workflows.
• Native compilation: Compatible with Quarkus native compilation for faster startup and lower memory footprint.
• Observability: Integrated with the Quarkus observability stack for metrics and tracing.