awaescher/OllamaSharp

The easiest way to use Ollama in .NET

What it solves

OllamaSharp is a .NET library that simplifies the process of integrating local or remote Ollama AI models into C# applications. It acts as a bridge, providing a strongly-typed API wrapper around the Ollama API, eliminating the need for manual HTTP requests to interact with the AI models.

How it works

The library provides an OllamaApiClient that wraps every single Ollama API endpoint. This allows developers to perform tasks such as chatting, generating completions, creating embeddings, and managing models (pulling, listing, and deleting) using awaitable C# methods. It supports real-time streaming of responses and progress reporting for long-running tasks like model downloads.

Who it’s for

.NET developers who want to use Ollama for AI capabilities in their software, whether they are building simple chat interfaces or integrating AI into larger frameworks like Microsoft Semantic Kernel or .NET Aspire.

Highlights

  • Full API Coverage: Covers all Ollama API endpoints, including model management and embeddings.
  • C# Native Experience: Supports real-time streaming and Native AOT (Ahead-of-Time) compilation for high performance.
  • Tool Support: Includes a sophisticated tools engine with source generators for function calling.
  • Ecosystem Integration: Recommended by Microsoft and implements IChatClient and IEmbeddingGenerator from Microsoft.Extensions.AI for provider-agnostic AI development.

Related

  • Project
    ollama/ollama-python

    A Python library that simplifies integration with Ollama, enabling developers to chat with, manage, and generate embeddings from LLMs locally or in the cloud.

  • Project
    SciSharp/LLamaSharp

    A cross-platform C# library based on llama.cpp that allows developers to run LLaMA and other LLMs locally on CPU and GPU with high-level APIs.

  • Project
    JHubi1/ollama-app

    A modern cross-platform client for Ollama that provides a graphical chat interface for interacting with local AI models via API.

  • Project
    ollama4j/ollama4j

    A Java library wrapper for the Ollama server that allows developers to integrate local LLMs into Java applications with type-safe bindings.

  • Project
    SciSharp/BotSharp

    An open-source .NET framework for building AI bot platforms that allows enterprise developers to integrate LLMs and multi-agent systems into business applications.