forrany/Awesome-Ollama-Server

这是一个用于监控和检测 Ollama 服务可用性和性能的系统。它提供了一个现代化的 Web 界面，支持多语言（中文/英文），并具有实时检测和数据展示功能。

What it solves

This project provides a monitoring and detection system for Ollama services. It allows users to track the availability and performance of multiple Ollama instances, ensuring they are online and performing optimally.

How it works

The system uses a Next.js 14 web interface to detect and monitor Ollama services. It can perform batch detection of service addresses, test response times and TPS (Transactions Per Second), and list available models on those services. It also supports automatic FOFA scanning to find services.

Who it’s for

It is designed for users and administrators who need to manage or research the same-day availability and performance of multiple Ollama servers.

Highlights

  • Service Detection: Batch detection of Ollama services with real-time status updates and exportable results.
  • Performance Monitoring: Visualization of response times and TPS data.
  • Model Filtering: Ability to filter and sort services based on the models they host and their performance metrics.
  • Multilingual Support: Full interface available in both Chinese and English.
  • Flexible Deployment: Supports standard Node.js installation and Docker Compose for quick setup.

Related

  • Dispatch
    Ollama Web Search and Web Fetch API Release

    Ollama has released a new web search and web fetch API to reduce hallucinations and provide LLMs with real-time web data via REST and library integrations.

  • Dispatch
    Ollama adds streaming tool calling support

    Ollama now supports streaming responses with tool calling, letting chat applications receive partial model output and invoke functions in real time.

  • Dispatch
    Ollama Multimodal Engine Release

    Ollama has introduced a new multimodal engine to improve the reliability and accuracy of local inference for vision models, supporting Llama 4, Gemma 3, Qwen 2.5 VL, and Mistral Small 3.1.

  • Dispatch
    Ollama Tool Support Release

    Ollama has introduced tool calling support for models like Llama 3.1, allowing local LLMs to interact with external APIs, functions, and code interpreters.

  • Dispatch
    Ollama Cloud Models Preview

    Ollama has introduced Cloud models in preview, enabling users to run large-scale models on datacenter-grade hardware while maintaining the same local toolset and API integration.