PyThaiNLP/pythainlp

Thai natural language processing in Python

What it solves

PyThaiNLP is a comprehensive natural language processing (NLP) library specifically designed for the Thai language, serving as a Thai-focused counterpart to NLTK. It provides the essential tools and datasets needed to analyze and process Thai text, which often lacks the clear word boundaries found in other languages.

How it works

The library provides a suite of linguistic analysis tools and pre-trained models. It handles the complexities of Thai text through several key capabilities:

  • Segmentation: It can break down text into sentences, words, and subwords.

  • Tagging: It performs part-of-speech tagging to identify the grammatical role of words.

  • Transliteration: It converts text between Romanization and IPA conversion.

  • Correction: It offers spelling suggestions and correction tools.

  • Utilities: It includes specialized utilities for Thai-specific needs, like converting numbers to text (bahttext) and Thai-specific datetime formatting.

Who it’s for

Developers, researchers, and data scientists working with Thai language data who need a standardized, open-source toolkit for linguistic analysis.

Highlights

  • Comprehensive Toolset: Covers everything from basic tokenization to complex tagging and transliteration.
  • Data-Rich: Includes built-in Thai character sets, word lists, and stop words.
  • Flexible Installation: Offers optional extras like machine translation and WordNet support.
  • CLI Interface: Provides a thainlp command-line interface for quick data cataloging and analysis.
  • Enterprise-Ready: Includes specific modes for offline use and read-only environments (e.g., Docker volumes) to manage how data is downloaded and cached.

Related

  • Project
    nltk/nltk

    The Natural Language Toolkit (NLTK) is a suite of Python modules and data sets that supports research and development in Natural Language Processing.

  • Project
    dongrixinyu/JioNLP

    A Python library for Chinese NLP preprocessing and parsing, providing tools for data cleaning, entity extraction, and automatic LLM evaluation.

  • Project
    sloria/TextBlob

    A Python library for processing textual data that provides a simple API for common NLP tasks like sentiment analysis, tagging, and classification.

  • Project
    cltk/cltk

    A Python library providing natural language processing tools specifically tailored for pre-modern and historical languages, supporting both LLMs and traditional NLP backends.

  • Project
    undertheseanlp/underthesea

    An open-source agentic AI toolkit and Vietnamese NLP library that provides multi-provider LLM support and specialized text processing tools for the Vietnamese language.