estebanpdl/osintgpt

What it solves

It simplifies the analysis of text data for open-source intelligence (OSINT) research, allowing users to process large volumes of text, find similar documents, and manage conversation history.

How it works

The package leverages OpenAI's GPT models for text analysis and embeddings. It uses a SQLite database for managing conversation data and integrates with Qdrant, a high-performance vector similarity search engine, to store and search high-dimensional vector embeddings and their associated metadata.

Who it’s for

Researchers and analysts performing open-source intelligence (OSINT) tasks who need to leverage LLMs and vector search to analyze text data.

Highlights

• Text Analysis: Uses GPT models to calculate embeddings and search for similar documents.
• Interactive Mode: Provides a dynamic way to communicate directly with the GPT model via prompts.
• Database Management: Integrated SQLite support for storing and retrieving conversation data.
• Vector Store Integration: Full interface for Qdrant to manage collections, vectors, and payloads efficiently.