levyflux/AViD
Framework that enables fine-tuning of vision-language grounding models on custom datasets
What it solves
AViD provides a practical workflow for fine-tuning Grounding DINO, an open-vocabulary object detector, on custom datasets. It allows teams to adapt a large detector to domain-specific objects without the computational cost of updating every model parameter.
How it works
AViD implements parameter-efficient fine-tuning (PEFT) using LoRA (Low-Rank Adaptation), targeting the detector's attention, projection, FFN, bounding-box, and feature-map layers. To stabilize training, it includes optional Exponential Moving Averages (EMA). The system uses a CSV-based dataset reader and provides a complete pipeline including YAML-driven training, checkpointing, and a dedicated evaluation loop for metrics like mAP, precision, and recall.
Who it’s for
It is designed for developers and AI teams who need to train a vision-language detector on specialized objects but want to avoid full-parameter fine-tuning.
Highlights
- Parameter-Efficient Adaptation: Uses LoRA to target specific layers for faster, lighter training.
- End-to-End Workflow: Integrates dataset loading, training, validation, and evaluation in one repository.
- Training Stabilization: Optional EMA support to ensure smoother model trajectories.
- Detection-Focused Evaluation: Provides detailed per-class summaries and visual comparisons.
- Flexible Entry Points: Includes YAML configurations, a Gradio demo, and single-image inference scripts.
Related
- Project
- Project
- Project
- Project