Firepal/stammer

Recreate any audio track by rearranging the frames of another video

What it solves

STAMMER is a utility that allows you to recreate one audio source (the modulator) using only the audio frames from another source (the carrier). This enables the creation of audio edits where the timbre and sounds of one file are used to "reconstruct" the patterns and rhythms of another.

How it works

The tool divides both the carrier and modulator signals into frames and calculates their spectra using the Fast Fourier Transform (FFT). To better mimic human hearing, it averages nearby frequencies into bins. For each frame in the modulator, the tool searches for the frame in the carrier that has the most similar spectrum (maximizing the dot product of normalized spectrum vectors). It then adjusts the volume of the selected carrier frame to match the modulator's volume and inserts it into the output.

Who it’s for

It is designed for audio editors, meme creators, and people interested in digital signal processing (DSP) who want to create unique, chopped-up audio effects.

Highlights

  • Cross-source reconstruction: Recreates any audio source using frames from another audio or video file.
  • Spectrum-based matching: Uses FFT and frequency binning to find the most similar audio frames.
  • ** keluarga volume scaling**: Linearly scales carrier frame volume to match the modulator for a cleaner result.
  • Flexible input: Supports various audio and video file extensions via ffmpeg.

Related

  • Project
    acoustid/chromaprint

    An audio fingerprinting library that generates compact identifiers to detect near-identical audio files and streams for high-performance searching.

  • Project
    nomadkaraoke/python-audio-separator

    A Python package for audio stem separation that uses UVR models to split audio files into vocals, instrumentals, and other specific instrument tracks.

  • Project
    iver56/audiomentations

    A Python library for audio data augmentation that provides a wide variety of transforms to make audio deep learning models more robust for real-world use.

  • Project
    LCAV/pyroomacoustics

    A Python package for simulating room acoustics and implementing audio array processing algorithms, used to generate synthetic audio data and test signal processing techniques.

  • Project
    stumpy-dev/stumpy

    A scalable Python library for computing matrix profiles to identify repeated patterns and anomalies in time series data.