CLAMS App Directory

How to use CLAMS apps

App Directory

simple-timepoints-stitcher

Stitches a sequence of TimePoint annotations into a sequence of TimeFrame annotations, performing simple smoothing of short peaks of positive labels.

swt-detection

Detects scenes with text, like slates, chyrons and credits.

pyscenedetect-wrapper

whisper-wrapper

A CLAMS wrapper for Whisper-based ASR software originally developed by OpenAI.

easyocr-wrapper

Using EasyOCR to extract text from timeframes

dbpedia-spotlight-wrapper

Apply named entity linking to all text documents in a MMIF file.

slatedetection

This tool detects slates.

fewshotclassifier

This tool uses a vision model to classify video segments. Currenly supports “chyron” frame type.

barsdetection

This tool detects SMPTE color bars.

east-textdetection

OpenCV-based text localization app that used EAST text detection model. Please visit the source code repository for full documentation.

parseqocr-wrapper

This tool applies Parseq OCR to a video or image and generates text boxes and OCR results.

tesseractocr-wrapper

This tool applies Tesseract OCR to a video or image and generates text boxes and OCR results.

chyron-detection

This tool detects chyrons, generates time segments.

gentle-forced-aligner-wrapper

This CLAMS app aligns transcript and audio track using Gentle. Gentle is a robust yet lenient forced aligner built on Kaldi.This app only works when Gentle is already installed locally.Unfortunately, Gentle is not distributed as a Python package distribution.To get Gentle installation instruction, see https://lowerquality.com/gentle/ Make sure install Gentle from the git commit specified in analyzer_version in this metadata.

tonedetection

Detects spans of monotonic audio within an audio file

spacy-wrapper

Apply spaCy NLP to all text documents in a MMIF file.

brandeis-acs-wrapper

Brandeis Acoustic Classification & Segmentation (ACS) is a audio segmentation tool developed at Brandeis Lab for Linguistics and Computation. The original software can be found at https://github.com/brandeis-llc/acoustic-classification-segmentation .

inaspeechsegmenter-wrapper

inaSpeechSegmenter is a CNN-based audio segmentation toolkit. The original software can be found at https://github.com/ina-foss/inaSpeechSegmenter .

aapb-pua-kaldi-wrapper

A CLAMS wrapper for Kaldi-based ASR software originally developed by PopUpArchive and hipstas, and later updated by Kyeongmin Rim at Brandeis University. Wrapped software can be found at https://github.com/brandeis-llc/aapb-pua-kaldi-docker .