AUDIO & VIDEO ANALYSIS

• Audio Demux

  1. Version:  2.2.1
  2. Language: C++
  3. Purpose: processing step, separates audio from audio/video stream, resampling
  4. License: GPL (sources available in extractor repository)

• Speech-to-text (Kaldi)

  1. Version:  2.2.0
  2. Language: Java
  3. Purpose: annotation, transform audio into text annotations
  4. License: ASL2.0 (sources available in extractor repository)

• Speech-to-text (BING)

  1. Version:  1.1.0
  2. Language: Java
  3. Purpose: annotation, transform audio into text annotations
  4. License: ASL2.0 (sources available in extractor repository, MS Bing API access required)

• Temporal Video Segmentation

  1. Version:  2.2.0
  2. Language: C++
  3. Purpose: shot annotation, shot and key frame extraction
  4. License: Proprietary (FhG,  available on request)

• Media Quality

  1. Version:  discontinued
  2. Language: C++
  3. Purpose: media quality annotation for different quality features
  4. License: Proprietary (FhG,  available on request)

• Audio Editing Detection

  1. Version:  2.0.0
  2. Language: C++
  3. Purpose: annotates whether an audio track has been edited / cut or not
  4. License: Proprietary (FhG, available on request)

• Media Info

  1. Version:  2.0.0
  2. Language: C++
  3. Purpose: annotation of technical media metadata (container, codec)
  4. License: ASL2.0  (sources available in extractor repository)

• MediaTags2rdf

  1. Version:  0.9.0
  2. Language: Java
  3. Purpose: annotation helper for Media Info extractor
  4. License: ASL2.0  (sources available in extractor repository)

• Speech Music Discrimination

  1. Version:  discontinued
  2. Language: C++
  3. Purpose: annotation whether an audio track contains speech or music
  4. License: Proprietary (FhG, available on request)

IMAGE ANALYSIS

• Animal Detection (HoG based)

  1. Version:  2.1.1
  2. Language: C++
  3. Purpose: detection and annotation of animals (model for 10 species)
  4. License: ASL2.0 (sources available in extractor repository)

• Animal Detection (DPM based)

  1. Version:  1.0.2
  2. Language: C++
  3. Purpose: detection and annotation of animals (model for 10 species)
  4. License: ASL2.0 (sources available in extractor repository)

• Animal Detection (CNN based)

  1. Version:  1.0.2
  2. Language: C++
  3. Purpose: detection and annotation of animals (model for 10 species)
  4. License: ASL2.0 (sources available in extractor repository)

• Face Detection

  1. Version:  2.1.0
  2. Language: C++
  3. Purpose: detection and annotation of human faces in images or videos
  4. License: ASL2.0 (sources available in extractor repository)

• ObjectDetection2RDF

  1. Version:  2.2.0
  2. Language: Java
  3. Purpose: annotation helper, converts native object annotation (face detection, animal detection) into MICO RDF
  4. License: ASL2.0 (sources available in extractor repository)

TEXT ANALYSIS

• Diarization

  1. Version:  1.3.0
  2. Language: Java
  3. Purpose: processing step, separates sentences to words
  4. License: ASL2.0 (sources available in extractor repository)

• Kaldi2rdf

  1. Version:  3.1.0
  2. Language: Java
  3. Purpose: annotation helper, converts Kaldi speech to text annotations into MICO RDF
  4. License: ASL2.0 (sources available in extractor repository)

• Kaldi2txt

  1. Version:  2.2.0
  2. Language: Java
  3. Purpose: processing step, converts Kaldi speech to text annotations into plain text
  4. License: ASL2.0 (sources available in extractor repository)

• Redlink Text Analysis

  1. Version:  1.0.0
  2. Language: Java
  3. Purpose: annotation of named entity recognition results
  4. License: ASL2.0 (sources available in extractor repository, Redlink API access required)

• OpenNLP NER

  1. Version:  1.3.0
  2. Language: Java
  3. Purpose: annotation of named entity recognition results
  4. License: ASL2.0  (sources available in extractor repository)

• OpenNLP Competence

  1. Version:  1.2.0
  2. Language: Java
  3. Purpose: annotation of competence classification results
  4. License: ASL2.0  (sources available in extractor repository)

• OpenNLP Sentiment

  1. Version:  1.2.0
  2. Language: Java
  3. Purpose: annotation of sentiment analysis results
  4. License: ASL2.0  (sources available in extractor repository)

• Text Language detection

  1. Version:  1.0.2
  2. Language: Java
  3. Purpose: annotation of language used in plain text
  4. License: ASL2.0 (sources available in extractor repository)