nordlicht - create colorful timebars from video and audio files

nordlicht is a tool that converts video and audio files into colorful timebars. nordlicht is free software, supports a large number of styles, and is optimized for speed. It comes with a software library written in C that allows for easy integration into other programs.

Examples

The Lion King (1994)

Finding Nemo (2003)

Titanic (1997)

Even if you don’t know the movies, you can probably spot the fire scene in The Lion King, the dirty fish tank scene in Finding Nemo, and the sinking scene in Titanic. You can also see the credits, and spot outdoor scenes (which feature a blue sky in the upper half).

nordlicht creates these images by taking the movies’ frames in regular intervals, scaling them to 1 pixel width, and putting them next to each other.

Styles

The default style is horizontal, which compresses each frame to a single column before appending them. This style emphasizes landscapes and up-and-down movement. Also, it is usually the best style for differentiating scenes:

Cosmos Laundromat (2015), horizontal

The vertical style, on the other hand, compresses each individual frames to a single row, rotates them counterclockwise by 90 degrees, and then sticks them together. This style emphazizes horizontal movement and sometimes lets you recognize objects or characters standing next to each other:

Cosmos Laundromat (2015), vertical

The simple thumbnails style just creates a row of thumbnails as you would expect:

Cosmos Laundromat (2015), thumbnails

When using the middlecolumn style, nordlicht will not compress the frames, but just go with the middlemost column of each frame. This is like watching the movie through a thin crack. It highlights colors and texture in the center of the screen, and can result in interesting effects when the camera is moving sideways:

Cosmos Laundromat (2015), middlecolumn

The slitscan style works in a similar way, but instead of always selecting the middle column, the selected column is moved over the width of the video from left to right, so that one pass takes as long as one frame in the thumbnails style. Think of it as watching the movie through a thin, moving crack. This style is interesting because for long, static scenes, parts of the content becomes recognizable while still maintaining accuracy:

Cosmos Laundromat (2015), slitscan

Finally, the spectrogram style is different from all previous styles because it analyzes the file’s audio track and creates a spectrogram: Low frequencies are at the bottom, high frequencies at the top, and the color describes the volume of that frequency (warmer colors means higher volume):

Cosmos Laundromat (2015), spectrogram

For convenience, nordlicht also supports putting multiple styles in the same image. For example, this is the resulting image for the style slitscan+spectrogram:

Cosmos Laundromat (2015), slitscan+spectrogram

What’s next?

If you’re interested, you can learn how to install and use nordlicht. Also make sure to check out our long-term goals on the integrations page!

License: GPLv2+

nordlicht is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

The header image shows an aurora borealis, which is called “Nordlicht” (nord-/lɪçt/) in German. The picture was taken in Greenland during the Shelios 2012 expedition and is available under the Creative Commons Attribution-NonCommercial License.