Multicaptions

Multicaptions is an open source captioning technology for media installations in museums, galleries, and other public institutions that accommodates opt-in viewing of captions in multiple languages without impinging on the video image.

Running on a Raspberry Pi, Multicaptions displays fullscreen video (up to full HD) while simultaneously processing and displaying subtitles in one or more selectable languages on a separate graphic LCD or VFD display. It is an affordable, easy-to-build, easy-to-maintain, open source project using completely off-the-shelf hardware.

Multicaptions is inspired by Figaro System’s Simultext (known as “Met Titles” at the NYC Metropolitan Opera).

Hardware Requirements

• Raspberry Pi 2 Model B or above
• a monitor and HDMI cable
• cables and components
  • 5V 2.4 Amp power supply for the Raspberry Pi
  • microSD card for the Raspberry Pi (at least 4GB)
  • pushbutton for cycling through languages (optional)
  • jumper wires for connecting pushbutton (optional)
• LCD option
  • Crystalfontz CFAG24064A graphic LCD display
  • Arduino Mega 2560
  • A to B USB cable for connecting the Arduino to the Raspberry Pi
  • 10K potentiometer for setting the LCD display contrast
  • jumper wires for connecting Arduino to LCD display
• VFD option
  • Noritake GU256x64F-3900B Vacuum Fluorescent Display
  • RS-232 DE-9 to 7 pin Kit (with 24V power adapter)
  • USB to RS-232 DB9 Serial Adapter

Setup and Installation

See LCD or VFD branches for detailed instructions.

Notes

Multicaptions currently requires that SRT files for the same video have the same number of subtitles with the same start and end times, regardless of language, with a maximum of two lines per subtitle. (e.g. The demo video has 88 subtitles.)

Thanks

• Big ups to @olikraus for their indispensible u8g2 library, without which none of this would be possible.
• Many thanks to Moe Jangda for his work getting the Raspberry Pi to talk to the LCD display.
• High fives to Sean McIntyre for refactoring my code.