ReCoDi Pipeline Overview

ReCoDi – Refinable Colorization of Historic Imagery via Conditional Diffusion Models

Film archives and museums all over the world contain large amounts of historic videos and imagery, only available as either monochrome or even black-and-white documents. While digitization and in some cases digital restoration preserves these cultural assets from decay, marketing of these historic documents is difficult due to limited public acceptance caused by their archaic look. Colorization techniques make the depictions of historic events visually appealing such that they are interesting to a larger audience. However, colorizing historic imagery remains a highly labor- and cost-intensive process, which prevents its more widespread use to this day. ReCoDi addresses the most costly step in the colorization process of historic films, namely the colorization of single keyframes respecting authentic historic looks. Such keyframes are the basis for any further color propagation tools. This project aims to combine state-of-the-art deep learning-based image generation approaches, novel conditioning strategies for these generative models, and efficient user control into a unified optimization framework.

Project Consortium

  • Institute of Visual Computing (IVC)
  • HS-ART, specialists for digital film restoration

Project Duration

2024 - 2027

Dissemination

Peer-Reviewed Publications:
  • STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection, J. Micorek, M. Koziński & H. Possegger, In Proc. of the European Conference on Computer Vision (ECCV), 2026
  • M. Negovetić & H. Possegger, In Proc. of the AI Summit Styria (AIS), 2026
Completed Theses:
  • M. Negovetić, Leveraging Temporal Context for 4K Video Super-Resolution, Master's Thesis, Faculty of Computer Science & Biomedical Engineering, 2026
  • F. Kaltenegger, A Guidance Model for Image Colorization, Bachelor Thesis, Faculty of Computer Science & Biomedical Engineering, 2025
Example of text- and scribble-based colorization results: Colorization results with different text conditioning and color scribbles.

Project Funding

This project was funded under the BRIDGE programme of the Austrian Federal Ministry of Innovation, Mobility and Infrastructure. The Austrian Research Promotion Agency (FFG) has been authorised for the programme management.