InstructIR: High-Quality Image Restoration Following Human Instructions

Marcos V. Conde^1,2, Gregor Geigle¹, Radu Timofte¹,

▶ ¹Computer Vision Lab, University of Wuerzburg ▶ ²Sony PlayStation, FTG

TL;DR

InstructIR takes as input an image and a human-written instruction for how to improve that image. The (single) neural model performs all-in-one image restoration. InstructIR achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. Test the model now on HF 🤗 InstructIR space
🚀 You can start with the demo tutorial from our github.

🔥🔥 More content comming soon: all test results, more model versions, tables, etc.

Examples of InstructIR

Demo App 🤗

User

Do you know who drew this painting?

LLaVA

The painting depicts a woman, commonly believed to be Mona Lisa, the famous artwork by Leonardo da Vinci. It is a portrait painting that showcases the woman's enigmatic smile and has become one of the most famous and iconic art pieces in the world. The original work is displayed in the Louvre Museum in Paris, and it is known for its intricate details, use of oil paint, and the artist's innovative techniques that contributed to its enduring appeal and mystery.

Citation BibTeX


    @misc{conde2024instructir,
      title={High-Quality Image Restoration Following Human Instructions}, 
      author={Marcos V. Conde, Gregor Geigle, Radu Timofte},
      year={2024},
      journal={arXiv preprint}
    }

Acknowledgement

This work was partly supported by the The Humboldt Foundation (AvH). Marcos Conde is also supported by Sony Interactive Entertainment, FTG. This work is inspired in InstructPix2Pix.
For any inquiries contact Marcos V. Conde: marcos.conde [at] uni-wuerzburg.de

This website is adapted from Nerfies and LLaVA, licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. We thank the original authors of this website template.