Skip to content

Commit

Permalink
add demo video
Browse files Browse the repository at this point in the history
  • Loading branch information
mv-lab committed Feb 4, 2024
1 parent 7c4ffa1 commit d65ff5c
Show file tree
Hide file tree
Showing 4 changed files with 22 additions and 21 deletions.
17 changes: 9 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# InstructIR ✏️🖼️
## [High-Quality Image Restoration Following Human Instructions](https://mv-lab.github.io/InstructIR/)
## [High-Quality Image Restoration Following Human Instructions](https://arxiv.org/abs/2401.16468)

[![arXiv](https://img.shields.io/badge/arXiv-Paper-<COLOR>.svg)](https://arxiv.org/abs/2401.16468)
<a href="https://colab.research.google.com/drive/1OrTvS-i6uLM2Y8kIkq8ZZRwEQxQFchfq?usp=sharing"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="google colab logo"></a>
Expand All @@ -8,11 +8,15 @@
[![Paper page](https://huggingface.co/datasets/huggingface/badges/resolve/main/paper-page-sm.svg)](https://huggingface.co/papers/2401.16468)


[Marcos V. Conde](https://scholar.google.com/citations?user=NtB1kjYAAAAJ&hl=en), [Gregor Geigle](https://scholar.google.com/citations?user=uIlyqRwAAAAJ&hl=en), [Radu Timofte](https://scholar.google.com/citations?user=u3MwH5kAAAAJ&hl=en)
[Marcos V. Conde](https://mv-lab.github.io/), [Gregor Geigle](https://scholar.google.com/citations?user=uIlyqRwAAAAJ&hl=en), [Radu Timofte](https://scholar.google.com/citations?user=u3MwH5kAAAAJ&hl=en)

Computer Vision Lab, University of Wuerzburg | Sony PlayStation, FTG

<a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir_teaser.png" alt="InstructIR" width=100%></a>

<a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir.gif" alt="InstructIR" width=100%></a>

Video courtesy of Gradio ([see their post about InstructIR](https://twitter.com/Gradio/status/1752776176811041049)). Also shoutout to AK -- [see his tweet](https://twitter.com/_akhaliq/status/1752551364566126798).


### TL;DR: quickstart
InstructIR takes as input an image and a human-written instruction for how to improve that image. The neural model performs all-in-one image restoration. InstructIR achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement.
Expand Down Expand Up @@ -45,12 +49,9 @@ Image restoration is a fundamental problem that involves recovering a high-quali
🚀 You can start with the [demo tutorial](demo.ipynb). We also host the same tutorial on [google colab](https://colab.research.google.com/drive/1OrTvS-i6uLM2Y8kIkq8ZZRwEQxQFchfq?usp=sharing) so you can run it using free GPUs!.


| | |
|----------|:-------------:
| <a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir_teaser.gif" alt="InstructIR App"></a> | <a href="https://mv-lab.github.io/InstructIR/"><img src="static/replicate.png" alt="InstructIR App"></a> |

<a href="https://mv-lab.github.io/InstructIR/"><img src="images/instructir_teaser.png" alt="InstructIR" width=100%></a>

### Gradio Demo
### Gradio Demo <a href='https://github.com/gradio-app/gradio'><img src='https://img.shields.io/github/stars/gradio-app/gradio'></a>
We made a simple [Gradio demo](app.py) you can run (locally) on your machine [here](app.py). You need Python>=3.9 and [these requirements](requirements_gradio.txt) for it: `pip install -r requirements_gradio.txt`

```
Expand Down
Binary file added images/instructir.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added images/instructir.mp4
Binary file not shown.
26 changes: 13 additions & 13 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -117,7 +117,7 @@ <h1 class="title is-1 publication-title">InstructIR: High-Quality Image Restorat
<br>
<div class="is-size-4 publication-authors">
<span class="author-block">
<a href="https://scholar.google.com/citations?user=NtB1kjYAAAAJ" style="color:#f68946;font-weight:normal;">Marcos V. Conde<sup>1,2</sup></a>,
<a href="https://mv-lab.github.io/" style="color:#f68946;font-weight:normal;">Marcos V. Conde<sup>1,2</sup></a>,
</span>
<span class="author-block">
<a href="https://scholar.google.com/citations?user=uIlyqRwAAAAJ&hl=en" style="color:#008AD7;font-weight:normal;">Gregor Geigle<sup>1</sup></a>,
Expand Down Expand Up @@ -195,7 +195,7 @@ <h1 class="title is-1 publication-title">InstructIR: High-Quality Image Restorat
<!-- Abstract. -->
<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<h2 class="title is-3">TL;DR & Abstract </h2>
<h2 class="title is-3">TL;DR</h2>

<div class="content has-text-justified">

Expand All @@ -211,16 +211,6 @@ <h2 class="title is-3">TL;DR & Abstract </h2>
<br>
<br>

<center>
<details>
<summary> <h3> Abstract</h4> (click me to read)</summary>
<p align="justify">
Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement.
</p>
</details>
</center>


</div>

</div>
Expand All @@ -236,7 +226,17 @@ <h2 class="title is-3">TL;DR & Abstract </h2>
<div class="columns is-centered has-text-centered">
<div class="column is-six-fifths">
<h2 class="title is-3"> Examples of InstructIR</h2>
<img src="images/instructir_teaser.png" width="50%">

<video width="860" height="640" autoplay loop controls>
<source src="images/instructir.mp4" type="video/mp4">
Your browser does not support the video tag.
</video>

<!--
<img src="images/instructir_teaser.png" width="50%">
-->


</div>
</div>

Expand Down

0 comments on commit d65ff5c

Please sign in to comment.