Skip to content

Commit

Permalink
Add 232 CLIP Language Saliency Map (openvinotoolkit#825)
Browse files Browse the repository at this point in the history
* Add saliency map notebook

* Language Visual Saliency review (#1)

language review

* Lower n_iters and add readme

---------

Co-authored-by: Tatiana Savina <[email protected]>
  • Loading branch information
apaniukov and tsavina authored Feb 15, 2023
1 parent bd148b2 commit 4211f0c
Show file tree
Hide file tree
Showing 4 changed files with 1,063 additions and 0 deletions.
1,048 changes: 1,048 additions & 0 deletions notebooks/232-clip-language-saliency-map/232-clip-language-saliency-map.ipynb

Large diffs are not rendered by default.

14 changes: 14 additions & 0 deletions notebooks/232-clip-language-saliency-map/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# Language-Visual Saliency with CLIP and OpenVINO™

The notebook will cover the following topics:

* Explanation of a _saliency map_ and how it can be used.
* Overview of the CLIP neural network and its usage in generating saliency maps.
* How to split a neural network into parts for separate inference.
* How to speed up inference with OpenVINO™ and asynchronous execution.

## Saliency Map

A saliency map is a visualization technique that highlights regions of interest in an image. For example, it can be used to [explain image classification predictions](https://academic.oup.com/mnras/article/511/4/5032/6529251#389668570) for a particular label. Here is an example of a saliency map that we will get in this notebook:

![](saliency_map_clip.JPG)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions openvino_notebooks
Submodule openvino_notebooks added at bbd4c5

0 comments on commit 4211f0c

Please sign in to comment.