forked from openvinotoolkit/openvino_notebooks
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add 232 CLIP Language Saliency Map (openvinotoolkit#825)
* Add saliency map notebook * Language Visual Saliency review (#1) language review * Lower n_iters and add readme --------- Co-authored-by: Tatiana Savina <[email protected]>
- Loading branch information
Showing
4 changed files
with
1,063 additions
and
0 deletions.
There are no files selected for viewing
1,048 changes: 1,048 additions & 0 deletions
1,048
notebooks/232-clip-language-saliency-map/232-clip-language-saliency-map.ipynb
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
# Language-Visual Saliency with CLIP and OpenVINO™ | ||
|
||
The notebook will cover the following topics: | ||
|
||
* Explanation of a _saliency map_ and how it can be used. | ||
* Overview of the CLIP neural network and its usage in generating saliency maps. | ||
* How to split a neural network into parts for separate inference. | ||
* How to speed up inference with OpenVINO™ and asynchronous execution. | ||
|
||
## Saliency Map | ||
|
||
A saliency map is a visualization technique that highlights regions of interest in an image. For example, it can be used to [explain image classification predictions](https://academic.oup.com/mnras/article/511/4/5032/6529251#389668570) for a particular label. Here is an example of a saliency map that we will get in this notebook: | ||
|
||
![](saliency_map_clip.JPG) |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Submodule openvino_notebooks
added at
bbd4c5