-
Notifications
You must be signed in to change notification settings - Fork 5
/
index.html
279 lines (232 loc) · 11.9 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
<!DOCTYPE html>
<html lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1.0"/>
<title>In&Out</title>
<!-- CSS -->
<link href="https://fonts.googleapis.com/icon?family=Material+Icons" rel="stylesheet">
<link href="css/materialize.css" type="text/css" rel="stylesheet" media="screen,projection"/>
<link href="css/style.css" type="text/css" rel="stylesheet" media="screen,projection"/>
<link rel="stylesheet" href="css/main.css">
<link href="css/font-awesome.min.css" rel="stylesheet">
<!--<meta property="og:image" content="http://gph.is/2oZQz8h" />-->
</head>
<body>
<div class="navbar-fixed">
<nav class="grey darken-4" role="navigation">
<div classi="nav-wrapper container" >
<ul class="left hide-on-med-and-down">
<li><a class="page-scroll" href="#home">Home</a></li>
<li><a class="page-scroll" href="#abstract">Abstract</a></li>
<li><a class="page-scroll" href="#paper">Paper</a></li>
<li><a class="page-scroll" href="#models">Models</a></li>
<li><a class="page-scroll" href="#results">Results</a></li>
</ul>
</div>
</nav>
</div>
<div class="section no-pad-bot" id="index-banner">
<div class="container scrollspy" id="home">
<h4 class="header center black-text">In&Out: Diverse Image Outpainting via GAN Inversion</h4>
<!-- <h4 class="header center black-text">Disentangled Representation</h4> -->
<br>
<div class="row center">
<!-- <h5 class="header col m1 s12">
</h5> -->
<h5 class="header col m2 s12">
<div class="author"><a href="https://yccyenchicheng.github.io/" target="blank">Yen-Chi Cheng</a><sup>1</sup></div>
<!-- <div class="school"><a href="https://www.cmu.edu/" target="blank">Carnegie Mellon University</a></div> -->
</h5>
<h5 class="header col m2 s12">
<div class="author"><a href="https://hubert0527.github.io/" target="blank">Chieh Hubert Lin</a><sup>2</sup></div>
<!-- <div class="school"><a href="http://www.ucmerced.edu/" target="blank">UC, Merced</a></div> -->
</h5>
<h5 class="header col m2 s12">
<div class="author"><a href="http://hsinyinglee.com" target="blank">Hsin-Ying Lee</a><sup>3</sup></div>
<!-- <div class="school"><a href="https://snap.com/" target="blank">Snap Inc.</a></div> -->
</h5>
<h5 class="header col m2 s12">
<div class="author"><a href="https://alanspike.github.io/" target="blank">Jian Ren</a><sup>3</sup></div>
<!-- <div class="school"><a href="https://snap.com/" target="blank">Snap Inc.</a></div> -->
</h5>
<h5 class="header col m2 s12">
<div class="author"><a href="http://www.stulyakov.com/" target="blank">Sergey Tulyakov</a><sup>3</sup></div>
<!-- <div class="school"><a href="https://snap.com/" target="blank">Snap Inc.</a></div> -->
</h5>
<h5 class="header col m2 s12">
<div class="author"><a href="http://faculty.ucmerced.edu/mhyang/" target="blank">Ming-Hsuan Yang</a><sup>2, 4</sup></div>
<!-- <div class="school"><a href="http://www.ucmerced.edu/" target="blank">UC, Merced</a></div> -->
</h5>
</div>
<!-- <div class="row center" style="margin-top:-100px"> -->
<div class="row center">
<h5 class="header col m2 s12"></h5>
<h5 class="header col m2 s12">
<div class="school"><a href="http://www.ucmerced.edu/" target="blank"><sup>1</sup>Carnegie Mellon University</a></div>
</h5>
<h5 class="header col m2 s12">
<div class="school"><a href="https://www.pku.edu.cn/" target="blank"><sup>2</sup>UC, Merced</a></div>
</h5>
<h5 class="header col m2 s12">
<div class="school"><a href="http://www.vt.edu/" target="blank"><sup>3</sup>Snap Inc.</a></div>
</h5>
<h5 class="header col m2 s12">
<div class="school"><a href="http://www.verisk.com/" target="blank"><sup>4</sup>Google Research</a></div>
</h5>
</div>
</div>
</div>
<div class="publ center">
<ul>
<li><a href="https://arxiv.org/abs/2104.00675">Paper</a></li>
<li><a href="https://github.com/yccyenchicheng/InOut">Code</a></li>
</ul>
</div>
<div class="container">
<div class="section">
<!-- Icon Section -->
<div class="row center">
<div id="scroll-out-container" class="col l10 offset-l1 m10 offset-m1 s12">
<!--div class="col-sm-12"-->
<!-- <img class="responsive-img" src="images/vstack.gif" hspace="10"> -->
<div style="margin: 0 auto;">
<div class="teaser-arrow-text" style="text-align: right;">Outpaint</div>
<div class="teaser-arrow" style="text-align: right;">↤</div>
<div class="teaser-center">Real Image</div>
<div class="teaser-arrow" style="text-align: left;">↦</div>
<div class="teaser-arrow-text" style="text-align: left;">Outpaint</div>
</div>
<div id="scroll-out-block-left" class="scroll-out-block"></div>
<img class="responsive-img" src="images/pano_teaser.png">
<div id="scroll-out-block-right" class="scroll-out-block"></div>
</div>
</div>
</div>
<br>
<section id="abstract" class="abstract-section">
<div class="row section scrollspy">
<div class="title">Abstract</div>
Image outpainting seeks for a semantically consistent extension of the input image beyond its available content. Compared to inpainting --- filling in missing pixels in a way coherent with the neighboring pixels --- outpainting can be achieved in more diverse ways since the problem is less constrained by the surrounding pixels.
Existing image outpainting methods pose the problem as a conditional image-to-image translation task, often generating repetitive structures and textures by replicating the content available in the input image.
In this work, we formulate the problem from the perspective of inverting generative adversarial networks.
Our generator renders micro-patches conditioned on their joint latent code as well as their individual positions in the image.
To outpaint an image, we seek for multiple latent codes not only recovering available patches but also synthesizing diverse outpainting by patch-based generation.
This leads to richer structure and content in the outpainted regions.
Furthermore, our formulation allows for outpainting conditioned on the categorical input, thereby enabling flexible user controls.
Extensive experimental results demonstrate the proposed method performs favorably against existing in- and outpainting methods, featuring higher visual quality and diversity.
</div>
</section>
<br>
<section id="paper" class="paper-section">
<div class="row section scrollspy">
<div class="title">Paper</div>
<br>
<div class="col s8 offset-s2">
<div id='paper-thumbnail'>
<!-- <a href="../publication/ECCV18_DRIT.pdf" target="_blank"> -->
<a href="https://arxiv.org/abs/2104.00675" target="_blank">
<img class="responsive-img" src="images/InOut_thumbnail.png">
<!-- <img class="responsive-img" src="images/paper_thumbnail.png"> -->
</a>
</div>
</div>
</div>
<div class="row">
<div class="subtitle">Citation</div>
<p>Yen-Chi Cheng, Chieh Hubert Lin, Hsin-Ying Lee, Jian Ren, Sergey Tulyakov, Ming-Hsuan Yang, "In&Out: Diverse Image Outpainting via GAN Inversion", in arXiv, 2021.</p>
<br>
<div class="subtitle">Bibtex</div>
<pre>
@article{InOut,
author = {Cheng, Yen-Chi and Lin, Chieh Hubert and Lee, Hsin-Ying and Ren, Jian and Tulyakov, Sergey and Yang, Ming-Hsuan},
title = {In&Out: Diverse Image Outpainting via GAN Inversion},
volume = {abs/2104.00675},
year = {2021}
}</pre>
</div>
</section>
<section id="models" class="model-section">
<div class="title">Overview</div>
<div class="row center">
<!--div class="col l8 offset-l2 m10 offset-m1 s12"-->
<div class="col-sm-10">
<img class="responsive-img" src="images/teaser.png">
</div>
</div>
<div class="col s6 offset-s3">
<!-- <img class="responsive-img" src="images/architecture.png"> -->
<img class="responsive-img" src="images/arch.png">
</div>
</section>
<section id="results" class="result-section">
<div class="section row scrollspy">
<div class="title">Results</div>
<div class="row center">
<div class="subtitle" id="Flickr">Flickr-Landscape</div>
Outpainting results of the collected Flickr-Landscape dataset.
<img class="responsive-img" src="images/Flickr.png">
</div>
<div class="row center">
<div class="subtitle" id="LSUN">LSUN-Church</div>
Outpainting results of the church cateogry of the LSUN dataset.
<img class="responsive-img" src="images/Church.png">
</div>
<br>
<div class="row center">
<div class="subtitle" id="Compare">Comparisons</div>
The proposed approach is more stable, synthesizes richer context with more complex structures, and is able to handle some of the difficultcomplex scenes.
<div class="col s12">
<img class="responsive-img" src="images/compare.png">
</div>
</div>
<br>
<div class="row center">
<div class="subtitle" id="multi">Multi-directional and irregular-boundary outpainting</div>
The proposed method can naturally handle outpainting to any direction and with irregular boundaries.
<div class="col s8 offset-s2">
<img class="responsive-img" src="images/multi_and_irr.png">
</div>
</div>
<br>
<div class="row center">
<div class="subtitle" id="Pano">Panorama</div>
The proposed method can perform panorama generation of high quality and high structural complexity without repeating patterns.
<img class="responsive-img" src="images/pano.png">
</div>
</div>
</section>
<section id="reference" class="reference-section">
<div class="row section scrollspy">
<div class="title">References</div>
<ul>
<li>•
Piotr Teterwak, Aaron Sarna, Dilip Krishnan, Aaron Maschinot, David Belanger, Ce Liu, William T Free-man. <a href="https://arxiv.org/abs/1908.07007">Boundless: Generative adversarial networks for imageextension. InICCV, 2019</a>, ICCV, 2019
</li>
<li>•
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas S Huang. <a href="https://arxiv.org/abs/1801.07892">Generative image inpainting with contextual attention</a>, CVPR, 2018
</li>
<li>•
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas S Huang. <a href="https://arxiv.org/abs/1806.03589">Free-form image inpainting with gated convolution</a>, ICCV, 2019
</li>
<li>•
Zongxin Yang, Jian Dong, Ping Liu, Yi Yang, Shuicheng Yan. <a href="https://arxiv.org/abs/1912.12688">Very long natural scenery image prediction by outpainting</a>, ICCV, 2019
</li>
<li>•
Rameen Abdal, Yipeng Qin, and Peter Wonka. <a href="https://arxiv.org/abs/1911.11544">Image2stylegan++: How to edit the embedded images?</a>, CVPR, 2020
</li>
</ul>
</div>
</section>
</div>
<footer class="page-footer grey lighten-3">
<div class="footer-copyright center black-text">
Copyright © Yen-Chi Cheng & Hsin-Ying Lee 2021
</div>
</footer>
<!-- Scripts-->
<script src="https://code.jquery.com/jquery-2.1.1.min.js"></script>
<script src="js/init.js"></script>
<script src="js/materialize.js"></script>
</body>
</html>