-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathindex.html
271 lines (229 loc) · 10.6 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>Novel View Synthesis: From Depth-Based Warping to Multi-Plane Images and Beyond</title>
<meta name="author" content="Orazio Gallo">
<meta name="keywords" content="deep learning, tutorial, novel view synthesis, Multi-Plane imaging, ">
<link rel="stylesheet" href="style.css">
<link rel="stylesheet" type="text/css" href="//fonts.googleapis.com/css?family=Open+Sans" />
</head>
<body>
<div align="center">
<div class="titlesection">
<h2>CVPR 2020 Tutorial on</h2>
<h1>Novel View Synthesis: From Depth-Based Warping to Multi-Plane Images and Beyond</h1>
<video loop="" autoplay="" muted="" height="167" ">
<source src="imgs/jump.mp4" type="video/mp4">
</video>
<video loop="" autoplay="" muted="" height="167" ">
<source src="https://storage.googleapis.com/nerf_data/website_renders/orchid.mp4" type="video/mp4">
</video>
<img src="imgs/synsin.gif" height="167">
<video loop="" autoplay="" muted="" height="167" ">
<source src="imgs/evs.mp4" type="video/mp4">
</video>
</div>
<div class="textsection">
Novel view synthesis is a long-standing problem at the intersection of computer graphics and computer vision.
Seminal work in this field dates back to the 1990s, with early methods proposing to interpolate either between corresponding pixels from the input images, or between rays in space.
Recent deep learning methods enabled tremendous improvements to the quality of the results, and brought renewed popularity to the field.
The teaser above shows novel view synthesis from different recent methods. <i>From left to right: Yoon et al. [1], Mildenhall et al. [2], Wiles et al. [3], and Choi et al. [4]. Images and videos courtesy of the respective authors.</i>
</div>
<div class="titlesection">
<h3 style="color:red"> >>> <a href="https://youtu.be/OEUHalxanuc?t=165", target="_blank">If you missed it, you can watch the full replay here</a> <<<</h3>
</div>
<div class="textsection">
We would like to thank again our speakers for the great talks, which made this tutorial really great.
You can also click on the links in the table below to go to specific talks.
We will share the slides from the talks soon.
</div>
<div class="textsection">
<h3>Goal of the Tutorial</h3>
In this tutorial we will first introduce the problem, including offering context and a taxonomy of the different methods. We will then have talks by the researchers behind the most recent approaches in the field.
At the end of the tutorial we will have a roundtable discussion with all the speakers.
</div>
<div class="textsection">
<h3>Date and Location</h3>
<div align="center">
The tutorial took place on June 14th, 2020 within CVPR 2020.</br>
Contact us <a href="mailto:[email protected]">here</a>.
</div>
</div>
<h3>Organizers</h3>
<div id="container_organizers">
<div class="box">
<img class="circularImage" src="imgs/orazio_s.jpeg" border="1" width="150" alt="Orazio's pic"></br>
<a href="http://alumni.soe.ucsc.edu/~orazio/", target="_blank">Orazio Gallo</a> <a href="https://twitter.com/0razio?ref_src=twsrc%5Etfw"><img src="imgs/twitter.jpeg" height="19"></a></br>
NVIDIA
</div>
<div class="box">
<img class="circularImage" src="imgs/alejandro_s.jpeg" border="1" width="150" alt="Alejandro's pic"></br>
<a href="https://research.nvidia.com/person/alejandro-troccoli", target="_blank">Alejandro Troccoli</a></br>
NVIDIA
</div>
<div class="box">
<img class="circularImage" src="imgs/varun_s.jpeg" border="1" width="150" alt="Varun's pic"></br>
<a href="https://varunjampani.github.io", target="_blank">Varun Jampani</a></br>
Google
</div>
<span class="stretch"></span>
</div>
<h3>Invited Speakers</h3>
<div id="container_speakers">
<div class="box">
<img class="circularImage" src="imgs/rick_s.jpg" border="1" width="150" alt="Rick's pic"></br>
<a href="http://szeliski.org/RichardSzeliski.htm", target="_blank">Rick Szeliski</a></br>
Facebook
</div>
<div class="box">
<img class="circularImage" src="imgs/pratul_s.jpg" border="1" width="150" alt="Pratul's pic"></br>
<a href="https://people.eecs.berkeley.edu/~pratul/", target="_blank">Pratul Srinivasan</a></br>
UC Berkeley
</div>
<div class="box">
<img class="circularImage" src="imgs/richard_s2.jpg" border="1" width="150" alt="Richard's pic"></br>
<a href="https://scholar.google.com/citations?hl=en&user=IkpNZAoAAAAJ", target="_blank">Richard Tucker</a></br>
Google
</div>
<div class="box">
<img class="circularImage" src="imgs/olivia_s.jpg" border="1" width="150" alt="Olivia's pic"></br>
<a href="http://www.robots.ox.ac.uk/~ow/", target="_blank">Olivia Wiles</a></br>
U. of Oxford
</div>
<span class="stretch"></span>
</div>
<div id="container_speakers_3">
<div class="box">
<img class="circularImage" src="imgs/jaeshin_s.jpg" border="1" width="150" alt="Jae Shin's pic"></br>
<a href="https://www-users.cs.umn.edu/~jsyoon/", target="_blank">Jae Shin Yoon</a></br>
UMN
</div>
<div class="box">
<img class="circularImage" src="imgs/gaurav_s.jpg" border="1" width="150" alt="Gaurav's pic"></br>
<a href="https://gchauras.github.io/research/", target="_blank">Gaurav Chaurasia</a></br>
Oculus
</div>
<div class="box">
<img class="circularImage" src="imgs/nima_s.jpg" border="1" width="150" alt="Nima's pic"></br>
<a href="http://faculty.cs.tamu.edu/nimak/", target="_blank">Nima Kalantari</a></br>
Texas A&M
</div>
<span class="stretch"></span>
</div>
<div class="vgap"></div>
<div class="textsection">
<div align="center">
<span>
<h2>Program with Link to the Videos of the Talks</h2>
Slides available <a href="https://drive.google.com/drive/folders/1q7w1AaJTViijxqVCZqZad5AGD3yaGDrf?usp=drive_link">here</a>.
<p>
<table style="width:95%">
<td></td>
<td bgcolor="#DDDDDD">Talk Title</td>
<td bgcolor="#DDDDDD">Speaker</td>
</tr>
<tr>
<td bgcolor="#DDDDDD">9:20 - 9:50</td>
<td>
Novel View Synthesis: A Gentle Introduction</br>
<a href="https://youtu.be/OEUHalxanuc?t=374", target="_blank">[Video]</a>
</td>
<td>Orazio</td>
</tr>
<tr>
<td bgcolor="#DDDDDD">9:50 - 10:20</td>
<td>
Reflections on Image-Based Rendering</br>
<a href="https://youtu.be/OEUHalxanuc?t=1823", target="_blank">[Video]</a>
</td>
<td>Rick</td>
</tr>
<tr>
<td bgcolor="#DDDDDD">10:20 - 10:50</td>
<td>
SynSin: Single Image View Synthesis</br>
<a href="https://youtu.be/OEUHalxanuc?t=4081", target="_blank">[Video]</a>
</td>
<td>Olivia</td>
</tr>
<tr>
<td>10:50 - 11:00</td>
<th>Coffee break (15m)</th>
<td></td>
</tr>
<tr>
<td bgcolor="#DDDDDD">11:00 - 11:30</td>
<td>
View synthesis with Multiplane Images</br>
<a href="https://youtu.be/OEUHalxanuc?t=6106", target="_blank">[Video]</a>
<!-- <a href="about:blank", target="_blank">[Slides]</a> -->
</td>
<td>Richard</td>
</tr>
<tr>
<td bgcolor="#DDDDDD">11:30 - 12:00</td>
<td>
View Synthesis and Immersive Mixed Reality for VR devices</br>
<a href="https://youtu.be/OEUHalxanuc?t=8134", target="_blank">[Video]</a>
</td>
<td>Gaurav</td>
</tr>
<tr>
<td>12:00 - 12:45</td>
<!-- <th colspan="2">Lunch break (45m)</th> -->
<th>Lunch break (45m)</th>
<td></td>
</tr>
<tr>
<td bgcolor="#DDDDDD">12:45 - 13:15</td>
<td>
View and Frame Interpolation for Consumer Light Field Cameras</br>
<a href="https://youtu.be/OEUHalxanuc?t=12570", target="_blank">[Video]</a>
</td>
<td>Nima</td>
</tr>
<tr>
<td bgcolor="#DDDDDD">13:15 - 13:45</td>
<td>
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis</br>
<a href="https://youtu.be/OEUHalxanuc?t=14308", target="_blank">[Video]</a>
<td>Pratul</td>
</tr>
<tr>
<td bgcolor="#DDDDDD">13:45 - 14:15</td>
<td>
Novel View Synthesis from Dynamic Scenes</br>
<a href="https://youtu.be/OEUHalxanuc?t=16154", target="_blank">[Video]</a>
<td>Jae Shin</td>
</tr>
<tr>
<td>14:15 - 14:30</td>
<th>Coffee break (15m)</th>
<td></td>
</tr>
<tr>
<td bgcolor="#DDDDDD">14:30 - 15:30</td>
<td>Round Table Discussion With the Invited Speakers</br>
<a href="https://youtu.be/OEUHalxanuc?t=18715", target="_blank">[Video]</a>
</td>
<td></td>
</tr>
</table>
</p>
</span>
</div>
</div>
<div class="textsection">
<h2>References</h2>
[1] Yoon, Kim, Gallo, Park, and Kautz, "Novel View Synthesis of Dynamic Scenes with Globally
Coherent Depths from a Monocular Camera" IEEE CVPR 2020.</br>
[2] Mildenhall, Srinivasan, Tancik, Barron, Ramamoorthi, and Ng, "NeRF: Representing Scenes
as Neural Radiance Fields for View Synthesis" arXiv 2020.</br>
[3] Wiles, Gkioxari, Szeliski, and Johnson, "SynSin: End-to-end View Synthesis from a Single Image"
IEEE CVPR 2020.</br>
[4] Choi, Gallo, Troccoli, Kim, and Kautz, "Extreme view synthesis" IEEE
ICCV 2019.</br>
</div>
</body>
</html>