[DL輪読会]Neural 3d Mesh Renderer

DEEP LEARNING JP [DL Papers] Neural 3D Mesh Renderer Kohei Nishimura, Izumi Lab h9p://deeplearning.jp/

t pm : • - : • 2 • . ,2D / : 0 :DH 7 . : .2D H2 22 2 H k • – souxK – soux fYU • – DDA : sob b hj • :D2 2 / dc dc e Nyv e l b D 1 21 d Te rn a Y 2 2D A D _ • DDA :D 3 : 2 2D 21 • DDA :D 3 : 2 2D 1 D D: ij rn g f e

• http://hiroharu-kato.com/projects_en/neural_renderer.html
• https://github.com/hiroharu-kato/neural_renderer
• https://github.com/hiroharu-kato/mesh_reconstruction

)2 • : - – ,3 : )2 . D( ,3

: 2 : • – D 2 3 2 ! "2 !% 2 • – – : "2 !&' 2 2 • – #$ 2 , 2 !& 2 2 2 2 2 !% !&(

: • : – d • – ( . b ( • – .)

• : : – !"# $" ( ( , – % & ) : 1 – !'( = % &+, − %(&/ ) !'( = % &+2 − %(&/ ) – !3, = &+, − &/ !32 = &+2 − &/ P )

:, !"# . :, • $% – – '& $ % – '" $ & . : !"# . – !"# = $ % + '& ⋅ '" $ & !" .$ % $ & '& , 2 $&

•

]"#

!D

–

D

(

–

4
D)(()

4

–
]

–

?{+
,# = $() ( , "# }:
]

• 2 ∈ $567

×9

.

6

/# → /# + 2# + 3

3 ∈ $:×9
,

•
•

D$(!, ")

2
.

[D

3

:

D

ba

D

(

dg

• !(#) (
(
D
–
D
• {&' } .
,
D S
• {)
&' = +(! # , -' } (em
3
• .' !(#) D
D
• / !(#) D>
D
– !(#)Dni
• )2
• )3

h

gl

:3
(D

S

k

0 = 123 L56 + 128 L59

- -2
-

023 # -' , &' = −
2

2); ⊙2; =
2); >2; ?2); ⊙2; =

L59 # = ∑ A; ∈C

•
–

ni

123 = 1, 128 = 0.001

DE&.' + 1

G

:

ml

c

f

3
#$ C

!"

•
–

rn

3

•

32 .2 3

•

32 .2 3

• )

.

.

.

2 . Gn
!$

2 .
. 3

%$

2 .

%" G a

!

e

%$ ! ! $ = '$ (!) − '$ ! $

+

+

%" ! ! " = ,('" ! ) − ,('" ! " + )

. (3

+

-

– '$ ! , '" !
G

– , !

3

–

.

sy

2 .

% = /$ %$ + /" %" + /1 %1

•
–

32 .2 (3

%$ = ∑ 3 ,3 5

. (3

%" = , '" : #, ;

– )

:(#, ;)

5
4 4 ∈(7,7 )

t

;

?

D

#
∈<

+

+

− , '" !"

:

%1 # ; = ∑ <=,<>

–

89 − 89$

?@ − ?A

S

]
+
+

+
-

[

Lo

.

2 .

3
•
!2 .
3

"(!) .

−" !

'
&

.

,2

,

•
(2 .

:D)3

!2 .
:D3
.

*(), ()

"(!) .
,,2

.- 2
,

− " * ), (

'
&

0 • – 62 348 -42 348 – 62 348 E D c – -42 348 , • • 0 a ): – • d F C ) - )A eC 31 D G c ( :( mD a

( Gfeh Gfeh • – 1 4 ( A = U O – a – lc T A:= =C := i pGU , lc rs ps T v U tx d • – .=3( : A U – = , – rs 62 A U , h U o T ps h O , oSn 32# UC=D .=3U N uI O C 4= 4 .=3 ) 4= 3 :=

> • 3 1 2 1 2 - 0:

2 - - , -

1 • I I U2 0 0 • • 3 D . D 3