Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

Commitec86a3b

Browse files
committed
update models
1 parent4f9db18 commitec86a3b

File tree

4 files changed

+115
-17
lines changed

4 files changed

+115
-17
lines changed

‎README.md‎

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -152,6 +152,20 @@ Download the pretrained model ([ResNet-34](https://drive.google.com/file/d/16Y_M
152152

153153
</center>
154154

155+
##MODEL ZOO
156+
157+
| Backbone| Training Data| PA-MPJPE (3DPW)| MPJPE (3DPW)| PA-MPJPE (Human3.6M)| MPJPE (Human3.6M)| Download| Config|
158+
|----------|----------|------------|------------|-------|-----------|--------|--------------|
159+
| ResNet-34| w/o 3DPW|||||[model]()|[cfg]()|
160+
| ResNet-34| w/ 3DPW| 44.5| 72.4| 33.8| 55.5|[model](https://drive.google.com/file/d/19ktHbERz0Un5EzJYZBdzdzTrFyd9gLCx/view?usp=share_link)|[cfg](./configs/256x192_adam_lr1e-3-res34_smpl_3d_cam_2x_mix_w_pw3d.yaml)|
161+
| HRNet-W48| w/o 3DPW| 48.6| 88.0| 29.5| 50.4|[model](https://drive.google.com/file/d/1o3z99bebm2XImElc3XEUzTNVhQboGJE9/view?usp=share_link)|[cfg](./configs/256x192_adam_lr1e-3-hrw48_cam_2x_wo_pw3d.yaml)|
162+
| HRNet-W48| w/ 3DPW| 41.8| 71.3| 29.8| 47.1|[model](https://drive.google.com/file/d/1gp3549vIEKfbc8SDQ-YF3Idi1aoR3DkW/view?usp=share_link)|[cfg](configs/256x192_adam_lr1e-3-hrw48_cam_2x_w_pw3d_3dhp.yaml)|
163+
164+
165+
####Notes
166+
- All models assume a fixed focal length and predict camera parameters.
167+
- Flip test is used by default.
168+
155169

156170
##Citing
157171
If our code helps your research, please consider citing the following paper:

‎configs/256x192_adam_lr1e-3-hrw48_cam_2x_w_pw3d_3dhp.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ DATASET:
2121
MODEL:
2222
TYPE:'HRNetSMPLCam'
2323
HR_PRETRAINED:'./pose_hrnet_w48_256x192.pth'
24-
PRETRAINED:'./exp/hrnetw48_ckpt13.pth'
24+
PRETRAINED:''
2525
# TRY_LOAD: ''
2626
TRY_LOAD:''
2727
RESUME:''
Lines changed: 79 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,79 @@
1+
DATASET:
2+
DATASET:'mix_smpl_cam'
3+
SET_LIST:
4+
-ROOT:'./data/h36m/'
5+
TEST_SET:'Sample_20_test_Human36M_smpl'
6+
TRAIN_SET:'Sample_trainmin_train_Human36M_smpl_leaf_twist'
7+
-ROOT:'./data/coco/'
8+
TRAIN_SET:'train2017'
9+
-ROOT:'./data/3dhp/'
10+
TRAIN_SET:'train_v2'
11+
PROTOCOL:2
12+
FLIP:True
13+
ROT_FACTOR:30
14+
SCALE_FACTOR:0.3
15+
NUM_JOINTS_HALF_BODY:8
16+
PROB_HALF_BODY:-1
17+
COLOR_FACTOR:0.2
18+
OCCLUSION:True
19+
MODEL:
20+
TYPE:'HRNetSMPLCam'
21+
HR_PRETRAINED:'./pose_hrnet_w48_256x192.pth'
22+
PRETRAINED:''
23+
# TRY_LOAD: ''
24+
TRY_LOAD:''
25+
RESUME:''
26+
FOCAL_LENGTH:1000
27+
IMAGE_SIZE:
28+
-256
29+
-256
30+
HEATMAP_SIZE:
31+
-64
32+
-64
33+
NUM_JOINTS:29
34+
HRNET_TYPE:48
35+
EXTRA:
36+
SIGMA:2
37+
BACKBONE:'resnet'
38+
CROP:'padding'
39+
AUGMENT:'none'
40+
PRESET:'simple_smpl_3d_cam'
41+
DEPTH_DIM:64
42+
POST:
43+
NORM_TYPE:'softmax'
44+
BBOX_3D_SHAPE:
45+
-2200
46+
-2200
47+
-2200
48+
LOSS:
49+
TYPE:'LaplaceLossDimSMPLCam'
50+
ELEMENTS:
51+
BETA_WEIGHT:1
52+
BETA_REG_WEIGHT:0
53+
PHI_REG_WEIGHT:0.0001
54+
LEAF_REG_WEIGHT:0
55+
TWIST_WEIGHT:1
56+
THETA_WEIGHT:0.01
57+
UVD24_WEIGHT:1
58+
XYZ24_WEIGHT:0
59+
XYZ_SMPL24_WEIGHT:0
60+
XYZ_SMPL17_WEIGHT:0
61+
VERTICE_WEIGHT:0
62+
USE_LAPLACE:True
63+
TEST:
64+
HEATMAP2COORD:'coord'
65+
TRAIN:
66+
WORLD_SIZE:4
67+
BATCH_SIZE:36
68+
BEGIN_EPOCH:0
69+
END_EPOCH:200
70+
OPTIMIZER:'adam'
71+
LR:0.001
72+
LR_FACTOR:0.1
73+
LR_STEP:
74+
-60
75+
-80
76+
DPG_MILESTONE:140
77+
DPG_STEP:
78+
-160
79+
-190

‎hybrik/utils/presets/simple_transform_3d_smpl_cam.py‎

Lines changed: 21 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -185,12 +185,12 @@ def _integral_target_generator(self, joints_3d, num_joints, patch_height, patch_
185185
target[:,1]=joints_3d[:,1,0]/patch_height-0.5
186186
target[:,2]=joints_3d[:,2,0]/self.bbox_3d_shape[0]
187187

188-
target_weight[target[:,0]>0.5]=0
189-
target_weight[target[:,0]<-0.5]=0
190-
target_weight[target[:,1]>0.5]=0
191-
target_weight[target[:,1]<-0.5]=0
192-
target_weight[target[:,2]>0.5]=0
193-
target_weight[target[:,2]<-0.5]=0
188+
#target_weight[target[:, 0] > 0.5] = 0
189+
#target_weight[target[:, 0] < -0.5] = 0
190+
#target_weight[target[:, 1] > 0.5] = 0
191+
#target_weight[target[:, 1] < -0.5] = 0
192+
#target_weight[target[:, 2] > 0.5] = 0
193+
#target_weight[target[:, 2] < -0.5] = 0
194194

195195
target=target.reshape((-1))
196196
target_weight=target_weight.reshape((-1))
@@ -208,12 +208,12 @@ def _integral_uvd_target_generator(self, joints_3d, num_joints, patch_height, pa
208208
target[:,1]=joints_3d[:,1,0]/patch_height-0.5
209209
target[:,2]=joints_3d[:,2,0]/self.bbox_3d_shape[2]
210210

211-
target_weight[target[:,0]>0.5]=0
212-
target_weight[target[:,0]<-0.5]=0
213-
target_weight[target[:,1]>0.5]=0
214-
target_weight[target[:,1]<-0.5]=0
215-
target_weight[target[:,2]>0.5]=0
216-
target_weight[target[:,2]<-0.5]=0
211+
#target_weight[target[:, 0] > 0.5] = 0
212+
#target_weight[target[:, 0] < -0.5] = 0
213+
#target_weight[target[:, 1] > 0.5] = 0
214+
#target_weight[target[:, 1] < -0.5] = 0
215+
#target_weight[target[:, 2] > 0.5] = 0
216+
#target_weight[target[:, 2] < -0.5] = 0
217217

218218
target=target.reshape((-1))
219219
target_weight=target_weight.reshape((-1))
@@ -401,8 +401,13 @@ def __call__(self, src, label):
401401

402402
# half body transform
403403
ifself._trainand (np.sum(joints_vis_17[:,0])>self.num_joints_half_bodyandnp.random.rand()<self.prob_half_body):
404+
# self.num_joints = 17
405+
# c_half_body, s_half_body = self.half_body_transform(
406+
# gt_joints_17[:, :, 0], joints_vis_17
407+
# )
408+
self.num_joints=24
404409
c_half_body,s_half_body=self.half_body_transform(
405-
gt_joints_17[:, :,0],joints_vis_17
410+
gt_joints_29[:, :,0],joints_vis_29
406411
)
407412

408413
ifc_half_bodyisnotNoneands_half_bodyisnotNone:
@@ -513,9 +518,9 @@ def __call__(self, src, label):
513518

514519
ifself.focal_length>0:
515520
cam_scale,cam_trans,cam_valid,cam_error,new_uvd=self.calc_cam_scale_trans2(
516-
target_xyz_24.reshape(-1,3).copy(),
517-
tmp_uvd_24.copy(),
518-
tmp_uvd_24_weight.copy())
521+
target_xyz_24.reshape(-1,3).copy(),
522+
tmp_uvd_24.copy(),
523+
tmp_uvd_24_weight.copy())
519524

520525
target_uvd_29= (target_uvd_29*target_weight_29).reshape(-1,3)
521526
else:

0 commit comments

Comments
 (0)
[8]ページ先頭
©2009-2025 Movatter.jp