Skip to content

Couldn‘t reproduce the results in the paper #15

Description

@Dopamine0717

Following readme construction, I only got AP 23.5 after training on Seed 1 Percent 1 Coco standard while 25.81 ± 0.28 is claimed in the paper. Here's my setting:

Dataset:
percent 1 seed 1 Coco standard

Pretrained baseline:
I just changed the number of gpu in the train_gpu2.sh to get the train_gpu4.sh and only got AP 12.3.

Training:
I use train_gpu4.sh with pretrained baseline and got AP 23.5

Config:
labelmatch_standard.py
samples_per_gpu = 1
total_iter = 250000
update_interval = 1000
test_interval = 2000
learning_rate = 0.005
lr_config = dict(policy='step',warmup='linear',warmup_iters=4000,warmup_ratio=0.001,step=[140000,200000])

Environment:
I used two envs, one with Python = 3.6, mmdet=2.10.0, pytorch=1.6.0, and another with Python = 3.9, mmdet = 2.25, torch = 1.12. Both got the same results.

Could you share your model weight and log of Label Match training to help use reproduce results?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions