An issule about Chinese benchmark evaluation

[ZidunGuo]

I downloaded best.pth from Google drive. I used the following command python tools/eval_rec_all_ch.py -c configs/rec/svtrv2/svtrv2_smtr_gtc_rctc_ch.yml, using the following configuration files:

Global:
  device: gpu
  epoch_num: 100
  log_smooth_window: 20
  print_batch_step: 10
  output_dir: ./output/rec/ch/svtrv2_smtr_gtc_rctc_ch
  save_epoch_step: [15, 1]
  # evaluation is run every 2000 iterations
  eval_batch_step: [0, 2000]
  eval_epoch_step: [0, 1]
  cal_metric_during_train: False
  pretrained_model: ./output/rec/ch/svtrv2_ch_original/best.pth
  # ./output/rec/u14m_filter/svtrv2_rctc/best.pth
  checkpoints:
  use_tensorboard: false
  infer_img:
  # for data or label process
  character_dict_path: &character_dict_path ./tools/utils/ppocr_keys_v1.txt # ch
  max_text_length: &max_text_length 25
  use_space_char: &use_space_char False
  save_res_path: ./output/rec/ch/predicts_svtrv2_smtr_gtc_rctc_ch.txt
  use_amp: True

Optimizer:
  name: AdamW
  lr: 0.00065 # for 4gpus bs256/gpu
  weight_decay: 0.05
  filter_bias_and_bn: True

LRScheduler:
  name: OneCycleLR
  warmup_epoch: 5
  cycle_momentum: False

Architecture:
  model_type: rec
  algorithm: SVTRv2
  in_channels: 3
  Transform:
  Encoder:
    name: SVTRv2LNConvTwo33
    use_pos_embed: False
    dims: [128, 256, 384]
    depths: [6, 6, 6]
    num_heads: [4, 8, 12]
    mixer: [['Conv','Conv','Conv','Conv','Conv','Conv'],['Conv','Conv','FGlobal','Global','Global','Global'],['Global','Global','Global','Global','Global','Global']]
    local_k: [[5, 5], [5, 5], [-1, -1]]
    sub_k: [[1, 1], [2, 1], [-1, -1]]
    last_stage: false
    feat2d: True
  Decoder:
    name: GTCDecoder
    infer_gtc: False
    detach: False
    gtc_decoder:
      name: SMTRDecoder
      num_layer: 1
      ds: True
      max_len: *max_text_length
      next_mode: &next True
      sub_str_len: &subsl 5
    ctc_decoder:
      name: RCTCDecoder

Loss:
  name: GTCLoss
  ctc_weight: 0.1
  gtc_loss:
    name: SMTRLoss

# PostProcess:
#   name: GTCLabelDecode
#   gtc_label_decode:
#     name: SMTRLabelDecode
#     next_mode: *next
#   character_dict_path: *character_dict_path
#   use_space_char: *use_space_char

# Metric:
#   name: RecGTCMetric
#   main_indicator: acc
#   # is_filter: True

Loss:
  name: CTCLoss
  zero_infinity: True

PostProcess:
  name: CTCLabelDecode
  character_dict_path: *character_dict_path
  use_space_char: *use_space_char

Metric:
  name: RecMetric
  main_indicator: acc
  # is_filter: True

Train:
  dataset:
    name: RatioDataSetTVResize
    ds_width: True
    padding: false
    data_dir_list: ['../benchmark_bctr/benchmark_bctr_train/document_train',
    '../benchmark_bctr/benchmark_bctr_train/handwriting_train',
    '../benchmark_bctr/benchmark_bctr_train/scene_train',
    '../benchmark_bctr/benchmark_bctr_train/web_train'
    ]
    transforms:
      - DecodeImagePIL: # load image
          img_mode: RGB
      - PARSeqAugPIL:
      - GTCLabelEncode: # Class handling label
          gtc_label_encode:
            name: SMTRLabelEncode
            sub_str_len: *subsl
          character_dict_path: *character_dict_path
          use_space_char: *use_space_char
          max_text_length: *max_text_length
      - KeepKeys:
          keep_keys: ['image', 'label', 'label_subs', 'label_next', 'length_subs',
          'label_subs_pre', 'label_next_pre', 'length_subs_pre', 'length', 'ctc_label', 'ctc_length'] # dataloader will return list in this order
  sampler:
    name: RatioSampler
    scales: [[128, 32]] # w, h
    # divide_factor: to ensure the width and height dimensions can be devided by downsampling multiple
    first_bs: &bs 256
    fix_bs: false
    divided_factor: [4, 16] # w, h
    is_training: True
  loader:
    shuffle: True
    batch_size_per_card: *bs
    drop_last: True
    max_ratio: &max_ratio 8
    num_workers: 4

Eval:
  dataset:
    name: RatioDataSetTVResize
    ds_width: True
    padding: False
    data_dir_list: ['../benchmark_bctr/benchmark_bctr_test/scene_test']
    transforms:
      - DecodeImagePIL: # load image
          img_mode: RGB
      - CTCLabelEncode: # Class handling label
          character_dict_path: *character_dict_path
          use_space_char: *use_space_char
          max_text_length: *max_text_length
      - KeepKeys:
          keep_keys: ['image', 'label', 'length'] # dataloader will return list in this order
  sampler:
    name: RatioSampler
    scales: [[128, 32]] # w, h
    # divide_factor: to ensure the width and height dimensions can be devided by downsampling multiple
    first_bs: *bs
    fix_bs: false
    divided_factor: [4, 16] # w, h
    is_training: False
  loader:
    shuffle: False
    drop_last: False
    batch_size_per_card: *bs
    max_ratio: *max_ratio
    num_workers: 4

Output log as below:

[2026/04/07 22:25:39] openrec INFO: ----------- Config -----------
[2026/04/07 22:25:39] openrec INFO: Architecture : 
[2026/04/07 22:25:39] openrec INFO:     Decoder : 
[2026/04/07 22:25:39] openrec INFO:         ctc_decoder : 
[2026/04/07 22:25:39] openrec INFO:             name : RCTCDecoder
[2026/04/07 22:25:39] openrec INFO:         detach : False
[2026/04/07 22:25:39] openrec INFO:         gtc_decoder : 
[2026/04/07 22:25:39] openrec INFO:             ds : True
[2026/04/07 22:25:39] openrec INFO:             max_len : 25
[2026/04/07 22:25:39] openrec INFO:             name : SMTRDecoder
[2026/04/07 22:25:39] openrec INFO:             next_mode : True
[2026/04/07 22:25:39] openrec INFO:             num_layer : 1
[2026/04/07 22:25:39] openrec INFO:             sub_str_len : 5
[2026/04/07 22:25:39] openrec INFO:         infer_gtc : False
[2026/04/07 22:25:39] openrec INFO:         name : GTCDecoder
[2026/04/07 22:25:39] openrec INFO:     Encoder : 
[2026/04/07 22:25:39] openrec INFO:         depths : [6, 6, 6]
[2026/04/07 22:25:39] openrec INFO:         dims : [128, 256, 384]
[2026/04/07 22:25:39] openrec INFO:         feat2d : True
[2026/04/07 22:25:39] openrec INFO:         last_stage : False
[2026/04/07 22:25:39] openrec INFO:         local_k : [[5, 5], [5, 5], [-1, -1]]
[2026/04/07 22:25:39] openrec INFO:         mixer : [['Conv', 'Conv', 'Conv', 'Conv', 'Conv', 'Conv'], ['Conv', 'Conv', 'FGlobal', 'Global', 'Global', 'Global'], ['Global', 'Global', 'Global', 'Global', 'Global', 'Global']]
[2026/04/07 22:25:39] openrec INFO:         name : SVTRv2LNConvTwo33
[2026/04/07 22:25:39] openrec INFO:         num_heads : [4, 8, 12]
[2026/04/07 22:25:39] openrec INFO:         sub_k : [[1, 1], [2, 1], [-1, -1]]
[2026/04/07 22:25:39] openrec INFO:         use_pos_embed : False
[2026/04/07 22:25:39] openrec INFO:     Transform : None
[2026/04/07 22:25:39] openrec INFO:     algorithm : SVTRv2
[2026/04/07 22:25:39] openrec INFO:     in_channels : 3
[2026/04/07 22:25:39] openrec INFO:     model_type : rec
[2026/04/07 22:25:39] openrec INFO: Eval : 
[2026/04/07 22:25:39] openrec INFO:     dataset : 
[2026/04/07 22:25:39] openrec INFO:         data_dir_list : ['../benchmark_bctr/benchmark_bctr_test/scene_test']
[2026/04/07 22:25:39] openrec INFO:         ds_width : True
[2026/04/07 22:25:39] openrec INFO:         name : RatioDataSetTVResize
[2026/04/07 22:25:39] openrec INFO:         padding : False
[2026/04/07 22:25:39] openrec INFO:         transforms : 
[2026/04/07 22:25:39] openrec INFO:             DecodeImagePIL : 
[2026/04/07 22:25:39] openrec INFO:                 img_mode : RGB
[2026/04/07 22:25:39] openrec INFO:             CTCLabelEncode : 
[2026/04/07 22:25:39] openrec INFO:                 character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/07 22:25:39] openrec INFO:                 max_text_length : 25
[2026/04/07 22:25:39] openrec INFO:                 use_space_char : False
[2026/04/07 22:25:39] openrec INFO:             KeepKeys : 
[2026/04/07 22:25:39] openrec INFO:                 keep_keys : ['image', 'label', 'length', 'real_ratio']
[2026/04/07 22:25:39] openrec INFO:     loader : 
[2026/04/07 22:25:39] openrec INFO:         batch_size_per_card : 256
[2026/04/07 22:25:39] openrec INFO:         drop_last : False
[2026/04/07 22:25:39] openrec INFO:         max_ratio : 8
[2026/04/07 22:25:39] openrec INFO:         num_workers : 4
[2026/04/07 22:25:39] openrec INFO:         shuffle : False
[2026/04/07 22:25:39] openrec INFO:     sampler : 
[2026/04/07 22:25:39] openrec INFO:         divided_factor : [4, 16]
[2026/04/07 22:25:39] openrec INFO:         first_bs : 256
[2026/04/07 22:25:39] openrec INFO:         fix_bs : False
[2026/04/07 22:25:39] openrec INFO:         is_training : False
[2026/04/07 22:25:39] openrec INFO:         name : RatioSampler
[2026/04/07 22:25:39] openrec INFO:         scales : [[128, 32]]
[2026/04/07 22:25:39] openrec INFO: Global : 
[2026/04/07 22:25:39] openrec INFO:     cal_metric_during_train : False
[2026/04/07 22:25:39] openrec INFO:     character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/07 22:25:39] openrec INFO:     checkpoints : None
[2026/04/07 22:25:39] openrec INFO:     device : gpu
[2026/04/07 22:25:39] openrec INFO:     distributed : False
[2026/04/07 22:25:39] openrec INFO:     epoch_num : 100
[2026/04/07 22:25:39] openrec INFO:     eval_batch_step : [0, 2000]
[2026/04/07 22:25:39] openrec INFO:     eval_epoch_step : [0, 1]
[2026/04/07 22:25:39] openrec INFO:     infer_img : None
[2026/04/07 22:25:39] openrec INFO:     log_smooth_window : 20
[2026/04/07 22:25:39] openrec INFO:     max_text_length : 25
[2026/04/07 22:25:39] openrec INFO:     output_dir : ./output/rec/ch/svtrv2_smtr_gtc_rctc_ch
[2026/04/07 22:25:39] openrec INFO:     pretrained_model : ./output/rec/ch/svtrv2_ch_original/best.pth
[2026/04/07 22:25:39] openrec INFO:     print_batch_step : 10
[2026/04/07 22:25:39] openrec INFO:     save_epoch_step : [15, 1]
[2026/04/07 22:25:39] openrec INFO:     save_res_path : ./output/rec/ch/predicts_svtrv2_smtr_gtc_rctc_ch.txt
[2026/04/07 22:25:39] openrec INFO:     use_amp : False
[2026/04/07 22:25:39] openrec INFO:     use_space_char : False
[2026/04/07 22:25:39] openrec INFO:     use_tensorboard : False
[2026/04/07 22:25:39] openrec INFO: LRScheduler : 
[2026/04/07 22:25:39] openrec INFO:     cycle_momentum : False
[2026/04/07 22:25:39] openrec INFO:     name : OneCycleLR
[2026/04/07 22:25:39] openrec INFO:     warmup_epoch : 5
[2026/04/07 22:25:39] openrec INFO: Loss : 
[2026/04/07 22:25:39] openrec INFO:     name : CTCLoss
[2026/04/07 22:25:39] openrec INFO:     zero_infinity : True
[2026/04/07 22:25:39] openrec INFO: Metric : 
[2026/04/07 22:25:39] openrec INFO:     main_indicator : acc
[2026/04/07 22:25:39] openrec INFO:     max_len : 25
[2026/04/07 22:25:39] openrec INFO:     max_ratio : 12
[2026/04/07 22:25:39] openrec INFO:     name : RecMetric
[2026/04/07 22:25:39] openrec INFO:     with_ratio : True
[2026/04/07 22:25:39] openrec INFO: Optimizer : 
[2026/04/07 22:25:39] openrec INFO:     filter_bias_and_bn : True
[2026/04/07 22:25:39] openrec INFO:     lr : 0.00065
[2026/04/07 22:25:39] openrec INFO:     name : AdamW
[2026/04/07 22:25:39] openrec INFO:     weight_decay : 0.05
[2026/04/07 22:25:39] openrec INFO: PostProcess : 
[2026/04/07 22:25:39] openrec INFO:     character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/07 22:25:39] openrec INFO:     name : CTCLabelDecode
[2026/04/07 22:25:39] openrec INFO:     use_space_char : False
[2026/04/07 22:25:39] openrec INFO:     with_ratio : True
[2026/04/07 22:25:39] openrec INFO: Train : 
[2026/04/07 22:25:39] openrec INFO:     dataset : 
[2026/04/07 22:25:39] openrec INFO:         data_dir_list : ['../benchmark_bctr/benchmark_bctr_train/document_train', '../benchmark_bctr/benchmark_bctr_train/handwriting_train', '../benchmark_bctr/benchmark_bctr_train/scene_train', '../benchmark_bctr/benchmark_bctr_train/web_train']
[2026/04/07 22:25:39] openrec INFO:         ds_width : True
[2026/04/07 22:25:39] openrec INFO:         name : RatioDataSetTVResize
[2026/04/07 22:25:39] openrec INFO:         padding : False
[2026/04/07 22:25:39] openrec INFO:         transforms : 
[2026/04/07 22:25:39] openrec INFO:             DecodeImagePIL : 
[2026/04/07 22:25:39] openrec INFO:                 img_mode : RGB
[2026/04/07 22:25:39] openrec INFO:             PARSeqAugPIL : None
[2026/04/07 22:25:39] openrec INFO:             GTCLabelEncode : 
[2026/04/07 22:25:39] openrec INFO:                 character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/07 22:25:39] openrec INFO:                 gtc_label_encode : 
[2026/04/07 22:25:39] openrec INFO:                     name : SMTRLabelEncode
[2026/04/07 22:25:39] openrec INFO:                     sub_str_len : 5
[2026/04/07 22:25:39] openrec INFO:                 max_text_length : 25
[2026/04/07 22:25:39] openrec INFO:                 use_space_char : False
[2026/04/07 22:25:39] openrec INFO:             KeepKeys : 
[2026/04/07 22:25:39] openrec INFO:                 keep_keys : ['image', 'label', 'label_subs', 'label_next', 'length_subs', 'label_subs_pre', 'label_next_pre', 'length_subs_pre', 'length', 'ctc_label', 'ctc_length']
[2026/04/07 22:25:39] openrec INFO:     loader : 
[2026/04/07 22:25:39] openrec INFO:         batch_size_per_card : 256
[2026/04/07 22:25:39] openrec INFO:         drop_last : True
[2026/04/07 22:25:39] openrec INFO:         max_ratio : 8
[2026/04/07 22:25:39] openrec INFO:         num_workers : 4
[2026/04/07 22:25:39] openrec INFO:         shuffle : True
[2026/04/07 22:25:39] openrec INFO:     sampler : 
[2026/04/07 22:25:39] openrec INFO:         divided_factor : [4, 16]
[2026/04/07 22:25:39] openrec INFO:         first_bs : 256
[2026/04/07 22:25:39] openrec INFO:         fix_bs : False
[2026/04/07 22:25:39] openrec INFO:         is_training : True
[2026/04/07 22:25:39] openrec INFO:         name : RatioSampler
[2026/04/07 22:25:39] openrec INFO:         scales : [[128, 32]]
[2026/04/07 22:25:39] openrec INFO: config : configs/rec/svtrv2/svtrv2_issue_config.yml
[2026/04/07 22:25:39] openrec INFO: filename : svtrv2_issue_config
[2026/04/07 22:25:39] openrec INFO: local_rank : None
[2026/04/07 22:25:39] openrec INFO: ---------------------------------------------
[2026/04/07 22:25:45] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/benchmark_bctr_test/scene_test
[2026/04/07 22:25:48] openrec INFO: 0
[2026/04/07 22:25:48] openrec INFO: 18636
[2026/04/07 22:25:48] openrec INFO: 12730
[2026/04/07 22:25:48] openrec INFO: 9905
[2026/04/07 22:25:48] openrec INFO: 7554
[2026/04/07 22:25:48] openrec INFO: 4494
[2026/04/07 22:25:48] openrec INFO: 2941
[2026/04/07 22:25:48] openrec INFO: 1975
[2026/04/07 22:25:48] openrec INFO: 5411
0 18636 32.0 72 256
0 12730 64.0 49 256
0 9905 96.0 38 256
0 7554 128.0 29 256
0 4494 160.0 22 204
0 2941 192.0 17 170
0 1975 224.0 13 146
0 5411 256.0 42 128
[2026/04/07 22:25:48] openrec INFO: valid dataloader has 290 iters
[2026/04/07 22:26:08] openrec INFO: {'Total': 22269216, 'Trainable': 22269216}
[2026/04/07 22:26:09] openrec INFO: Loading weights using torch.load: ./output/rec/ch/svtrv2_ch_original/best.pth
[2026/04/07 22:26:09] openrec INFO: finetune from checkpoint ./output/rec/ch/svtrv2_ch_original/best.pth
[2026/04/07 22:26:09] openrec INFO: run with torch 2.3.0+cu118 and device cuda:0
[2026/04/07 22:26:09] openrec INFO: metric in ckpt ***************
[2026/04/07 22:26:09] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/benchmark_bctr_test/scene_test
[2026/04/07 22:26:12] openrec INFO: 0
[2026/04/07 22:26:12] openrec INFO: 18636
[2026/04/07 22:26:12] openrec INFO: 12730
[2026/04/07 22:26:12] openrec INFO: 9905
[2026/04/07 22:26:12] openrec INFO: 7554
[2026/04/07 22:26:12] openrec INFO: 4494
[2026/04/07 22:26:12] openrec INFO: 2941
[2026/04/07 22:26:12] openrec INFO: 1975
[2026/04/07 22:26:12] openrec INFO: 5411
0 18636 32.0 72 256
0 12730 64.0 49 256
0 9905 96.0 38 256
0 7554 128.0 29 256
0 4494 160.0 22 204
0 2941 192.0 17 170
0 1975 224.0 13 146
0 5411 256.0 42 128
[2026/04/07 22:26:12] openrec INFO: ../benchmark_bctr/benchmark_bctr_test/scene_test valid dataloader has 290 iters
eval model:: 100%|██████████| 290/290 [01:37<00:00,  2.97it/s]
[2026/04/07 22:27:50] openrec INFO: metric eval ***************
[2026/04/07 22:27:50] openrec INFO: acc:0.764667064581487
[2026/04/07 22:27:50] openrec INFO: acc_real:0.7646513526750068
[2026/04/07 22:27:50] openrec INFO: acc_lower:0.764667064581487
[2026/04/07 22:27:50] openrec INFO: acc_ignore_space:0.7646513526750068
[2026/04/07 22:27:50] openrec INFO: acc_ignore_space_lower:0.764667064581487
[2026/04/07 22:27:50] openrec INFO: acc_ignore_space_symbol:0.7646513526750068
[2026/04/07 22:27:50] openrec INFO: acc_ignore_space_lower_symbol:0.764667064581487
[2026/04/07 22:27:50] openrec INFO: each_len_num:[6134, 11740, 8915, 13063, 5529, 4598, 2936, 2484, 1387, 1249, 1500, 920, 617, 655, 378, 350, 235, 178, 141, 127, 114, 119, 85, 80, 112]
[2026/04/07 22:27:50] openrec INFO: each_len_acc:[0.8465927602761775, 0.8589437812104397, 0.8079641045339718, 0.8092321818807072, 0.711521069431143, 0.7301000419093083, 0.6723433219606835, 0.6960547476004236, 0.6712328718728704, 0.6349079212577429, 0.7193333285377779, 0.6315217322660681, 0.5494327301550611, 0.3389312925354001, 0.4312169198090762, 0.3142857053061227, 0.4255318967858767, 0.37078649602323055, 0.34751770584980807, 0.3149606051212122, 0.29824558787319405, 0.3697478680884144, 0.37647054394464186, 0.37499995312500584, 0.08928570631377622]
[2026/04/07 22:27:50] openrec INFO: each_len_norm_edit_dis:[0.851062384766228, 0.910190232898759, 0.910530406317809, 0.9197350690616133, 0.8946487973809628, 0.887133899042046, 0.8453199591807655, 0.860359432238017, 0.8708443492448934, 0.8637302190140769, 0.9048862810203717, 0.8791178942905247, 0.871934388596714, 0.8710868794672304, 0.8733134954149869, 0.8842086867817125, 0.8610016966247, 0.8890794464049592, 0.8807506439112842, 0.8707479601618388, 0.9178438592610574, 0.9065665870523976, 0.9134981630610288, 0.935625008046874, 0.9197212118889537]
[2026/04/07 22:27:50] openrec INFO: each_ratio_num:[18636, 12730, 9905, 7554, 4494, 2941, 1975, 1448, 970, 759, 536, 1698]
[2026/04/07 22:27:50] openrec INFO: each_ratio_acc:[0.6808327963721653, 0.8408483889702684, 0.8321049966359364, 0.8195657918724308, 0.8206497534030937, 0.8055083277609373, 0.7549367050382951, 0.7106353542083194, 0.682474219768307, 0.6271409667043351, 0.5914178994138451, 0.47762072745806405]
[2026/04/07 22:27:50] openrec INFO: each_ratio_norm_edit_dis:[0.782271576559439, 0.927155449417919, 0.9396814575171256, 0.9455601573721382, 0.9530147525218903, 0.9582186187005312, 0.9559880819654317, 0.9500713840592041, 0.9532485161650048, 0.9469827075561619, 0.9491241262561125, 0.9413835074088104]
[2026/04/07 22:27:50] openrec INFO: norm_edit_dis:0.8947422929143602
[2026/04/07 22:27:50] openrec INFO: num_samples:63646
[2026/04/07 22:27:50] openrec INFO: fps:4862.728983664332
[2026/04/07 22:27:50] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/benchmark_bctr_test/web_test
[2026/04/07 22:27:50] openrec INFO: 0
[2026/04/07 22:27:50] openrec INFO: 4028
[2026/04/07 22:27:50] openrec INFO: 2762
[2026/04/07 22:27:50] openrec INFO: 1752
[2026/04/07 22:27:50] openrec INFO: 1830
[2026/04/07 22:27:50] openrec INFO: 989
[2026/04/07 22:27:50] openrec INFO: 774
[2026/04/07 22:27:50] openrec INFO: 537
[2026/04/07 22:27:50] openrec INFO: 1387
0 4028 32.0 15 256
0 2762 64.0 10 256
0 1752 96.0 6 256
0 1830 128.0 7 256
0 989 160.0 4 204
0 774 192.0 4 170
0 537 224.0 3 146
0 1387 256.0 10 128
[2026/04/07 22:27:50] openrec INFO: ../benchmark_bctr/benchmark_bctr_test/web_test valid dataloader has 67 iters
eval model:: 100%|██████████| 67/67 [00:30<00:00,  2.22it/s]
[2026/04/07 22:28:20] openrec INFO: metric eval ***************
[2026/04/07 22:28:20] openrec INFO: acc:0.788178390505599
[2026/04/07 22:28:20] openrec INFO: acc_real:0.788178390505599
[2026/04/07 22:28:20] openrec INFO: acc_lower:0.788178390505599
[2026/04/07 22:28:20] openrec INFO: acc_ignore_space:0.788178390505599
[2026/04/07 22:28:20] openrec INFO: acc_ignore_space_lower:0.788178390505599
[2026/04/07 22:28:20] openrec INFO: acc_ignore_space_symbol:0.788178390505599
[2026/04/07 22:28:20] openrec INFO: acc_ignore_space_lower_symbol:0.788178390505599
[2026/04/07 22:28:20] openrec INFO: each_len_num:[2197, 2145, 1639, 2509, 1224, 1006, 823, 661, 425, 318, 273, 173, 128, 96, 87, 59, 63, 50, 38, 28, 21, 27, 23, 30, 16]
[2026/04/07 22:28:20] openrec INFO: each_len_acc:[0.8320436921618402, 0.885314681187344, 0.819402069436229, 0.8425667563070276, 0.7671568564774767, 0.7564612250848785, 0.7181044870218167, 0.6959152693507524, 0.703529395211073, 0.7232704175072197, 0.6776556528331263, 0.5838149951552026, 0.5234374591064485, 0.562499941406256, 0.6091953322763985, 0.3220338437230773, 0.4761904006046983, 0.5599998880000223, 0.49999986842108723, 0.3571427295918823, 0.523809274376536, 0.29629618655696793, 0.5652171455577628, 0.33333322222225925, 0.5624996484377197]
[2026/04/07 22:28:20] openrec INFO: each_len_norm_edit_dis:[0.835472614919712, 0.9262082365522537, 0.9222696771063473, 0.9406555450371489, 0.9271280740469617, 0.909294235494093, 0.9051712677147505, 0.9144764602861948, 0.9251491402044528, 0.9359705566161346, 0.9238176381466596, 0.9011042001733158, 0.8649982935140413, 0.9234809107485162, 0.9220785530177908, 0.8638875272241147, 0.8826682906112383, 0.8682339444818661, 0.8349030905379679, 0.8901360936588781, 0.7959184645286224, 0.8116674683767098, 0.9300567411851598, 0.8313633040754798, 0.9700000187499883]
[2026/04/07 22:28:20] openrec INFO: each_ratio_num:[4028, 2762, 1752, 1830, 989, 774, 537, 409, 280, 203, 126, 369]
[2026/04/07 22:28:20] openrec INFO: each_ratio_acc:[0.7291459763427359, 0.8464880490713683, 0.8207762510229666, 0.8633879734241094, 0.8179979694843481, 0.8036175606767757, 0.7895716798962443, 0.7457212531608496, 0.7285714025510214, 0.679802922177196, 0.6349205845301124, 0.5582655675266784]
[2026/04/07 22:28:20] openrec INFO: each_ratio_norm_edit_dis:[0.8131998121403748, 0.929086140362589, 0.9432756269041903, 0.9633725602767652, 0.9589841153897356, 0.9623210910511723, 0.9648852476168723, 0.9544573869473572, 0.9603638523755411, 0.9565979343107031, 0.9465960123354791, 0.9136156868752283]
[2026/04/07 22:28:20] openrec INFO: norm_edit_dis:0.9089245500655146
[2026/04/07 22:28:20] openrec INFO: num_samples:14059
[2026/04/07 22:28:20] openrec INFO: fps:1173.943528644384
[2026/04/07 22:28:20] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/benchmark_bctr_test/document_test
[2026/04/07 22:28:22] openrec INFO: 0
[2026/04/07 22:28:22] openrec INFO: 3101
[2026/04/07 22:28:22] openrec INFO: 3892
[2026/04/07 22:28:22] openrec INFO: 3954
[2026/04/07 22:28:22] openrec INFO: 4304
[2026/04/07 22:28:22] openrec INFO: 4432
[2026/04/07 22:28:22] openrec INFO: 4725
[2026/04/07 22:28:22] openrec INFO: 4718
[2026/04/07 22:28:22] openrec INFO: 20874
0 3101 32.0 12 256
0 3892 64.0 15 256
0 3954 96.0 15 256
0 4304 128.0 16 256
0 4432 160.0 21 204
0 4725 192.0 27 170
0 4718 224.0 32 146
0 20874 256.0 163 128
[2026/04/07 22:28:22] openrec INFO: ../benchmark_bctr/benchmark_bctr_test/document_test valid dataloader has 309 iters
eval model:: 100%|██████████| 309/309 [01:47<00:00,  2.88it/s]
[2026/04/07 22:30:10] openrec INFO: metric eval ***************
[2026/04/07 22:30:10] openrec INFO: acc:0.74729999985054
[2026/04/07 22:30:10] openrec INFO: acc_real:0.74729999985054
[2026/04/07 22:30:10] openrec INFO: acc_lower:0.74729999985054
[2026/04/07 22:30:10] openrec INFO: acc_ignore_space:0.74729999985054
[2026/04/07 22:30:10] openrec INFO: acc_ignore_space_lower:0.74729999985054
[2026/04/07 22:30:10] openrec INFO: acc_ignore_space_symbol:0.74729999985054
[2026/04/07 22:30:10] openrec INFO: acc_ignore_space_lower_symbol:0.74729999985054
[2026/04/07 22:30:10] openrec INFO: each_len_num:[3464, 3267, 3367, 3266, 3340, 3284, 3411, 3358, 3339, 3314, 3290, 3316, 3318, 3334, 3332, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
[2026/04/07 22:30:10] openrec INFO: each_len_acc:[0.9656466484825442, 0.9253137406632576, 0.9094149067139444, 0.8735456188807543, 0.7988023928179568, 0.8035931766029439, 0.6719437095516162, 0.7504466922261861, 0.7226714563561801, 0.6858780908694082, 0.6875379918311915, 0.6565138701552657, 0.6317058449918449, 0.5869826017187084, 0.5357142841064997, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
[2026/04/07 22:30:10] openrec INFO: each_len_norm_edit_dis:[0.9657909931703493, 0.9624528110525881, 0.9695079695985309, 0.9680955297976255, 0.9585129741761089, 0.9656994954933459, 0.9497424301008516, 0.9673540799066287, 0.9673355296975077, 0.9658748012221916, 0.968868011515829, 0.9680879033469868, 0.9677441506623418, 0.9657668467333528, 0.9607442978369019, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]
[2026/04/07 22:30:10] openrec INFO: each_ratio_num:[3101, 3892, 3954, 4304, 4432, 4725, 4718, 4894, 4087, 3762, 2779, 5352]
[2026/04/07 22:30:10] openrec INFO: each_ratio_acc:[0.9951628474841572, 0.9283144888789453, 0.8806272107217319, 0.8385223028844743, 0.78000902351081, 0.7390476174834971, 0.708562948900884, 0.6847159773503965, 0.6638120854812525, 0.633705474126248, 0.6182079862604966, 0.5823991020508238]
[2026/04/07 22:30:10] openrec INFO: each_ratio_norm_edit_dis:[0.996506503289778, 0.9630866736131724, 0.9502240047504993, 0.9615463288638326, 0.9614537420179257, 0.9621740247620162, 0.9629785421901179, 0.9654887489368715, 0.9662039331694239, 0.9659119530440318, 0.9660177365340454, 0.9641428260792184]
[2026/04/07 22:30:10] openrec INFO: norm_edit_dis:0.9647468599804107
[2026/04/07 22:30:10] openrec INFO: num_samples:50000
[2026/04/07 22:30:10] openrec INFO: fps:4300.025986923865
[2026/04/07 22:30:10] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/benchmark_bctr_test/handwriting_test
[2026/04/07 22:30:11] openrec INFO: 0
[2026/04/07 22:30:11] openrec INFO: 1596
[2026/04/07 22:30:11] openrec INFO: 1679
[2026/04/07 22:30:11] openrec INFO: 1994
[2026/04/07 22:30:11] openrec INFO: 2390
[2026/04/07 22:30:11] openrec INFO: 2499
[2026/04/07 22:30:11] openrec INFO: 2399
[2026/04/07 22:30:11] openrec INFO: 2130
[2026/04/07 22:30:11] openrec INFO: 8797
0 1596 32.0 6 256
0 1679 64.0 6 256
0 1994 96.0 7 256
0 2390 128.0 9 256
0 2499 160.0 12 204
0 2399 192.0 14 170
0 2130 224.0 14 146
0 8797 256.0 68 128
[2026/04/07 22:30:11] openrec INFO: ../benchmark_bctr/benchmark_bctr_test/handwriting_test valid dataloader has 144 iters
eval model:: 100%|██████████| 144/144 [00:59<00:00,  2.43it/s]
[2026/04/07 22:31:10] openrec INFO: metric eval ***************
[2026/04/07 22:31:10] openrec INFO: acc:0.4290154997321515
[2026/04/07 22:31:10] openrec INFO: acc_real:0.4290154997321515
[2026/04/07 22:31:10] openrec INFO: acc_lower:0.4290154997321515
[2026/04/07 22:31:10] openrec INFO: acc_ignore_space:0.4290154997321515
[2026/04/07 22:31:10] openrec INFO: acc_ignore_space_lower:0.4290154997321515
[2026/04/07 22:31:10] openrec INFO: acc_ignore_space_symbol:0.4290154997321515
[2026/04/07 22:31:10] openrec INFO: acc_ignore_space_lower_symbol:0.4290154997321515
[2026/04/07 22:31:10] openrec INFO: each_len_num:[685, 1395, 1011, 1759, 1548, 1816, 2326, 2172, 1632, 1665, 1164, 1051, 697, 565, 512, 728, 361, 432, 356, 530, 297, 252, 187, 193, 150]
[2026/04/07 22:31:10] openrec INFO: each_len_acc:[0.4306569280196069, 0.5856630782389743, 0.5341246237969869, 0.6168277395291203, 0.5968992209502635, 0.5985682786422452, 0.6354256206559517, 0.4921731100728678, 0.4895833303334355, 0.4534534507300093, 0.35738831308085645, 0.2683158870759668, 0.22381635259947846, 0.19469026204088033, 0.1249999975585938, 0.07967032857595703, 0.09141273985006261, 0.11805555282278814, 0.05898876238795612, 0.033962263510145974, 0.016835016268181274, 0.03968253810783579, 0.005347593296920144, 0.0051813468817954985, 0.0]
[2026/04/07 22:31:10] openrec INFO: each_len_norm_edit_dis:[0.443600981358623, 0.7075883277489827, 0.7079294456848391, 0.8114095772202097, 0.8537967586656416, 0.8720299684119613, 0.8907577731975501, 0.8658953493857017, 0.8309507462329098, 0.8438833948210311, 0.8630262982128936, 0.8449041947029164, 0.8390292099900512, 0.8046577554517761, 0.827966316152968, 0.8587699522277805, 0.8090713638220896, 0.8283547330918881, 0.8374444186056634, 0.8435176563409462, 0.8119553525028895, 0.7886008609269054, 0.765667686715438, 0.7728912224564323, 0.7607001109200876]
[2026/04/07 22:31:10] openrec INFO: each_ratio_num:[1596, 1679, 1994, 2390, 2499, 2399, 2130, 1878, 1522, 1179, 1066, 3152]
[2026/04/07 22:31:10] openrec INFO: each_ratio_acc:[0.2813283190392962, 0.559261461826912, 0.574724169635285, 0.5648535541219516, 0.5502200858334529, 0.5735723194098694, 0.4971830962573563, 0.43929712226146367, 0.36268068092851063, 0.2917726862445065, 0.25515947227805374, 0.1230964463099732]
[2026/04/07 22:31:10] openrec INFO: each_ratio_norm_edit_dis:[0.36915232197717807, 0.7048612364135798, 0.7953079027536996, 0.8377093194866857, 0.8685511999787917, 0.9014988008708897, 0.8947183444909022, 0.9006480719843837, 0.8824018776703618, 0.8773589248452873, 0.873898290605178, 0.8488590899078406]
[2026/04/07 22:31:10] openrec INFO: norm_edit_dis:0.8207959383916626
[2026/04/07 22:31:10] openrec INFO: num_samples:23484
[2026/04/07 22:31:10] openrec INFO: fps:1752.6475670931627
[76.4667064581487, 78.8178390505599, 74.729999985054, 42.90154997321515, 68.22902386674444, 70.89735362540158]

This result is quite different from the data in the paper.

[Topdu]

我们重测指标如下，基本符合论文中指标：

[2026/04/08 17:12:11] openrec INFO: ----------- Config -----------
[2026/04/08 17:12:11] openrec INFO: Architecture : 
[2026/04/08 17:12:11] openrec INFO:     Decoder : 
[2026/04/08 17:12:11] openrec INFO:         ctc_decoder : 
[2026/04/08 17:12:11] openrec INFO:             name : RCTCDecoder
[2026/04/08 17:12:11] openrec INFO:         detach : False
[2026/04/08 17:12:11] openrec INFO:         gtc_decoder : 
[2026/04/08 17:12:11] openrec INFO:             ds : True
[2026/04/08 17:12:11] openrec INFO:             max_len : 25
[2026/04/08 17:12:11] openrec INFO:             name : SMTRDecoder
[2026/04/08 17:12:11] openrec INFO:             next_mode : True
[2026/04/08 17:12:11] openrec INFO:             num_layer : 1
[2026/04/08 17:12:11] openrec INFO:             sub_str_len : 5
[2026/04/08 17:12:11] openrec INFO:         infer_gtc : False
[2026/04/08 17:12:11] openrec INFO:         name : GTCDecoder
[2026/04/08 17:12:11] openrec INFO:     Encoder : 
[2026/04/08 17:12:11] openrec INFO:         depths : [6, 6, 6]
[2026/04/08 17:12:11] openrec INFO:         dims : [128, 256, 384]
[2026/04/08 17:12:11] openrec INFO:         feat2d : True
[2026/04/08 17:12:11] openrec INFO:         last_stage : False
[2026/04/08 17:12:11] openrec INFO:         local_k : [[5, 5], [5, 5], [-1, -1]]
[2026/04/08 17:12:11] openrec INFO:         mixer : [['Conv', 'Conv', 'Conv', 'Conv', 'Conv', 'Conv'], ['Conv', 'Conv', 'FGlobal', 'Global', 'Global', 'Global'
], ['Global', 'Global', 'Global', 'Global', 'Global', 'Global']]                                                                                               [2026/04/08 17:12:11] openrec INFO:         name : SVTRv2LNConvTwo33
[2026/04/08 17:12:11] openrec INFO:         num_heads : [4, 8, 12]
[2026/04/08 17:12:11] openrec INFO:         sub_k : [[1, 1], [2, 1], [-1, -1]]
[2026/04/08 17:12:11] openrec INFO:         use_pos_embed : False
[2026/04/08 17:12:11] openrec INFO:     Transform : None
[2026/04/08 17:12:11] openrec INFO:     algorithm : SVTRv2
[2026/04/08 17:12:11] openrec INFO:     in_channels : 3
[2026/04/08 17:12:11] openrec INFO:     model_type : rec
[2026/04/08 17:12:11] openrec INFO: Eval : 
[2026/04/08 17:12:11] openrec INFO:     dataset : 
[2026/04/08 17:12:11] openrec INFO:         data_dir_list : ['../benchmark_bctr/scene_test']
[2026/04/08 17:12:11] openrec INFO:         ds_width : True
[2026/04/08 17:12:11] openrec INFO:         name : RatioDataSetTVResize
[2026/04/08 17:12:11] openrec INFO:         padding : False
[2026/04/08 17:12:11] openrec INFO:         transforms : 
[2026/04/08 17:12:11] openrec INFO:             DecodeImagePIL : 
[2026/04/08 17:12:11] openrec INFO:                 img_mode : RGB
[2026/04/08 17:12:11] openrec INFO:             CTCLabelEncode : 
[2026/04/08 17:12:11] openrec INFO:                 character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/08 17:12:11] openrec INFO:                 max_text_length : 25
[2026/04/08 17:12:11] openrec INFO:                 use_space_char : False
[2026/04/08 17:12:11] openrec INFO:             KeepKeys : 
[2026/04/08 17:12:11] openrec INFO:                 keep_keys : ['image', 'label', 'length', 'real_ratio']
[2026/04/08 17:12:11] openrec INFO:     loader : 
[2026/04/08 17:12:11] openrec INFO:         batch_size_per_card : 256
[2026/04/08 17:12:11] openrec INFO:         drop_last : False
[2026/04/08 17:12:11] openrec INFO:         max_ratio : 8
[2026/04/08 17:12:11] openrec INFO:         num_workers : 4
[2026/04/08 17:12:11] openrec INFO:         shuffle : False
[2026/04/08 17:12:11] openrec INFO:     sampler : 
[2026/04/08 17:12:11] openrec INFO:         divided_factor : [4, 16]
[2026/04/08 17:12:11] openrec INFO:         first_bs : 256
[2026/04/08 17:12:11] openrec INFO:         fix_bs : False
[2026/04/08 17:12:11] openrec INFO:         is_training : False
[2026/04/08 17:12:11] openrec INFO:         name : RatioSampler
[2026/04/08 17:12:11] openrec INFO:         scales : [[128, 32]]
[2026/04/08 17:12:11] openrec INFO: Global : 
[2026/04/08 17:12:11] openrec INFO:     cal_metric_during_train : False
[2026/04/08 17:12:11] openrec INFO:     character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/08 17:12:11] openrec INFO:     checkpoints : None
[2026/04/08 17:12:11] openrec INFO:     device : gpu
[2026/04/08 17:12:11] openrec INFO:     distributed : False
[2026/04/08 17:12:11] openrec INFO:     epoch_num : 100
[2026/04/08 17:12:11] openrec INFO:     eval_batch_step : [0, 2000]
[2026/04/08 17:12:11] openrec INFO:     eval_epoch_step : [0, 1]
[2026/04/08 17:12:11] openrec INFO:     infer_img : None
[2026/04/08 17:12:11] openrec INFO:     log_smooth_window : 20
[2026/04/08 17:12:11] openrec INFO:     max_text_length : 25
[2026/04/08 17:12:11] openrec INFO:     output_dir : ./output/rec/ch/svtrv2_smtr_gtc_rctc_ch
[2026/04/08 17:12:11] openrec INFO:     pretrained_model : ./svtrv2_ch/best.pth
[2026/04/08 17:12:11] openrec INFO:     print_batch_step : 10
[2026/04/08 17:12:11] openrec INFO:     save_epoch_step : [15, 1]
[2026/04/08 17:12:11] openrec INFO:     save_res_path : ./output/rec/ch/predicts_svtrv2_smtr_gtc_rctc_ch.txt
[2026/04/08 17:12:11] openrec INFO:     use_amp : False
[2026/04/08 17:12:11] openrec INFO:     use_space_char : False
[2026/04/08 17:12:11] openrec INFO:     use_tensorboard : False
[2026/04/08 17:12:11] openrec INFO: LRScheduler : 
[2026/04/08 17:12:11] openrec INFO:     cycle_momentum : False
[2026/04/08 17:12:11] openrec INFO:     name : OneCycleLR
[2026/04/08 17:12:11] openrec INFO:     warmup_epoch : 5
[2026/04/08 17:12:11] openrec INFO: Loss : 
[2026/04/08 17:12:11] openrec INFO:     name : CTCLoss
[2026/04/08 17:12:11] openrec INFO:     zero_infinity : True
[2026/04/08 17:12:11] openrec INFO: Metric : 
[2026/04/08 17:12:11] openrec INFO:     main_indicator : acc
[2026/04/08 17:12:11] openrec INFO:     max_len : 25
[2026/04/08 17:12:11] openrec INFO:     max_ratio : 12
[2026/04/08 17:12:11] openrec INFO:     name : RecMetric
[2026/04/08 17:12:11] openrec INFO:     with_ratio : True
[2026/04/08 17:12:11] openrec INFO: Optimizer : 
[2026/04/08 17:12:11] openrec INFO:     filter_bias_and_bn : True
[2026/04/08 17:12:11] openrec INFO:     lr : 0.00065
[2026/04/08 17:12:11] openrec INFO:     name : AdamW
[2026/04/08 17:12:11] openrec INFO:     weight_decay : 0.05
[2026/04/08 17:12:11] openrec INFO: PostProcess : 
[2026/04/08 17:12:11] openrec INFO:     character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/08 17:12:11] openrec INFO:     name : CTCLabelDecode
[2026/04/08 17:12:11] openrec INFO:     use_space_char : False
[2026/04/08 17:12:11] openrec INFO:     with_ratio : True
[2026/04/08 17:12:11] openrec INFO: Train : 
[2026/04/08 17:12:11] openrec INFO:     dataset : 
[2026/04/08 17:12:11] openrec INFO:         data_dir_list : ['../benchmark_bctr/benchmark_bctr_train/document_train', '../benchmark_bctr/benchmark_bctr_train/h
andwriting_train', '../benchmark_bctr/benchmark_bctr_train/scene_train', '../benchmark_bctr/benchmark_bctr_train/web_train']                                   [2026/04/08 17:12:11] openrec INFO:         ds_width : True
[2026/04/08 17:12:11] openrec INFO:         name : RatioDataSetTVResize
[2026/04/08 17:12:11] openrec INFO:         padding : False
[2026/04/08 17:12:11] openrec INFO:         transforms : 
[2026/04/08 17:12:11] openrec INFO:             DecodeImagePIL : 
[2026/04/08 17:12:11] openrec INFO:                 img_mode : RGB
[2026/04/08 17:12:11] openrec INFO:             PARSeqAugPIL : None
[2026/04/08 17:12:11] openrec INFO:             CTCLabelEncode : 
[2026/04/08 17:12:11] openrec INFO:                 character_dict_path : ./tools/utils/ppocr_keys_v1.txt
[2026/04/08 17:12:11] openrec INFO:                 max_text_length : 25
[2026/04/08 17:12:11] openrec INFO:                 use_space_char : False
[2026/04/08 17:12:11] openrec INFO:             KeepKeys : 
[2026/04/08 17:12:11] openrec INFO:                 keep_keys : ['image', 'label', 'length']
[2026/04/08 17:12:11] openrec INFO:     loader : 
[2026/04/08 17:12:11] openrec INFO:         batch_size_per_card : 256
[2026/04/08 17:12:11] openrec INFO:         drop_last : True
[2026/04/08 17:12:11] openrec INFO:         max_ratio : 8
[2026/04/08 17:12:11] openrec INFO:         num_workers : 4
[2026/04/08 17:12:11] openrec INFO:         shuffle : True
[2026/04/08 17:12:11] openrec INFO:     sampler : 
[2026/04/08 17:12:11] openrec INFO:         divided_factor : [4, 16]
[2026/04/08 17:12:11] openrec INFO:         first_bs : 256
[2026/04/08 17:12:11] openrec INFO:         fix_bs : False
[2026/04/08 17:12:11] openrec INFO:         is_training : True
[2026/04/08 17:12:11] openrec INFO:         name : RatioSampler
[2026/04/08 17:12:11] openrec INFO:         scales : [[128, 32]]
[2026/04/08 17:12:11] openrec INFO: config : configs/rec/svtrv2/svtrv2_smtr_gtc_rctc_ch_infer.yml
[2026/04/08 17:12:11] openrec INFO: filename : svtrv2_smtr_gtc_rctc_ch_infer
[2026/04/08 17:12:11] openrec INFO: local_rank : None
[2026/04/08 17:12:11] openrec INFO: ---------------------------------------------
[2026/04/08 17:12:14] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/scene_test
[2026/04/08 17:12:16] openrec INFO: 0
[2026/04/08 17:12:16] openrec INFO: 12134
[2026/04/08 17:12:16] openrec INFO: 13846
[2026/04/08 17:12:16] openrec INFO: 11323
[2026/04/08 17:12:16] openrec INFO: 8695
[2026/04/08 17:12:16] openrec INFO: 5282
[2026/04/08 17:12:16] openrec INFO: 3539
[2026/04/08 17:12:16] openrec INFO: 2404
[2026/04/08 17:12:16] openrec INFO: 6423
0 12134 32.0 47 256
0 13846 64.0 54 256
0 11323 96.0 44 256
0 8695 128.0 33 256
0 5282 160.0 25 204
0 3539 192.0 20 170
0 2404 224.0 16 146
0 6423 256.0 50 128
[2026/04/08 17:12:16] openrec INFO: valid dataloader has 297 iters
[2026/04/08 17:12:16] openrec INFO: {'Total': 22269216, 'Trainable': 22269216}
[2026/04/08 17:12:17] openrec INFO: Loading weights using torch.load: ./svtrv2_ch/best.pth
[2026/04/08 17:12:18] openrec INFO: finetune from checkpoint ./svtrv2_ch/best.pth
[2026/04/08 17:12:18] openrec INFO: run with torch 2.6.0+cu126 and device cuda:0
[2026/04/08 17:12:18] openrec INFO: metric in ckpt ***************
[2026/04/08 17:12:18] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/scene_test
[2026/04/08 17:12:19] openrec INFO: 0
[2026/04/08 17:12:19] openrec INFO: 12134
[2026/04/08 17:12:19] openrec INFO: 13846
[2026/04/08 17:12:19] openrec INFO: 11323
[2026/04/08 17:12:19] openrec INFO: 8695
[2026/04/08 17:12:19] openrec INFO: 5282
[2026/04/08 17:12:19] openrec INFO: 3539
[2026/04/08 17:12:19] openrec INFO: 2404
[2026/04/08 17:12:19] openrec INFO: 6423
0 12134 32.0 47 256
0 13846 64.0 54 256
0 11323 96.0 44 256
0 8695 128.0 33 256
0 5282 160.0 25 204
0 3539 192.0 20 170
0 2404 224.0 16 146
0 6423 256.0 50 128
[2026/04/08 17:12:19] openrec INFO: ../benchmark_bctr/scene_test valid dataloader has 297 iters
eval model:: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████| 297/297 [01:05<00:00,  4.51it/s]
[2026/04/08 17:13:25] openrec INFO: metric eval ***************
[2026/04/08 17:13:25] openrec INFO: acc:0.8339722840659315
[2026/04/08 17:13:25] openrec INFO: acc_real:0.8339565721594512
[2026/04/08 17:13:25] openrec INFO: acc_lower:0.8339722840659315
[2026/04/08 17:13:25] openrec INFO: acc_ignore_space:0.8339565721594512
[2026/04/08 17:13:25] openrec INFO: acc_ignore_space_lower:0.8339722840659315
[2026/04/08 17:13:25] openrec INFO: acc_ignore_space_symbol:0.8339565721594512
[2026/04/08 17:13:25] openrec INFO: acc_ignore_space_lower_symbol:0.8339722840659315
[2026/04/08 17:13:25] openrec INFO: each_len_num:[6137, 11739, 8918, 13058, 5533, 4611, 2944, 2470, 1385, 1248, 1501, 918, 614, 639, 382, 355, 232, 186, 138, 1
32, 109, 121, 85, 78, 113]                                                                                                                                     [2026/04/08 17:13:25] openrec INFO: each_len_acc:[0.8409646393336082, 0.8625095827050775, 0.8432383933132559, 0.857941491148766, 0.8330019865660546, 0.83214053
1702146, 0.7992527146764513, 0.8097165959120785, 0.7870036044259667, 0.7764423014708149, 0.8207861371033569, 0.7734204708777727, 0.7459283266135452, 0.7965571080351, 0.7146596671555061, 0.7014084309462414, 0.7155172105380513, 0.6290322242455794, 0.6956521235034693, 0.590909046143254, 0.6055045316050889, 0.6446280458985086, 0.6117646339100431, 0.6282050476660195, 0.6991149823792051]                                                                                             [2026/04/08 17:13:25] openrec INFO: each_len_norm_edit_dis:[0.8453506058682028, 0.9115725360664686, 0.9265861447442674, 0.9446175427760528, 0.9443492913055788,
 0.9551107945054793, 0.9478756477804618, 0.9557379464434607, 0.9529828979072088, 0.9561270793847483, 0.9685723450308902, 0.9633350495187631, 0.9624648887148171, 0.9699353533283833, 0.9556500884210274, 0.9676436076499177, 0.9583555763297323, 0.9509791530204523, 0.9639706175539798, 0.9285298692703546, 0.953830577332355, 0.9418547723877904, 0.9477692587733807, 0.9665384658284019, 0.9620955512021362]                                                                              [2026/04/08 17:13:25] openrec INFO: each_ratio_num:[12134, 13846, 11323, 8695, 5282, 3539, 2404, 1744, 1157, 928, 639, 1955]
[2026/04/08 17:13:25] openrec INFO: each_ratio_acc:[0.8255315635194235, 0.847103856097715, 0.844122581609006, 0.8493386994257175, 0.8534645951278595, 0.8428934
703506824, 0.8202994974197192, 0.7964449495616689, 0.7934312809556502, 0.77478447440965, 0.7949921628326735, 0.7125319656647982]                               [2026/04/08 17:13:25] openrec INFO: each_ratio_norm_edit_dis:[0.8776723388581933, 0.9235732841313558, 0.9370839362526979, 0.948221880331031, 0.9564458378972286
, 0.9601911123406612, 0.9564735462805312, 0.9520158689988883, 0.9595067352147316, 0.9513662834767583, 0.9612922512706836, 0.9541863301338591]                  [2026/04/08 17:13:25] openrec INFO: norm_edit_dis:0.9297571108374629
[2026/04/08 17:13:25] openrec INFO: num_samples:63646
[2026/04/08 17:13:25] openrec INFO: fps:22141.877893926612
[2026/04/08 17:13:25] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/web_test
[2026/04/08 17:13:26] openrec INFO: 0
[2026/04/08 17:13:26] openrec INFO: 3408
[2026/04/08 17:13:26] openrec INFO: 2900
[2026/04/08 17:13:26] openrec INFO: 1891
[2026/04/08 17:13:26] openrec INFO: 1943
[2026/04/08 17:13:26] openrec INFO: 1063
[2026/04/08 17:13:26] openrec INFO: 831
[2026/04/08 17:13:26] openrec INFO: 569
[2026/04/08 17:13:26] openrec INFO: 1454
0 3408 32.0 13 256
0 2900 64.0 11 256
0 1891 96.0 7 256
0 1943 128.0 7 256
0 1063 160.0 5 204
0 831 192.0 4 170
0 569 224.0 3 146
0 1454 256.0 11 128
[2026/04/08 17:13:26] openrec INFO: ../benchmark_bctr/web_test valid dataloader has 69 iters
eval model:: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████| 69/69 [00:13<00:00,  5.20it/s]
[2026/04/08 17:13:39] openrec INFO: metric eval ***************
[2026/04/08 17:13:39] openrec INFO: acc:0.8342698621279822
[2026/04/08 17:13:39] openrec INFO: acc_real:0.8342698621279822
[2026/04/08 17:13:39] openrec INFO: acc_lower:0.8342698621279822
[2026/04/08 17:13:39] openrec INFO: acc_ignore_space:0.8342698621279822
[2026/04/08 17:13:39] openrec INFO: acc_ignore_space_lower:0.8342698621279822
[2026/04/08 17:13:39] openrec INFO: acc_ignore_space_symbol:0.8342698621279822
[2026/04/08 17:13:39] openrec INFO: acc_ignore_space_lower_symbol:0.8342698621279822
[2026/04/08 17:13:39] openrec INFO: each_len_num:[2200, 2142, 1637, 2513, 1222, 1002, 825, 663, 417, 321, 276, 176, 131, 90, 91, 53, 64, 53, 37, 28, 22, 26, 22
, 29, 19]                                                                                                                                                      [2026/04/08 17:13:39] openrec INFO: each_len_acc:[0.8381818143719008, 0.8940242722034347, 0.8735491699844278, 0.8822124915152706, 0.8404255250374344, 0.8153692
533396283, 0.7927272631184574, 0.7812971224540404, 0.7745803171563473, 0.785046704515679, 0.7463767845515659, 0.6931817787964898, 0.6488549123011517, 0.6666665925926007, 0.7142856357927873, 0.5471697080811871, 0.593749907226577, 0.6037734709861375, 0.540540394448542, 0.464285548469447, 0.5454542975207739, 0.4230767603550922, 0.6818178719009673, 0.41379296076104805, 0.6315786149586237]                                                                                          [2026/04/08 17:13:39] openrec INFO: each_len_norm_edit_dis:[0.841606061326033, 0.9313958920102899, 0.9429444108555626, 0.956222879297997, 0.9558530125972593, 0
.945757295475286, 0.9517864363708426, 0.9563318496375526, 0.958964950236773, 0.9587723037482432, 0.952807761582841, 0.9510853757396129, 0.9224310100316904, 0.9474625278833523, 0.9614926782242478, 0.9379063063091003, 0.917589828408065, 0.8893192308577861, 0.8967994589019954, 0.9022959532616494, 0.8658009268004445, 0.8813469595913944, 0.9347826383399075, 0.8686516810131251, 0.974736855401655]                                                                                    [2026/04/08 17:13:39] openrec INFO: each_ratio_num:[3408, 2900, 1891, 1943, 1063, 831, 569, 426, 300, 209, 126, 393]
[2026/04/08 17:13:39] openrec INFO: each_ratio_acc:[0.8148474154493913, 0.8637931004696789, 0.8392384937110603, 0.8836850186120174, 0.8513640559608273, 0.82671
47914956102, 0.8119507765913748, 0.8004694647777122, 0.7899999736666676, 0.7464114475401221, 0.746031686822882, 0.6641221205057986]                            [2026/04/08 17:13:39] openrec INFO: each_ratio_norm_edit_dis:[0.8697767074810002, 0.9318374857962919, 0.9393837099184336, 0.9663558214278042, 0.963544572213014
3, 0.9622941046569556, 0.9651450516112808, 0.963562563873926, 0.9665470545518575, 0.9614340151230475, 0.959028095874848, 0.9266957589428898]                   [2026/04/08 17:13:39] openrec INFO: norm_edit_dis:0.9303665940342412
[2026/04/08 17:13:39] openrec INFO: num_samples:14059
[2026/04/08 17:13:39] openrec INFO: fps:25938.609701863807
[2026/04/08 17:13:39] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/document_test
[2026/04/08 17:13:40] openrec INFO: 0
[2026/04/08 17:13:40] openrec INFO: 3096
[2026/04/08 17:13:40] openrec INFO: 3895
[2026/04/08 17:13:40] openrec INFO: 3956
[2026/04/08 17:13:40] openrec INFO: 4304
[2026/04/08 17:13:40] openrec INFO: 4432
[2026/04/08 17:13:40] openrec INFO: 4725
[2026/04/08 17:13:40] openrec INFO: 4718
[2026/04/08 17:13:40] openrec INFO: 20874
0 3096 32.0 12 256
0 3895 64.0 15 256
0 3956 96.0 15 256
0 4304 128.0 16 256
0 4432 160.0 21 204
0 4725 192.0 27 170
0 4718 224.0 32 146
0 20874 256.0 163 128
[2026/04/08 17:13:40] openrec INFO: ../benchmark_bctr/document_test valid dataloader has 309 iters
eval model:: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████| 309/309 [01:05<00:00,  4.74it/s]
[2026/04/08 17:14:45] openrec INFO: metric eval ***************
[2026/04/08 17:14:45] openrec INFO: acc:0.9948399998010319
[2026/04/08 17:14:45] openrec INFO: acc_real:0.9948399998010319
[2026/04/08 17:14:45] openrec INFO: acc_lower:0.9948399998010319
[2026/04/08 17:14:45] openrec INFO: acc_ignore_space:0.9948399998010319
[2026/04/08 17:14:45] openrec INFO: acc_ignore_space_lower:0.9948399998010319
[2026/04/08 17:14:45] openrec INFO: acc_ignore_space_symbol:0.9948399998010319
[2026/04/08 17:14:45] openrec INFO: acc_ignore_space_lower_symbol:0.9948399998010319
[2026/04/08 17:14:45] openrec INFO: each_len_num:[3464, 3267, 3367, 3266, 3340, 3284, 3411, 3358, 3339, 3314, 3290, 3316, 3318, 3334, 3332, 0, 0, 0, 0, 0, 0, 0
, 0, 0, 0]                                                                                                                                                     [2026/04/08 17:14:45] openrec INFO: each_len_acc:[0.9965357938899082, 0.9972451760108809, 0.9988119958455242, 0.9984690722643322, 0.9979041886290293, 0.9972594
366709517, 0.997068305490858, 0.9979154228769641, 0.9949086523063532, 0.9954737447330303, 0.992401212789054, 0.9945717702214361, 0.9912597920697414, 0.9880023965566814, 0.9846938745957566, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]                                                                                [2026/04/08 17:14:45] openrec INFO: each_len_norm_edit_dis:[0.9965357967767442, 0.9984185287263998, 0.9995049995064696, 0.9994794856109017, 0.9993512974071318,
 0.9994997389957812, 0.9995811869175071, 0.9997394282318659, 0.9994143289758314, 0.9993992428832524, 0.9992355162591166, 0.9995263833486802, 0.9989693248313823, 0.9989530665326914, 0.99853941577069, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]                                                                      [2026/04/08 17:14:45] openrec INFO: each_ratio_num:[3096, 3895, 3956, 4304, 4432, 4725, 4718, 4894, 4087, 3762, 2779, 5352]
[2026/04/08 17:14:45] openrec INFO: each_ratio_acc:[0.9964470252052744, 0.9969191245265234, 0.9984833139573223, 0.9958178415524679, 0.9923285176165874, 0.99280
42307030599, 0.9938533255747068, 0.9938700429222108, 0.995106432603116, 0.9936204120318436, 0.9938826880392849, 0.9957025392456978]                            [2026/04/08 17:14:45] openrec INFO: each_ratio_norm_edit_dis:[0.9971468561676996, 0.9978391099755949, 0.9996418941700997, 0.9989516285834789, 0.999069199454873
6, 0.9990341522107995, 0.9993868596679388, 0.9990870229548467, 0.9995605921968521, 0.9994695009063178, 0.9994945261066365, 0.9996206148119067]                 [2026/04/08 17:14:45] openrec INFO: norm_edit_dis:0.9990708903875762
[2026/04/08 17:14:45] openrec INFO: num_samples:50000
[2026/04/08 17:14:45] openrec INFO: fps:22563.994198127635
[2026/04/08 17:14:45] openrec INFO: Initialize indexs of datasets:../benchmark_bctr/handwriting_test
[2026/04/08 17:14:46] openrec INFO: 0
[2026/04/08 17:14:46] openrec INFO: 1214
[2026/04/08 17:14:46] openrec INFO: 1719
[2026/04/08 17:14:46] openrec INFO: 2022
[2026/04/08 17:14:46] openrec INFO: 2405
[2026/04/08 17:14:46] openrec INFO: 2516
[2026/04/08 17:14:46] openrec INFO: 2424
[2026/04/08 17:14:46] openrec INFO: 2151
[2026/04/08 17:14:46] openrec INFO: 9033
0 1214 32.0 4 256
0 1719 64.0 6 256
0 2022 96.0 7 256
0 2405 128.0 9 256
0 2516 160.0 12 204
0 2424 192.0 14 170
0 2151 224.0 14 146
0 9033 256.0 70 128
[2026/04/08 17:14:46] openrec INFO: ../benchmark_bctr/handwriting_test valid dataloader has 144 iters
eval model:: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████| 144/144 [00:31<00:00,  4.64it/s]
[2026/04/08 17:15:17] openrec INFO: metric eval ***************
[2026/04/08 17:15:17] openrec INFO: acc:0.6689235221133863
[2026/04/08 17:15:17] openrec INFO: acc_real:0.6667518307499779
[2026/04/08 17:15:17] openrec INFO: acc_lower:0.6689235221133863
[2026/04/08 17:15:17] openrec INFO: acc_ignore_space:0.6667518307499779
[2026/04/08 17:15:17] openrec INFO: acc_ignore_space_lower:0.6689235221133863
[2026/04/08 17:15:17] openrec INFO: acc_ignore_space_symbol:0.6667518307499779
[2026/04/08 17:15:17] openrec INFO: acc_ignore_space_lower_symbol:0.6689235221133863
[2026/04/08 17:15:17] openrec INFO: each_len_num:[673, 1380, 949, 1770, 1552, 1840, 2314, 2190, 1648, 1678, 1170, 1059, 708, 554, 525, 716, 357, 426, 361, 515,
 286, 252, 197, 200, 164]                                                                                                                                      [2026/04/08 17:15:17] openrec INFO: each_len_acc:[0.8231797797447284, 0.8086956463137996, 0.7534246495951038, 0.7813559277889496, 0.766108242486416, 0.74999999
59239131, 0.7653413968654217, 0.7333333299847793, 0.6996359180847335, 0.6829558958107516, 0.6658119601212653, 0.6024551406755889, 0.5536723085639504, 0.5487364521888727, 0.4323809441451249, 0.5349161936464218, 0.4397758980454931, 0.48122064598073605, 0.4182825368896804, 0.3766990218116695, 0.29370628343684324, 0.2817460205656341, 0.22842638434383836, 0.14999999250000037, 0.21951218173706208]                                                                                   [2026/04/08 17:15:17] openrec INFO: each_len_norm_edit_dis:[0.8396978726146923, 0.8872061876399016, 0.9001756245151848, 0.9290940278420837, 0.9363033877447314,
 0.9425580536718683, 0.9531192981954895, 0.9522234388799526, 0.9458238905701044, 0.9502142080198441, 0.9484775999932179, 0.9407193718069573, 0.9420004595569494, 0.9343801574034799, 0.9264541615624636, 0.9480345166491687, 0.9243178200623995, 0.9369326454775905, 0.9259203823113988, 0.9264801865020978, 0.9089946054177157, 0.9042543904934293, 0.8779588820869839, 0.878643046360888, 0.8871961711476173]                                                                              [2026/04/08 17:15:17] openrec INFO: each_ratio_num:[1214, 1719, 2022, 2405, 2516, 2424, 2151, 1904, 1541, 1205, 1107, 3276]
[2026/04/08 17:15:17] openrec INFO: each_ratio_acc:[0.8064250345434512, 0.7748691054399703, 0.7596439131570528, 0.7367983337347263, 0.7229729700994715, 0.73803
63005856587, 0.6838679652074943, 0.678571425007503, 0.6177806578988926, 0.5958506174618207, 0.5438120998752295, 0.44169719034890964]                           [2026/04/08 17:15:17] openrec INFO: each_ratio_norm_edit_dis:[0.8643249403189677, 0.9011371931608273, 0.9270905845064514, 0.9344623116352698, 0.942039611957877
3, 0.9504591526582393, 0.9476912922394136, 0.9497713136484205, 0.9411226226734034, 0.9446124373050782, 0.9383001451648647, 0.924761929562469]                  [2026/04/08 17:15:17] openrec INFO: norm_edit_dis:0.9324639676902702
[2026/04/08 17:15:17] openrec INFO: num_samples:23484
[2026/04/08 17:15:17] openrec INFO: fps:21914.835918790166
[83.39722840659314, 83.42698621279821, 99.48399998010319, 66.89235221133863, 83.30014170270829, 86.15640024517653]

config如下，best.pth来自于我们公开的连接https://drive.google.com/drive/folders/1ZDECKXf8zZFhcKKKpvicg43Ho85uDZkF：

Global:
  device: gpu
  epoch_num: 100
  log_smooth_window: 20
  print_batch_step: 10
  output_dir: ./output/rec/ch/svtrv2_smtr_gtc_rctc_ch
  save_epoch_step: [15, 1]
  # evaluation is run every 2000 iterations
  eval_batch_step: [0, 2000]
  eval_epoch_step: [0, 1]
  cal_metric_during_train: False
  pretrained_model: ./svtrv2_ch/best.pth
  checkpoints:
  use_tensorboard: false
  infer_img:
  # for data or label process
  character_dict_path: &character_dict_path ./tools/utils/ppocr_keys_v1.txt # ch
  max_text_length: &max_text_length 25
  use_space_char: &use_space_char False
  save_res_path: ./output/rec/ch/predicts_svtrv2_smtr_gtc_rctc_ch.txt
  use_amp: True

Optimizer:
  name: AdamW
  lr: 0.00065 # for 4gpus bs256/gpu
  weight_decay: 0.05
  filter_bias_and_bn: True

LRScheduler:
  name: OneCycleLR
  warmup_epoch: 5
  cycle_momentum: False

Architecture:
  model_type: rec
  algorithm: SVTRv2
  in_channels: 3
  Transform:
  Encoder:
    name: SVTRv2LNConvTwo33
    use_pos_embed: False
    dims: [128, 256, 384]
    depths: [6, 6, 6]
    num_heads: [4, 8, 12]
    mixer: [['Conv','Conv','Conv','Conv','Conv','Conv'],['Conv','Conv','FGlobal','Global','Global','Global'],['Global','Global','Global','Global','Global','Global']]
    local_k: [[5, 5], [5, 5], [-1, -1]]
    sub_k: [[1, 1], [2, 1], [-1, -1]]
    last_stage: false
    feat2d: True
  Decoder:
    name: GTCDecoder
    infer_gtc: False
    detach: False
    gtc_decoder:
      name: SMTRDecoder
      num_layer: 1
      ds: True
      max_len: *max_text_length
      next_mode: &next True
      sub_str_len: &subsl 5
    ctc_decoder:
      name: RCTCDecoder

Loss:
  name: CTCLoss
  zero_infinity: True

PostProcess:
  name: CTCLabelDecode
  character_dict_path: *character_dict_path
  use_space_char: *use_space_char

Metric:
  name: RecMetric
  main_indicator: acc
  # is_filter: True

Train:
  dataset:
    name: RatioDataSetTVResize
    ds_width: True
    padding: false
    data_dir_list: ['../benchmark_bctr/benchmark_bctr_train/document_train',
    '../benchmark_bctr/benchmark_bctr_train/handwriting_train',
    '../benchmark_bctr/benchmark_bctr_train/scene_train',
    '../benchmark_bctr/benchmark_bctr_train/web_train'
    ]
    transforms:
      - DecodeImagePIL: # load image
          img_mode: RGB
      - PARSeqAugPIL:
      - CTCLabelEncode: # Class handling label
          character_dict_path: *character_dict_path
          use_space_char: *use_space_char
          max_text_length: *max_text_length
      - KeepKeys:
          keep_keys: ['image', 'label', 'length'] # dataloader will return list in this order
  sampler:
    name: RatioSampler
    scales: [[128, 32]] # w, h
    # divide_factor: to ensure the width and height dimensions can be devided by downsampling multiple
    first_bs: &bs 256
    fix_bs: false
    divided_factor: [4, 16] # w, h
    is_training: True
  loader:
    shuffle: True
    batch_size_per_card: *bs
    drop_last: True
    max_ratio: &max_ratio 8
    num_workers: 4

Eval:
  dataset:
    name: RatioDataSetTVResize
    ds_width: True
    padding: False
    data_dir_list: ['../benchmark_bctr/scene_test']
    transforms:
      - DecodeImagePIL: # load image
          img_mode: RGB
      - CTCLabelEncode: # Class handling label
          character_dict_path: *character_dict_path
          use_space_char: *use_space_char
          max_text_length: *max_text_length
      - KeepKeys:
          keep_keys: ['image', 'label', 'length'] # dataloader will return list in this order
  sampler:
    name: RatioSampler
    scales: [[128, 32]] # w, h
    # divide_factor: to ensure the width and height dimensions can be devided by downsampling multiple
    first_bs: *bs
    fix_bs: false
    divided_factor: [4, 16] # w, h
    is_training: False
  loader:
    shuffle: False
    drop_last: False
    batch_size_per_card: *bs
    max_ratio: *max_ratio
    num_workers: 4

环境配置：torch 2.6.0+cu126，H20或4090 GPU

另外，我们也发现在某些环境下会偶发指标对不齐的情况，例如在1080ti和3090 gpu下会可能出现该情况。因此，建议换一种GPU重新测试。