Skip to content

Latest commit

 

History

History
114 lines (94 loc) · 3.86 KB

README.md

File metadata and controls

114 lines (94 loc) · 3.86 KB

TransSeg

Installation

Requirements

Data Preparation

SemanticKITTI

Please download the files from the SemanticKITTI website and additionally the color data from the Kitti Odometry website. Extract everything into the same folder.

./dataset/
├── 
├── ...
└── SemanticKitti/
    ├──sequences
        ├── 00/           
        │   ├── velodyne/	
        |   |	├── 000000.bin
        |   |	├── 000001.bin
        |   |	└── ...
        │   └── labels/ 
        |   |   ├── 000000.label
        |   |   ├── 000001.label
        |   |   └── ...
        |   └── image_2/ 
        |   |   ├── 000000.png
        |   |   ├── 000001.png
        |   |   └── ...
        |   calib.txt
        ├── 08/ # for validation
        ├── 11/ # 11-21 for testing
        └── 21/
	    └── ...

NuScenes

Please download the Full dataset (v1.0) from the NuScenes website with lidarseg and extract it.

./dataset/
├── 
├── ...
└── nuscenes/
    ├──v1.0-trainval
    ├──v1.0-test
    ├──samples
    ├──sweeps
    ├──maps
    ├──lidarseg

Training

SemanticKITTI

You can run the training with

cd <root dir of this repo>
python main.py --log_dir TransSeg --config config/TransSeg-nuscenes.yaml --gpu 0,1,2,3
or
bash run_kitti.sh

The output will be written to logs/SemanticKITTI/2DPASS_semkitti by default.

NuScenes

cd <root dir of this repo>
python main.py --log_dir TransSeg --config config/TransSeg-nuscenes.yaml --gpu 0,1,2,3
or
bash run_nus.sh

Testing

You can run the testing with

cd <root dir of this repo>
python main.py --log_dir TransSeg_semkitti --config config/TransSeg-semantickitti.yaml --gpu 0  --test --num_vote 12 --checkpoint <dir for the pytorch checkpoint>

Here, num_vote is the number of views for the test-time-augmentation (TTA). We set this value to 12 as default (on a RTX 3090 GPU), and if you use other GPUs with smaller memory, you can choose a smaller value. num_vote=1 denotes there is no TTA used, and will cause about ~2% performance drop.

Acknowledgements

Code is built based on2DPASS, SPVNAS, Cylinder3D, xMUDA and SPCONV.

Citation

@article{zhuang2026transseg,
  title={TransSeg: 3-D Semantic Segmentation Based on 2D--3D Trans-Modal Fusion for Autonomous Driving},
  author={Zhuang, Mingxi and Wang, Guangming and Wang, Hesheng},
  journal={IEEE Transactions on Industrial Informatics},
  year={2026},
  volume={22},
  number={8},
  pages={6789-6799},
  doi={10.1109/TII.2026.3680762}
}