Skip to content
IRMVLabPublic

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

1 Commit

Folders and files

Repository files navigation

TransSeg

Installation

Requirements

Data Preparation

SemanticKITTI

Please download the files from the SemanticKITTI website and additionally the color data from the Kitti Odometry website. Extract everything into the same folder.

./dataset/
├── 
├── ...
└── SemanticKitti/
    ├──sequences
        ├── 00/           
        │   ├── velodyne/	
        |   |	├── 000000.bin
        |   |	├── 000001.bin
        |   |	└── ...
        │   └── labels/ 
        |   |   ├── 000000.label
        |   |   ├── 000001.label
        |   |   └── ...
        |   └── image_2/ 
        |   |   ├── 000000.png
        |   |   ├── 000001.png
        |   |   └── ...
        |   calib.txt
        ├── 08/ # for validation
        ├── 11/ # 11-21 for testing
        └── 21/
	    └── ...

NuScenes

Please download the Full dataset (v1.0) from the NuScenes website with lidarseg and extract it.

./dataset/
├── 
├── ...
└── nuscenes/
    ├──v1.0-trainval
    ├──v1.0-test
    ├──samples
    ├──sweeps
    ├──maps
    ├──lidarseg

Training

SemanticKITTI

You can run the training with

cd <root dir of this repo>
python main.py --log_dir TransSeg --config config/TransSeg-nuscenes.yaml --gpu 0,1,2,3
or
bash run_kitti.sh

The output will be written to logs/SemanticKITTI/2DPASS_semkitti by default.

NuScenes

cd <root dir of this repo>
python main.py --log_dir TransSeg --config config/TransSeg-nuscenes.yaml --gpu 0,1,2,3
or
bash run_nus.sh

Testing

You can run the testing with

cd <root dir of this repo>
python main.py --log_dir TransSeg_semkitti --config config/TransSeg-semantickitti.yaml --gpu 0  --test --num_vote 12 --checkpoint <dir for the pytorch checkpoint>

Here, num_vote is the number of views for the test-time-augmentation (TTA). We set this value to 12 as default (on a RTX 3090 GPU), and if you use other GPUs with smaller memory, you can choose a smaller value. num_vote=1 denotes there is no TTA used, and will cause about ~2% performance drop.

Acknowledgements

Code is built based on2DPASS, SPVNAS, Cylinder3D, xMUDA and SPCONV.

Citation

@article{zhuang2026transseg,
  title={TransSeg: 3-D Semantic Segmentation Based on 2D--3D Trans-Modal Fusion for Autonomous Driving},
  author={Zhuang, Mingxi and Wang, Guangming and Wang, Hesheng},
  journal={IEEE Transactions on Industrial Informatics},
  year={2026},
  volume={22},
  number={8},
  pages={6789-6799},
  doi={10.1109/TII.2026.3680762}
}

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages