Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Difference Inference result after the conversion. #42

Open
mattiadp opened this issue May 19, 2021 · 3 comments
Open

Difference Inference result after the conversion. #42

mattiadp opened this issue May 19, 2021 · 3 comments

Comments

@mattiadp
Copy link

Hello thank you for your work

I have a question for you. I have correctly converted a custom .weigth to openvino format. After converting to the openvino format, I was able to see a decrease in general performance as regards the quality of the detection. On average I noticed an 8% decrease in the neural network's ability to detect my custom objects. It's normal? Do you have any advice to be able to bring the quality of the results closer to those of the original weigth.
I noticed that the loss of quality occurs in the transformation .weight to .pb

Thank you

@TNTWEN
Copy link
Owner

TNTWEN commented May 19, 2021

@mattiadp
It is normal that there are differences in accuracy among different inferencing frameworks. But under normal circumstances, the accuracy of openvino will not lose too much. This has nothing to do with the precision of. pb.

I think you should check size of input image, confidence threshold,anchors ...... first,make sure these parameters are the same when you test your model in darknet and openvino.

Also you could use accuracy-checker(INT8 Quantization step 4) to calculate IR model's map.

@mattiadp
Copy link
Author

mattiadp commented May 19, 2021

Thanks for the quick response. OK! I got it. Maybe I could try training yolo4 directly with a TensorFlow framework implementation to get a better overall quality. Anyway thanks again.

@TNTWEN
Copy link
Owner

TNTWEN commented May 19, 2021

No,you should use darknet to train your model !!!!!!
Many tensorflow and pytorch 's yolov4 implementation are different from darknet.
It will cause your model can only run under the training framework, and the effect of converting to other frames is especially poor!!

Never train yolo4 directly with a TensorFlow framework then convert to other format.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants