Add log probs for all tokens #2862

Job	Run time
build-and-test-cpp-aarch64 (openblas)	4m 13s
build-and-push-docker-images	29m 35s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	5m 54s
build-python-wheels (ubuntu-20.04, auto64)	34m 47s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	5m 37s
build-python-wheels (windows-2019, auto64)	1h 1m 6s
build-python-wheels (ubuntu-20.04, aarch64)	1h 16m 27s
check-python-style	8s
build-python-wheels (macos-12, arm64)	15m 2s
build-and-deploy-docs	31s
test-python-wheels (ubuntu-20.04)	5m 31s
test-python-wheels (windows-2019)	5m 6s
publish-python-wheels-on-pypi	0s
	4h 3m 57s

Provide feedback