Add log probs for all tokens (#1755) #2867

Job	Run time
build-and-push-docker-images	28m 39s
build-and-test-cpp-aarch64 (openblas)	4m 36s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	5m 56s
build-python-wheels (ubuntu-20.04, auto64)	34m 33s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	5m 36s
check-python-style	11s
build-python-wheels (windows-2019, auto64)	45m 46s
build-python-wheels (ubuntu-20.04, aarch64)	1h 17m 11s
build-python-wheels (macos-12, arm64)	7m 1s
build-and-deploy-docs	32s
test-python-wheels (ubuntu-20.04)	11m 45s
test-python-wheels (windows-2019)	4m 0s
publish-python-wheels-on-pypi	0s
	3h 45m 46s

Provide feedback