LLaMa: get tokens in the range of the vocab size (#1621) #2647

Job	Run time
build-and-push-docker-images	23m 0s
build-and-test-cpp-aarch64 (openblas)	4m 0s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	5m 34s
build-python-wheels (ubuntu-20.04, auto64)	27m 4s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	5m 1s
build-python-wheels (macos-11, auto64)	35m 32s
build-and-test-cpp-x86_64 (macos-11, mkl)	10m 13s
check-python-style	8s
build-python-wheels (windows-2019, auto64)	43m 28s
build-and-test-cpp-x86_64 (macos-11, dnnl)	9m 22s
build-python-wheels (ubuntu-20.04, aarch64)	1h 13m 24s
build-python-wheels (macos-11, arm64)	12m 51s
build-and-deploy-docs	37s
test-python-wheels (ubuntu-20.04)	9m 16s
test-python-wheels (macos-11)	4m 27s
test-python-wheels (windows-2019)	5m 30s
publish-python-wheels-on-pypi	0s
	4h 29m 27s

Provide feedback