fix position bias in tensor parallel (#1714) #2775

Job	Run time
build-and-test-cpp-aarch64 (openblas)	4m 0s
build-and-test-cpp-aarch64 (openblas)	4m 0s
build-python-wheels (ubuntu-20.04, auto64)	2h 5m 57s
build-python-wheels (ubuntu-20.04, auto64)	2h 5m 57s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	6m 54s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	6m 54s
build-python-wheels (macos-11, auto64)	36m 44s
build-python-wheels (macos-11, auto64)	36m 44s
build-python-wheels (windows-2019, auto64)	5h 27m 46s
build-python-wheels (windows-2019, auto64)	5h 27m 46s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	6m 30s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	6m 30s
build-and-test-cpp-x86_64 (macos-11, mkl)	12m 16s
build-and-test-cpp-x86_64 (macos-11, mkl)	12m 16s
build-python-wheels (ubuntu-20.04, aarch64)	1h 17m 8s
build-python-wheels (ubuntu-20.04, aarch64)	1h 17m 8s
build-and-test-cpp-x86_64 (macos-11, dnnl)	10m 24s
build-and-test-cpp-x86_64 (macos-11, dnnl)	10m 24s
build-python-wheels (macos-11, arm64)	14m 10s
build-python-wheels (macos-11, arm64)	14m 10s
build-and-push-docker-images	3m 18s
build-and-push-docker-images	1h 50m 45s
check-python-style	9s
check-python-style	9s
build-and-deploy-docs	53s
build-and-deploy-docs	53s
test-python-wheels (ubuntu-20.04)	10m 6s
test-python-wheels (ubuntu-20.04)	10m 6s
test-python-wheels (macos-11)	4m 41s
test-python-wheels (macos-11)	4m 41s
test-python-wheels (windows-2019)	4m 57s
test-python-wheels (windows-2019)	4m 57s
publish-python-wheels-on-pypi	0s
publish-python-wheels-on-pypi	0s
	23h 19m 13s

Provide feedback