support tensor parallel #2671

Job	Run time
build-and-push-docker-images	5m 13s
build-and-push-docker-images	4m 3s
build-python-wheels (ubuntu-20.04, auto64)	16s
build-python-wheels (ubuntu-20.04, auto64)	2m 41s
build-and-test-cpp-aarch64 (openblas)	2m 35s
build-and-test-cpp-aarch64 (openblas)	2m 29s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	2m 24s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	2m 23s
check-python-style	14s
check-python-style	9s
build-python-wheels (macos-11, auto64)	10s
build-python-wheels (macos-11, auto64)	2m 40s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	2m 5s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	2m 7s
build-python-wheels (windows-2019, auto64)	16s
build-python-wheels (windows-2019, auto64)	2m 49s
build-and-test-cpp-x86_64 (macos-11, mkl)	2m 22s
build-and-test-cpp-x86_64 (macos-11, mkl)	2m 22s
build-python-wheels (ubuntu-20.04, aarch64)	11s
build-python-wheels (ubuntu-20.04, aarch64)	2m 42s
build-and-test-cpp-x86_64 (macos-11, dnnl)	2m 21s
build-and-test-cpp-x86_64 (macos-11, dnnl)	1m 51s
build-python-wheels (macos-11, arm64)	4s
build-python-wheels (macos-11, arm64)	2m 20s
test-python-wheels	0s
test-python-wheels	0s
build-and-deploy-docs	0s
build-and-deploy-docs	0s
publish-python-wheels-on-pypi	0s
publish-python-wheels-on-pypi	0s
	46m 47s

Provide feedback