-
Notifications
You must be signed in to change notification settings - Fork 90
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable windows arm64 builds for audio and vision #6352
Open
alinpahontu2912
wants to merge
8
commits into
pytorch:main
Choose a base branch
from
alinpahontu2912:winarm64_wheels
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
8 commits
Select commit
Hold shift + click to select a range
561e93b
add scripts and workflow for Windows arm64 audio & vision wheels
alinpahontu2912 795975b
Merge branch 'pytorch:main' into winarm64_wheels
alinpahontu2912 7293512
fix workflow_call
alinpahontu2912 001d221
Merge branch 'winarm64_wheels' of https://github.com/alinpahontu2912/…
alinpahontu2912 07893bb
update runner name
alinpahontu2912 c9a8eb5
update permissions
alinpahontu2912 127cdc0
update workflow and scripts
alinpahontu2912 ad2318c
add installation link for nightlytorch
alinpahontu2912 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,67 @@ | ||
| @echo off | ||
|
|
||
| echo Dependency MSVC Build Tools with C++ with ARM64/ARM64EC components installation started. | ||
|
|
||
| :: Pre-check for downloads and dependencies folders | ||
| if not exist "%DOWNLOADS_DIR%" mkdir "%DOWNLOADS_DIR%" | ||
| if not exist "%DEPENDENCIES_DIR%" mkdir "%DEPENDENCIES_DIR%" | ||
|
|
||
| :: Set download URL for the Visual Studio Installer | ||
| set DOWNLOAD_URL=https://aka.ms/vs/17/release/vs_BuildTools.exe | ||
| set INSTALLER_FILE=%DOWNLOADS_DIR%\vs_BuildTools.exe | ||
|
|
||
| :: Download installer | ||
| echo Downloading Visual Studio Build Tools with C++ installer... | ||
| curl -L -o "%INSTALLER_FILE%" %DOWNLOAD_URL% | ||
|
|
||
| :: Install the Visual Studio Build Tools with C++ components | ||
| echo Installing Visual Studio Build Tools with C++ components... | ||
| echo Installing MSVC %MSVC_VERSION% | ||
| if "%MSVC_VERSION%" == "latest" ( | ||
| "%INSTALLER_FILE%" --norestart --quiet --wait --installPath "%DEPENDENCIES_DIR%\VSBuildTools" ^ | ||
| --add Microsoft.VisualStudio.Workload.VCTools ^ | ||
| --add Microsoft.VisualStudio.Component.Windows10SDK ^ | ||
| --add Microsoft.VisualStudio.Component.Windows11SDK.22621 ^ | ||
| --add Microsoft.VisualStudio.Component.VC.ASAN ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CMake.Project ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CoreBuildTools ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CoreIde ^ | ||
| --add Microsoft.VisualStudio.Component.VC.Redist.14.Latest ^ | ||
| --add Microsoft.VisualStudio.Component.VC.Tools.ARM64EC ^ | ||
| --add Microsoft.VisualStudio.Component.VC.Tools.ARM64 ^ | ||
| --add Microsoft.VisualStudio.Component.VC.Tools.x86.x64 | ||
| ) else if "%MSVC_VERSION%" == "14.40" ( | ||
| "%INSTALLER_FILE%" --norestart --nocache --quiet --wait --fix --installPath "%DEPENDENCIES_DIR%\VSBuildTools" ^ | ||
| --add Microsoft.VisualStudio.Workload.VCTools ^ | ||
| --add Microsoft.VisualStudio.Component.Windows10SDK ^ | ||
| --add Microsoft.VisualStudio.Component.Windows11SDK.22621 ^ | ||
| --add Microsoft.VisualStudio.Component.VC.ASAN ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CMake.Project ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CoreBuildTools ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CoreIde ^ | ||
| --add Microsoft.VisualStudio.Component.VC.Redist.14.Latest ^ | ||
| --add Microsoft.VisualStudio.Component.VC.14.40.17.10.ARM64 ^ | ||
| --add Microsoft.VisualStudio.Component.VC.14.40.17.10.x86.x64 | ||
| ) else if "%MSVC_VERSION%" == "14.36" ( | ||
| "%INSTALLER_FILE%" --norestart --nocache --quiet --wait --fix --installPath "%DEPENDENCIES_DIR%\VSBuildTools" ^ | ||
| --add Microsoft.VisualStudio.Workload.VCTools ^ | ||
| --add Microsoft.VisualStudio.Component.Windows10SDK ^ | ||
| --add Microsoft.VisualStudio.Component.Windows11SDK.22621 ^ | ||
| --add Microsoft.VisualStudio.Component.VC.ASAN ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CMake.Project ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CoreBuildTools ^ | ||
| --add Microsoft.VisualStudio.Component.VC.CoreIde ^ | ||
| --add Microsoft.VisualStudio.Component.VC.Redist.14.Latest ^ | ||
| --add Microsoft.VisualStudio.Component.VC.14.36.17.6.ARM64 ^ | ||
| --add Microsoft.VisualStudio.Component.VC.14.36.17.6.x86.x64 | ||
| ) | ||
|
|
||
| echo exitcode = %errorlevel% | ||
|
|
||
| :: Check if installation was successful | ||
| if %errorlevel% neq 0 ( | ||
| echo Failed to install Visual Studio Build Tools with C++ components. | ||
| exit /b 1 | ||
| ) | ||
|
|
||
| echo Dependency Visual Studio Build Tools with C++ installation finished. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,55 @@ | ||
| @echo off | ||
| setlocal enabledelayedexpansion | ||
|
|
||
|
|
||
| echo Dependency Git installation started. | ||
|
|
||
|
|
||
| :: Pre-check for downloads and dependencies folders | ||
| set "DOWNLOADS_DIR=c:\temp\downloads" | ||
| set "DEPENDENCIES_DIR=c:\temp\dependencies" | ||
|
|
||
|
|
||
| if not exist "%DOWNLOADS_DIR%" mkdir "%DOWNLOADS_DIR%" | ||
| if not exist "%DEPENDENCIES_DIR%" mkdir "%DEPENDENCIES_DIR%" | ||
|
|
||
|
|
||
| :: Set download URL for the Git | ||
| set "DOWNLOAD_URL=https://github.com/git-for-windows/git/releases/download/v2.48.1.windows.1/Git-2.48.1-arm64.exe" | ||
| set "INSTALLER_FILE=%DOWNLOADS_DIR%\Git-2.48.1-arm64.exe" | ||
|
|
||
|
|
||
| :: Download installer | ||
| echo Downloading Git... | ||
| curl -L -o "%INSTALLER_FILE%" "%DOWNLOAD_URL%" | ||
|
|
||
|
|
||
| :: Verify download success | ||
| if not exist "%INSTALLER_FILE%" ( | ||
| echo Failed to download Git! | ||
| exit /b 1 | ||
| ) | ||
|
|
||
|
|
||
| :: Install Git | ||
| echo Installing Git... | ||
| "%INSTALLER_FILE%" /VERYSILENT /DIR="%DEPENDENCIES_DIR%\git" | ||
|
|
||
|
|
||
| :: Verify installation success | ||
| if %errorlevel% neq 0 ( | ||
| echo Failed to install Git. (exitcode = %errorlevel%) | ||
| exit /b 1 | ||
| ) | ||
|
|
||
|
|
||
| :: Enable long paths | ||
| call "%DEPENDENCIES_DIR%\git\cmd\git.exe" config --system core.longpaths true | ||
|
|
||
|
|
||
| :: Add Git to PATH (temporary for this session) | ||
| set "PATH=%DEPENDENCIES_DIR%\git\cmd\;%DEPENDENCIES_DIR%\git\bin\;%PATH%" | ||
|
|
||
|
|
||
| echo Dependency Git installation finished. | ||
| exit /b 0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,47 @@ | ||
| @echo off | ||
|
|
||
| echo Dependency Python installation started. | ||
|
|
||
| :: Pre-check for downloads and dependencies folders | ||
| if not exist "%DOWNLOADS_DIR%" mkdir %DOWNLOADS_DIR% | ||
| if not exist "%DEPENDENCIES_DIR%" mkdir %DEPENDENCIES_DIR% | ||
|
|
||
| echo PYTHON_VERSION is %PYTHON_VERSION% | ||
|
|
||
| if "%PYTHON_VERSION%" == "3.13" ( | ||
| echo Python version is set to 3.13 | ||
| set DOWNLOAD_URL=https://www.python.org/ftp/python/3.13.2/python-3.13.2-arm64.exe | ||
| ) | ||
| else if "%PYTHON_VERSION%" == "3.12" ( | ||
| echo Python version is set to 3.12 | ||
| set DOWNLOAD_URL=https://www.python.org/ftp/python/3.12.7/python-3.12.7-arm64.exe | ||
| ) else if "%PYTHON_VERSION%" == "3.11" ( | ||
| echo Python version is set to 3.11 | ||
| set DOWNLOAD_URL=https://www.python.org/ftp/python/3.11.9/python-3.11.9-arm64.exe | ||
| ) else ( | ||
| echo PYTHON_VERSION not defined, Python version is set to 3.12 | ||
| set DOWNLOAD_URL=https://www.python.org/ftp/python/3.12.7/python-3.12.7-arm64.exe | ||
| ) | ||
|
|
||
| set INSTALLER_FILE=%DOWNLOADS_DIR%\python-installer.exe | ||
|
|
||
| :: Download installer | ||
| echo Downloading Python... | ||
| curl -L -o "%INSTALLER_FILE%" "%DOWNLOAD_URL%" | ||
|
|
||
| :: Install Python | ||
| echo Installing Python... | ||
| "%INSTALLER_FILE%" /quiet Include_debug=1 TargetDir="%DEPENDENCIES_DIR%\Python" | ||
|
|
||
| :: Check if installation was successful | ||
| if %errorlevel% neq 0 ( | ||
| echo "Failed to install Python. (exitcode = %errorlevel%)" | ||
| exit /b 1 | ||
| ) | ||
|
|
||
| :: Add to PATH | ||
| echo %DEPENDENCIES_DIR%\Python\>> %GITHUB_PATH% | ||
| echo %DEPENDENCIES_DIR%\Python\scripts\>> %GITHUB_PATH% | ||
| echo %DEPENDENCIES_DIR%\Python\libs\>> %GITHUB_PATH% | ||
|
|
||
| echo Dependency Python installation finished. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,57 @@ | ||
| @echo on | ||
| set SRC_PATH=%GITHUB_WORKSPACE%\%SRC_DIR% | ||
| set CMAKE_BUILD_TYPE=%BUILD_TYPE% | ||
| set VCVARSALL_PATH=%DEPENDENCIES_DIR%\VSBuildTools\VC\Auxiliary\Build\vcvarsall.bat | ||
| set CONDA_PREFIX=%DEPENDENCIES_DIR% | ||
| set PATH=%PATH%;%CONDA_PREFIX%\Library\bin | ||
| set DISTUTILS_USE_SDK=1 | ||
| set USE_FFMPEG=1 | ||
| set FFMPEG_ROOT=%DEPENDENCIES_DIR%\Library | ||
|
|
||
| :: Dependencies | ||
| if not exist "%DOWNLOADS_DIR%" mkdir %DOWNLOADS_DIR% | ||
| if not exist "%DEPENDENCIES_DIR%" mkdir %DEPENDENCIES_DIR% | ||
| echo * > %DOWNLOADS_DIR%\.gitignore | ||
| echo * > %DEPENDENCIES_DIR%\.gitignore | ||
|
|
||
| :: install vcpkg | ||
| cd %DOWNLOADS_DIR% | ||
| :: for ffmpeg 6.1.1 - pinning the version of vcpkg | ||
| :: https://pytorch.org/audio/stable/installation.html | ||
| git clone https://github.com/microsoft/vcpkg.git -b 2024.07.12 | ||
| cd vcpkg | ||
| call bootstrap-vcpkg.bat | ||
|
|
||
| :: install dependencies | ||
| vcpkg install ffmpeg[ffmpeg]:arm64-windows --x-install-root=%DEPENDENCIES_DIR% | ||
| robocopy /E %DEPENDENCIES_DIR%\arm64-windows %DEPENDENCIES_DIR%\Library | ||
| robocopy /E %DEPENDENCIES_DIR%\Library\tools\ffmpeg %DEPENDENCIES_DIR%\Library\bin | ||
| robocopy /E %DEPENDENCIES_DIR%\Library\bin %SRC_PATH%\src\torio\lib | ||
|
|
||
| :: test ffmpeg | ||
| echo %FFMPEG_ROOT% | ||
| ffmpeg -version | ||
|
|
||
| :: Source directory | ||
| cd %SRC_PATH% | ||
|
|
||
| :: Virtual environment | ||
| python -m pip install --upgrade pip | ||
| python -m venv .venv --upgrade-deps | ||
| echo * > .venv\.gitignore | ||
| call .\.venv\Scripts\activate | ||
|
|
||
| :: Install dependencies | ||
| pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu | ||
|
|
||
| :: Activate visual studio | ||
| call "%VCVARSALL_PATH%" arm64 | ||
|
|
||
| :: Creates wheel under dist folder | ||
| python setup.py bdist_wheel | ||
|
|
||
| :: Check if installation was successful | ||
| if %errorlevel% neq 0 ( | ||
| echo "Failed on build_audio. (exitcode = %errorlevel%)" | ||
| exit /b 1 | ||
| ) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,60 @@ | ||
| @echo on | ||
| set SRC_PATH=%GITHUB_WORKSPACE%\%SRC_DIR% | ||
| set CMAKE_BUILD_TYPE=%BUILD_TYPE% | ||
| set VCVARSALL_PATH=%DEPENDENCIES_DIR%\VSBuildTools\VC\Auxiliary\Build\vcvarsall.bat | ||
| set CONDA_PREFIX=%DEPENDENCIES_DIR% | ||
| set PATH=%PATH%;%CONDA_PREFIX%\Library\bin | ||
| set DISTUTILS_USE_SDK=1 | ||
|
|
||
| :: Dependencies | ||
| if not exist "%DOWNLOADS_DIR%" mkdir %DOWNLOADS_DIR% | ||
| if not exist "%DEPENDENCIES_DIR%" mkdir %DEPENDENCIES_DIR% | ||
| echo * > %DOWNLOADS_DIR%\.gitignore | ||
| echo * > %DEPENDENCIES_DIR%\.gitignore | ||
|
|
||
| :: install vcpkg | ||
| cd %DOWNLOADS_DIR% | ||
| git clone https://github.com/microsoft/vcpkg.git | ||
| cd vcpkg | ||
| call bootstrap-vcpkg.bat | ||
|
|
||
| :: install dependencies | ||
| vcpkg install libjpeg-turbo:arm64-windows --x-install-root=%DEPENDENCIES_DIR% | ||
| vcpkg install libwebp:arm64-windows --x-install-root=%DEPENDENCIES_DIR% | ||
| vcpkg install libpng[tools]:arm64-windows --x-install-root=%DEPENDENCIES_DIR% | ||
| :: https://pytorch.org/vision/stable/index.html | ||
| :: Building with FFMPEG is disabled by default in the latest main | ||
| :: vcpkg install ffmpeg[ffmpeg]:arm64-windows --x-install-root=%DEPENDENCIES_DIR% | ||
| copy %DEPENDENCIES_DIR%\arm64-windows\lib\libpng16.lib %DEPENDENCIES_DIR%\arm64-windows\lib\libpng.lib | ||
| copy %DEPENDENCIES_DIR%\arm64-windows\bin\libpng16.dll %DEPENDENCIES_DIR%\arm64-windows\bin\libpng.dll | ||
| copy %DEPENDENCIES_DIR%\arm64-windows\bin\libpng16.pdb %DEPENDENCIES_DIR%\arm64-windows\bin\libpng.pdb | ||
| robocopy /E %DEPENDENCIES_DIR%\arm64-windows %DEPENDENCIES_DIR%\Library | ||
| robocopy /E %DEPENDENCIES_DIR%\Library\tools\libpng %DEPENDENCIES_DIR%\Library\bin | ||
| robocopy /E %DEPENDENCIES_DIR%\Library\bin %SRC_PATH%\torchvision *.dll | ||
|
|
||
| :: Source directory | ||
| cd %SRC_PATH% | ||
|
|
||
| :: Virtual environment | ||
| python -m pip install --upgrade pip | ||
| python -m venv .venv --upgrade-deps | ||
| echo * > .venv\.gitignore | ||
| call .\.venv\Scripts\activate | ||
|
|
||
| :: Install dependencies | ||
| pip install numpy | ||
| pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu | ||
|
|
||
| exit /b 0 | ||
|
|
||
| :: Activate visual studio | ||
| call "%VCVARSALL_PATH%" arm64 | ||
|
|
||
| :: Creates wheel under dist folder | ||
| python setup.py bdist_wheel | ||
|
|
||
| :: Check if installation was successful | ||
| if %errorlevel% neq 0 ( | ||
| echo "Failed on build_vision. (exitcode = %errorlevel%)" | ||
| exit /b 1 | ||
| ) | ||
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Check failure
Code scanning / lintrunner
PYPIDEP/unpinned PyPI install Error