[JENKINS-73242] GitHub Organization scan fails when repository is DMCA'd #1487
Description
Scanning a github organization/user fails if a repository is blocked due to a DMCA takedown.
Here is an excerpt from the end of my scan log:
Ignoring krypton
20:13:09 Skipping repository krypton because it is a fork
Ignoring laptop-setup-ubuntu-18.04
20:13:09 Skipping repository laptop-setup-ubuntu-18.04 because it is a fork
Ignoring LearningDesignPattern
20:13:09 Skipping repository LearningDesignPattern because it is a fork
Ignoring Ledger
20:13:10 Skipping repository Ledger because it is a fork
Ignoring LiquidBurner
20:13:10 Skipping repository LiquidBurner because it is a fork
ERROR: [Sun Jun 02 20:13:10 EDT 2024] Could not fetch sources from navigator org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator@7010654c
[Sun Jun 02 20:13:10 EDT 2024] Finished organization scan. Scan took 17 sec FATAL: Failed to recompute children of solonovamax
org.kohsuke.github.HttpException: {"message":"Repository access blocked","block":{"reason":"dmca","created_at":"2023-05-08T22:39:57Z","html_url":"
https://github.com/github/dmca/blob/master/2023/05/2023-05-04-nintendo-4.md
"}}
at PluginClassLoader for github-api//org.kohsuke.github.GitHubConnectorResponseErrorHandler$1.onError(GitHubConnectorResponseErrorHandler.java:62)
at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.detectKnownErrors(GitHubClient.java:504)
at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:464)
at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:427)
at PluginClassLoader for github-api//org.kohsuke.github.Requester.fetchInto(Requester.java:102)
at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.populate(GHRepository.java:3599)
at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.getSource(GHRepository.java:2979)
at PluginClassLoader for github-branch-source//org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator.visitSources(GitHubSCMNavigator.java:1068)
at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder.computeChildren(OrganizationFolder.java:530)
at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:269)
at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:167)
at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder$OrganizationScan.run(OrganizationFolder.java:915)
at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:446)
Finished: FAILURE
The repository in question is most likely one of the following:
These repositories cannot be removed through github. The DMCA was automatic and affected any users which had forked this repository (of which there were many, including me), so being unable to scan repositories due to this is quite annoying.
this is my first time reporting an issue for jenkins, so lmk if I left out any information (tho I think I got everything)
Originally reported by solonovamax, imported from: GitHub Organization scan fails when repository is DMCA'd
- assignee: solonovamax
- status: Open
- priority: Minor
- component(s): github-api-plugin, pipeline, scm-api-plugin
- resolution: Unresolved
- votes: 0
- watchers: 1
- imported: 2025-12-08
Raw content of original issue
Scanning a github organization/user fails if a repository is blocked due to a DMCA takedown.
Here is an excerpt from the end of my scan log:
Ignoring krypton 20:13:09 Skipping repository krypton because it is a fork Ignoring laptop-setup-ubuntu-18.04 20:13:09 Skipping repository laptop-setup-ubuntu-18.04 because it is a fork Ignoring LearningDesignPattern 20:13:09 Skipping repository LearningDesignPattern because it is a fork Ignoring Ledger 20:13:10 Skipping repository Ledger because it is a fork Ignoring LiquidBurner 20:13:10 Skipping repository LiquidBurner because it is a fork ERROR: [Sun Jun 02 20:13:10 EDT 2024] Could not fetch sources from navigator org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator@7010654c [Sun Jun 02 20:13:10 EDT 2024] Finished organization scan. Scan took 17 sec FATAL: Failed to recompute children of solonovamax org.kohsuke.github.HttpException: {"message":"Repository access blocked","block":{"reason":"dmca","created_at":"2023-05-08T22:39:57Z","html_url":" https://github.com/github/dmca/blob/master/2023/05/2023-05-04-nintendo-4.md "}} at PluginClassLoader for github-api//org.kohsuke.github.GitHubConnectorResponseErrorHandler$1.onError(GitHubConnectorResponseErrorHandler.java:62) at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.detectKnownErrors(GitHubClient.java:504) at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:464) at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:427) at PluginClassLoader for github-api//org.kohsuke.github.Requester.fetchInto(Requester.java:102) at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.populate(GHRepository.java:3599) at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.getSource(GHRepository.java:2979) at PluginClassLoader for github-branch-source//org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator.visitSources(GitHubSCMNavigator.java:1068) at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder.computeChildren(OrganizationFolder.java:530) at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:269) at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:167) at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder$OrganizationScan.run(OrganizationFolder.java:915) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:446) Finished: FAILURE
The repository in question is most likely one of the following:
These repositories cannot be removed through github. The DMCA was automatic and affected any users which had forked this repository (of which there were many, including me), so being unable to scan repositories due to this is quite annoying.
this is my first time reporting an issue for jenkins, so lmk if I left out any information (tho I think I got everything)
environment
Jenkins: 2.460<br/>
OS: Linux - 6.1.0-10-amd64<br/>
Java: 17.0.11 - Debian (OpenJDK 64-Bit Server VM)<br/>
---<br/>
adoptopenjdk:1.5<br/>
antisamy-markup-formatter:162.v0e6ec0fcfcf6<br/>
apache-httpcomponents-client-4-api:4.5.14-208.v438351942757<br/>
asm-api:9.7-33.v4d23ef79fcc8<br/>
bootstrap5-api:5.3.3-1<br/>
bouncycastle-api:2.30.1.78.1-233.vfdcdeb_0a_08a_a_<br/>
branch-api:2.1169.va_f810c56e895<br/>
build-name-setter:2.4.2<br/>
build-timeout:1.32<br/>
caffeine-api:3.1.8-133.v17b_1ff2e0599<br/>
checks-api:2.2.0<br/>
cloudbees-disk-usage-simple:203.v3f46a_7462b_1a_<br/>
cloudbees-folder:6.942.vb_43318a_156b_2<br/>
command-launcher:107.v773860566e2e<br/>
commons-lang3-api:3.13.0-62.v7d18e55f51e2<br/>
commons-text-api:1.11.0-109.vfe16c66636eb_<br/>
config-file-provider:973.vb_a_80ecb_9a_4d0<br/>
configuration-as-code:1810.v9b_c30a_249a_4c<br/>
credentials:1337.v60b_d7b_c7b_c9f<br/>
credentials-binding:677.vdc9d38cb_254d<br/>
dark-theme:465.vd8b_419b_0728f<br/>
dashboard-view:2.508.va_74654f026d1<br/>
data-tables-api:2.0.7-1<br/>
discord-notifier:241.v448b_ccd0c0d6<br/>
display-url-api:2.204.vf6fddd8a_8b_e9<br/>
durable-task:555.v6802fe0f0b_82<br/>
echarts-api:5.5.0-1<br/>
eddsa-api:0.3.0-4.v84c6f0f4969e<br/>
email-ext:1814.v404722f34263<br/>
embeddable-build-status:487.va_0ef04c898a_2<br/>
font-awesome-api:6.5.2-1<br/>
git:5.2.2<br/>
git-client:4.7.0<br/>
git-parameter:0.9.19<br/>
git-server:126.v0d945d8d2b_39<br/>
github:1.39.0<br/>
github-api:1.318-461.v7a_c09c9fa_d63<br/>
github-branch-source:1789.v5b_0c0cea_18c3<br/>
github-pullrequest:0.7.0<br/>
gitlab-api:5.3.0-91.v1f9a_fda_d654f<br/>
gitlab-plugin:1.8.1<br/>
gradle:2.12<br/>
gradle-daemon:0.1.0<br/>
gson-api:2.11.0-41.v019fcf6125dc<br/>
instance-identity:185.v303dc7c645f9<br/>
ionicons-api:74.v93d5eb_813d5f<br/>
jackson2-api:2.17.0-379.v02de8ec9f64c<br/>
jakarta-activation-api:2.1.3-1<br/>
jakarta-mail-api:2.1.3-1<br/>
javadoc:243.vb_b_503b_b_45537<br/>
javax-activation-api:1.2.0-7<br/>
javax-mail-api:1.6.2-10<br/>
jaxb:2.3.9-1<br/>
jdk-tool:73.vddf737284550<br/>
jersey2-api:2.42-147.va_28a_44603b_d5<br/>
jjwt-api:0.11.5-112.ve82dfb_224b_a_d<br/>
joda-time-api:2.12.7-29.v5a_b_e3a_82269a_<br/>
jquery3-api:3.7.1-2<br/>
jsch:0.2.16-86.v42e010d9484b_<br/>
json-api:20240303-41.v94e11e6de726<br/>
json-path-api:2.9.0-58.v62e3e85b_a_655<br/>
junit:1265.v65b_14fa_f12f0<br/>
locale:495.v4606fdb_134ef<br/>
lockable-resources:1255.vf48745da_35d0<br/>
mailer:472.vf7c289a_4b_420<br/>
material-theme:0.5.2-rc100.6121925fe229<br/>
matrix-auth:3.2.2<br/>
matrix-project:831.v084e85a_b_4ea_d<br/>
maven-plugin:3.23<br/>
metrics:4.2.21-451.vd51df8df52ec<br/>
mina-sshd-api-common:2.12.1-101.v85b_e08b_780dd<br/>
mina-sshd-api-core:2.12.1-101.v85b_e08b_780dd<br/>
monitoring:1.99.0<br/>
okhttp-api:4.11.0-172.vda_da_1feeb_c6e<br/>
pam-auth:1.11<br/>
pipeline-build-step:540.vb_e8849e1a_b_d8<br/>
pipeline-github-lib:61.v629f2cc41d83<br/>
pipeline-graph-analysis:216.vfd8b_ece330ca_<br/>
pipeline-groovy-lib:710.v4b_94b_077a_808<br/>
pipeline-input-step:495.ve9c153f6067b_<br/>
pipeline-milestone-step:119.vdfdc43fc3b_9a_<br/>
pipeline-model-api:2.2198.v41dd8ef6dd56<br/>
pipeline-model-definition:2.2198.v41dd8ef6dd56<br/>
pipeline-model-extensions:2.2198.v41dd8ef6dd56<br/>
pipeline-rest-api:2.34<br/>
pipeline-stage-step:312.v8cd10304c27a_<br/>
pipeline-stage-tags-metadata:2.2198.v41dd8ef6dd56<br/>
pipeline-stage-view:2.34<br/>
pipeline-utility-steps:2.16.2<br/>
plain-credentials:182.v468b_97b_9dcb_8<br/>
plugin-util-api:4.1.0<br/>
prism-api:1.29.0-15<br/>
prometheus:770.ve5e758db_606e<br/>
rebuild:332.va_1ee476d8f6d<br/>
resource-disposer:0.23<br/>
role-strategy:727.vd344b_eec783d<br/>
scm-api:690.vfc8b_54395023<br/>
script-security:1341.va_2819b_414686<br/>
simple-theme-plugin:176.v39740c03a_a_f5<br/>
snakeyaml-api:2.2-111.vc6598e30cc65<br/>
ssh-credentials:337.v395d2403ccd4<br/>
ssh-slaves:2.968.v6f8823c91de4<br/>
sshd:3.322.v159e91f6a_550<br/>
structs:337.v1b_04ea_4df7c8<br/>
theme-manager:215.vc1ff18d67920<br/>
timestamper:1.27<br/>
token-macro:400.v35420b_922dcb_<br/>
trilead-api:2.147.vb_73cc728a_32e<br/>
variant:60.v7290fc0eb_b_cd<br/>
workflow-aggregator:596.v8c21c963d92d<br/>
workflow-api:1316.v33eb_726c50b_a_<br/>
workflow-basic-steps:1058.vcb_fc1e3a_21a_9<br/>
workflow-cps:3894.3896.vca_2c931e7935<br/>
workflow-durable-task-step:1353.v1891a_b_01da_18<br/>
workflow-job:1426.v2ecb_a_a_42fd46<br/>
workflow-multibranch:791.v28fb_f74dfca_e<br/>
workflow-scm-step:427.v4ca_6512e7df1<br/>
workflow-step-api:657.v03b_e8115821b_<br/>
workflow-support:907.v6713a_ed8a_573<br/>
ws-cleanup:0.46