Skip to content

Commit

Permalink
Added tests for metadata collection
Browse files Browse the repository at this point in the history
  • Loading branch information
cellgeni committed Jan 20, 2025
1 parent 41f1977 commit 832b5d5
Show file tree
Hide file tree
Showing 26 changed files with 689 additions and 0 deletions.
33 changes: 33 additions & 0 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
name: Test Collect Metadata Script

on:
push:
branches:
- main
pull_request:

jobs:
test:
runs-on: ubuntu-latest
strategy:
matrix:
include:
- series_id: GSE191067
- series_id: GSE264508
- series_id: GSE274955
- series_id: GSE250130

steps:
- name: Checkout repository
uses: actions/checkout@v3

- name: Set up environment
run: |
sudo apt-get update
sudo apt-get install -y wget perl curl jq
- name: Run metadata collection tests
run: |
chmod +x ./scripts/*
chmod +x ./tests/test_metadata.sh
./tests/test_metadata.sh ${matrix.series_id}
11 changes: 11 additions & 0 deletions test_data/GSE191067/GSE191067.accessions.tsv
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
GSM5738231 SRS11329588 SRX13428615 SRR17249694,SRR17249695,SRR17249696,SRR17249697
GSM5738232 SRS11329589 SRX13428616 SRR17249690,SRR17249691,SRR17249692,SRR17249693
GSM5738233 SRS11329594 SRX13428617 SRR17249684,SRR17249685,SRR17249686,SRR17249687
GSM5738234 SRS11329591 SRX13428618 SRR17249680,SRR17249681,SRR17249682,SRR17249683
GSM5738235 SRS11329599 SRX13428625 SRR17249654,SRR17249655,SRR17249688,SRR17249689
GSM5738236 SRS11329592 SRX13428619 SRR17249676,SRR17249677,SRR17249678,SRR17249679
GSM5738237 SRS11329593 SRX13428620 SRR17249672,SRR17249673,SRR17249674,SRR17249675
GSM5738238 SRS11329597 SRX13428621 SRR17249668,SRR17249669,SRR17249670,SRR17249671
GSM5738239 SRS11329595 SRX13428622 SRR17249664,SRR17249665,SRR17249666,SRR17249667
GSM5738240 SRS11329596 SRX13428623 SRR17249660,SRR17249661,SRR17249662,SRR17249663
GSM5738241 SRS11329598 SRX13428624 SRR17249656,SRR17249657,SRR17249658,SRR17249659
44 changes: 44 additions & 0 deletions test_data/GSE191067/GSE191067.parsed.tsv
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
SRR17249654 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249654/SRR17249654.lite.1 SRA
SRR17249655 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249655/SRR17249655.lite.1 SRA
SRR17249656 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249656/SRR17249656.lite.1 SRA
SRR17249657 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249657/SRR17249657.lite.1 SRA
SRR17249658 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249658/SRR17249658.lite.1 SRA
SRR17249659 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249659/SRR17249659.lite.1 SRA
SRR17249660 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249660/SRR17249660.lite.1 SRA
SRR17249661 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249661/SRR17249661.lite.1 SRA
SRR17249662 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249662/SRR17249662.lite.1 SRA
SRR17249663 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249663/SRR17249663.lite.1 SRA
SRR17249664 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249664/SRR17249664.lite.1 SRA
SRR17249665 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249665/SRR17249665.lite.1 SRA
SRR17249666 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249666/SRR17249666.lite.1 SRA
SRR17249667 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249667/SRR17249667.lite.1 SRA
SRR17249668 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249668/SRR17249668.lite.1 SRA
SRR17249669 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249669/SRR17249669.lite.1 SRA
SRR17249670 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249670/SRR17249670.lite.1 SRA
SRR17249671 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249671/SRR17249671.lite.1 SRA
SRR17249672 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249672/SRR17249672.lite.1 SRA
SRR17249673 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249673/SRR17249673.lite.1 SRA
SRR17249674 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249674/SRR17249674.lite.1 SRA
SRR17249675 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249675/SRR17249675.lite.1 SRA
SRR17249676 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249676/SRR17249676.lite.1 SRA
SRR17249677 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249677/SRR17249677.lite.1 SRA
SRR17249678 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249678/SRR17249678.lite.1 SRA
SRR17249679 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249679/SRR17249679.lite.1 SRA
SRR17249680 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249680/SRR17249680.lite.1 SRA
SRR17249681 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249681/SRR17249681.lite.1 SRA
SRR17249682 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249682/SRR17249682.lite.1 SRA
SRR17249683 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249683/SRR17249683.lite.1 SRA
SRR17249684 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249684/SRR17249684.lite.1 SRA
SRR17249685 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249685/SRR17249685.lite.1 SRA
SRR17249686 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249686/SRR17249686.lite.1 SRA
SRR17249687 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249687/SRR17249687.lite.1 SRA
SRR17249688 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249688/SRR17249688.lite.1 SRA
SRR17249689 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249689/SRR17249689.lite.1 SRA
SRR17249690 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249690/SRR17249690.lite.1 SRA
SRR17249691 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249691/SRR17249691.lite.1 SRA
SRR17249692 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249692/SRR17249692.lite.1 SRA
SRR17249693 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249693/SRR17249693.lite.1 SRA
SRR17249694 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249694/SRR17249694.lite.1 SRA
SRR17249695 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249695/SRR17249695.lite.1 SRA
SRR17249696 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249696/SRR17249696.lite.1 SRA
SRR17249697 Homo sapiens https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249697/SRR17249697.lite.1 SRA
44 changes: 44 additions & 0 deletions test_data/GSE191067/GSE191067.run.list
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
SRR17249654
SRR17249655
SRR17249656
SRR17249657
SRR17249658
SRR17249659
SRR17249660
SRR17249661
SRR17249662
SRR17249663
SRR17249664
SRR17249665
SRR17249666
SRR17249667
SRR17249668
SRR17249669
SRR17249670
SRR17249671
SRR17249672
SRR17249673
SRR17249674
SRR17249675
SRR17249676
SRR17249677
SRR17249678
SRR17249679
SRR17249680
SRR17249681
SRR17249682
SRR17249683
SRR17249684
SRR17249685
SRR17249686
SRR17249687
SRR17249688
SRR17249689
SRR17249690
SRR17249691
SRR17249692
SRR17249693
SRR17249694
SRR17249695
SRR17249696
SRR17249697
11 changes: 11 additions & 0 deletions test_data/GSE191067/GSE191067.sample.list
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
GSM5738231
GSM5738232
GSM5738233
GSM5738234
GSM5738235
GSM5738236
GSM5738237
GSM5738238
GSM5738239
GSM5738240
GSM5738241
11 changes: 11 additions & 0 deletions test_data/GSE191067/GSE191067.sample_x_run.tsv
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
GSM5738231 SRR17249694,SRR17249695,SRR17249696,SRR17249697
GSM5738232 SRR17249690,SRR17249691,SRR17249692,SRR17249693
GSM5738233 SRR17249684,SRR17249685,SRR17249686,SRR17249687
GSM5738234 SRR17249680,SRR17249681,SRR17249682,SRR17249683
GSM5738235 SRR17249654,SRR17249655,SRR17249688,SRR17249689
GSM5738236 SRR17249676,SRR17249677,SRR17249678,SRR17249679
GSM5738237 SRR17249672,SRR17249673,SRR17249674,SRR17249675
GSM5738238 SRR17249668,SRR17249669,SRR17249670,SRR17249671
GSM5738239 SRR17249664,SRR17249665,SRR17249666,SRR17249667
GSM5738240 SRR17249660,SRR17249661,SRR17249662,SRR17249663
GSM5738241 SRR17249656,SRR17249657,SRR17249658,SRR17249659
44 changes: 44 additions & 0 deletions test_data/GSE191067/GSE191067.urls.list
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249654/SRR17249654.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249655/SRR17249655.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249656/SRR17249656.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249657/SRR17249657.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249658/SRR17249658.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249659/SRR17249659.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249660/SRR17249660.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249661/SRR17249661.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249662/SRR17249662.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249663/SRR17249663.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249664/SRR17249664.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249665/SRR17249665.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249666/SRR17249666.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249667/SRR17249667.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249668/SRR17249668.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249669/SRR17249669.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249670/SRR17249670.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249671/SRR17249671.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249672/SRR17249672.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249673/SRR17249673.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249674/SRR17249674.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249675/SRR17249675.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249676/SRR17249676.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249677/SRR17249677.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249678/SRR17249678.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249679/SRR17249679.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249680/SRR17249680.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249681/SRR17249681.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249682/SRR17249682.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249683/SRR17249683.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249684/SRR17249684.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249685/SRR17249685.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249686/SRR17249686.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249687/SRR17249687.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249688/SRR17249688.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249689/SRR17249689.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249690/SRR17249690.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249691/SRR17249691.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249692/SRR17249692.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249693/SRR17249693.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249694/SRR17249694.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249695/SRR17249695.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249696/SRR17249696.lite.1
https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos6/sra-pub-zq-40/SRR017/17249/SRR17249697/SRR17249697.lite.1
28 changes: 28 additions & 0 deletions test_data/GSE250130/GSE250130.accessions.tsv
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
GSM7974277 SRS19844433 SRX22870939 SRR27190826
GSM7974278 SRS19844434 SRX22870940 SRR27190825
GSM7974279 SRS19844445 SRX22870951 SRR27190814
GSM7974280 SRS19844454 SRX22870960 SRR27190805
GSM7974281 SRS19844455 SRX22870961 SRR27190804
GSM7974282 SRS19844456 SRX22870962 SRR27190803
GSM7974283 SRS19844457 SRX22870963 SRR27190802
GSM7974284 SRS19844458 SRX22870964 SRR27190801
GSM7974285 SRS19844459 SRX22870965 SRR27190800
GSM7974286 SRS19844460 SRX22870966 SRR27190799
GSM7974287 SRS19844435 SRX22870941 SRR27190824
GSM7974288 SRS19844436 SRX22870942 SRR27190823
GSM7974289 SRS19844437 SRX22870943 SRR27190822
GSM7974290 SRS19844438 SRX22870944 SRR27190821
GSM7974291 SRS19844439 SRX22870945 SRR27190820
GSM7974292 SRS19844440 SRX22870946 SRR27190819
GSM7974293 SRS19844441 SRX22870947 SRR27190818
GSM7974294 SRS19844442 SRX22870948 SRR27190817
GSM7974295 SRS19844443 SRX22870949 SRR27190816
GSM7974296 SRS19844444 SRX22870950 SRR27190815
GSM7974297 SRS19844446 SRX22870952 SRR27190813
GSM7974298 SRS19844447 SRX22870953 SRR27190812
GSM7974299 SRS19844448 SRX22870954 SRR27190811
GSM7974300 SRS19844449 SRX22870955 SRR27190810
GSM7974301 SRS19844450 SRX22870956 SRR27190809
GSM7974302 SRS19844451 SRX22870957 SRR27190808
GSM7974303 SRS19844452 SRX22870958 SRR27190807
GSM7974304 SRS19844453 SRX22870959 SRR27190806
Loading

0 comments on commit 832b5d5

Please sign in to comment.