Skip to content

Commit

Permalink
Create README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
hz0ne authored Apr 8, 2021
1 parent f23ac24 commit 6124323
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# scrapy_pdf

爬取PDF文件
原本目的是抓取校园网内部服务某个文件夹下的所有PDF文件,但是站方了下架所有PDF-_-

使用方法:
在setting中配置
root_link 为需要爬取PDF的根页面
link_start 为下载PDF的地址头部, https://xxxx/
download_local_dir 本地下载目标文件夹

TODO:
模块化为命令行程序

0 comments on commit 6124323

Please sign in to comment.