Repository navigation
Expand file tree
/
Copy path.gitignore
More file actions
86 lines (75 loc) · 2.96 KB
/
Copy path.gitignore
File metadata and controls
86 lines (75 loc) · 2.96 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
# Everything below is GENERATED by running this project. None of it belongs in
# git — it is either large, machine-specific, or a snapshot of a site that will
# have changed by the time anyone reads it. A single 3-page run drops
# ~5 MB of HTML snapshots alone.
# --- scrape output -------------------------------------------------------
*.json
*.csv
!package.json
# Committed on purpose: a real 5-row excerpt of a real run, so a reader can see
# the exact output shape without installing anything.
!sample_output.json
!sample_output.csv
wellfound_jobs.*
wellfound_jobs_*.*
# --- the live-test harness's working directory ---------------------------
live_results/
live_results.zip
# --- debug artifacts the engines drop next to themselves -----------------
# Written on purpose when a page yields nothing or comes back blocked, and by
# --dump-html on success too. Large, and stale within hours.
*_debug.html
*_debug.png
*.html.page*
# `--dump-html PATH --pages N` writes PATH.pageN whatever PATH ends in, so
# `snap.json.page2` and `out.page3` are dumps too.
*.page[0-9]*
# Root-level HTML is a dump or a capture; the tracked landing page is listed
# by name below and is unaffected (ignoring a tracked file changes nothing).
/*.html
# --- captures kept for parser work ---------------------------------------
# The smoke suite's fixtures are committed (trimmed, inside smoke_test.py);
# the multi-megabyte originals they were cut from are not.
captures/
live/
# --- the landing page and the proxy list ---------------------------------
# Both live outside the repo on purpose: the landing page is published
# elsewhere, and a downloaded 2captcha proxy list is a credential file.
index.html
proxylist.txt
# --- caches --------------------------------------------------------------
__pycache__/
*.py[cod]
.pytest_cache/
.fingerprint_cache/
# --- packaging build artifacts --------------------------------------------
*.egg-info/
dist/
build/
# --- environments --------------------------------------------------------
.venv/
venv/
env/
# --- editors / OS --------------------------------------------------------
.DS_Store
*.swp
.idea/
.vscode/
# --- never, under any circumstances --------------------------------------
# The scrapers mask user:pass in their own logs, but raw HTML dumps and the
# Scraper API's x-debug header are NOT masked, and a key pasted into a shell
# history file is not masked either.
*.log
.env
*.key
secrets*
# Any .env variant, however it was renamed. `.env` alone is not enough, and
# this has cost the family twice: craigslist-scraper's own .gitignore records
# a `.env.hold` made while testing that was committed WITH A LIVE KEY in it,
# recoverable only because that repo was private at the time. On 2026-09-17
# a sibling had an untracked `.env.bak` holding a 32-hex key in a PUBLIC
# repository, one `git add -A` from publication. Craigslist was fixed then
# and the fix never reached anyone else, which is the rule unapplied: when
# you fix one, check the siblings.
.env*
!.env.example