@@ -34,6 +34,8 @@ python birdwatch.py --url www.twitter.com/<profile>
34
34
python birdwatch.py --help
35
35
```
36
36
37
+ Tested on Python 3.10.
38
+
37
39
### Output
38
40
39
41
Birdwatch generates the following in the snapshots folder:
@@ -66,7 +68,7 @@ Assume all data is UTF-8 compliant.
66
68
67
69
These files are what the Twitter exporter should generate (` .js ` file) from the users you are following:
68
70
69
- ``` json
71
+ ```
70
72
window.* = [
71
73
{
72
74
"following": {
@@ -82,7 +84,7 @@ You can rename as json or specify via input flags to parse the file. `window.* =
82
84
83
85
### tweets.json
84
86
85
- ``` json
87
+ ```
86
88
[
87
89
{
88
90
"id": int,
@@ -103,7 +105,7 @@ Invalid string entries will be marked as "NULL".
103
105
104
106
### metadata.json
105
107
106
- ``` json
108
+ ```
107
109
{
108
110
"bio": str,
109
111
"name": str,
@@ -123,13 +125,13 @@ Invalid string entries will be marked as "NULL".
123
125
124
126
* My scraper terminates early?
125
127
126
- It is possible that either your images are taking sometime to load Consider using ` -s ` to adjust load-time.
128
+ It is possible that your images are taking sometime to load, Consider using ` -s ` to adjust load-time.
127
129
Or your scrolling height is too low / too high. Consider using ` --scroll-algorithm ` to adjust the type of algorithm
128
130
Then passing in a value to the algorithm ` --scroll-value ` .
129
131
130
- Help has more information as to what ` --scroll-value ` encodes.
132
+ "--help" has more information as to what ` --scroll-value ` encodes.
131
133
132
- ## Future Updates
134
+ ## Future Updates and Goals
133
135
134
- * Support Running Multiple Sessions to Resume Per-Profile
135
- * Expand Images and Attachments to Archive Images
136
+ * Support Running Multiple Sessions to Resume Per-Profile Fetching
137
+ * Save and Expand Post Attachments
0 commit comments