-
-
Notifications
You must be signed in to change notification settings - Fork 441
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix XBVR scraper so that it actually works... #1259
Conversation
Actually making it work properly without requiring any GraphQL calls at all. Note: I have no idea if the .zip/gallery part still works, I never used it, and this scraper never worked for me since Stash didn't actually pre-populate the title fields with the file extensions. This fixes that.
This needs some more troubleshooting/testing. |
TL;DR DW about it. As it stands, I don't think the current version of the script works at all. This was I think the smallest change possible to fix that without overhauling it entirely. I should update the .yml... Another user had offered a GraphQL script that was supposed to scrape filenames, but even after fixing my GraphQL issue (XBVR user -> 9999 was occupied -> threw Stash on 1234 and had no idea the scraper was actually querying Stash itself as part of the scrape...) it still returned an I don't know nearly enough about GraphQL, sqlite3, or its Python plugin, or enough Python to test that. But I do know that my little kludge fixes it entirely. XBVR doesn't index any 4 letter file extensions anyways (.webm is the only relevant one I can think of, and from one studio, for videos from many years ago), so If you are going to write something...added Also tried to make it allow choosing between either |
Found it. I believe @Tweeticoats wrote it? It's still searching by ie. if you try to edit the query on line 40 in the c.execute... call from the attached file to use an SQL wildcard to fill in for the extension, you'll run into the same exact problem I did.
there's no need for the GraphQL lookup...using sqlite3 only means the SQL wildcard still works without having to deal with any of the (minimal) overhead or converting the one data type or the other into the "right" one for appending an SQL wildcard, lol |
Hmm. Feet in mouth. Newly added scenes have the extension in the filename, lmao. |
oops
oops. I guess an ISO date is bad
* Adds studio code based on XBVR scene ID * Uses presence of "JAVR" tag to add "JAV" and "Censored" tags * Else adds "Virtual Reality" tag * WIP: Assigns proper Naughty America studios automatically
I'll piggyback onto #1333 |
Actually making it work properly without requiring any GraphQL calls at all.
Note: I have no idea if the .zip/gallery part still works, I never used it, and this scraper never worked for me to begin with since Stash didn't pre-populate the title fields with the file extensions. This fixes that.