05.02.23

[nniiicc]

Next steps

1. We currently have three steps to obtain data

• UW-Srape (which retrieves users by scraping profile info)
• UW-Query-Repos (searches for repos that are NOT forked, and have >0 count for stars, watchers, or forks)
• GH-API-UW-readme query (using EAGER scripts)

We should consider all of these to be relatively passive, or distanced data collection

We need to design a survey for more "active" data collection

• needs to be simple - Demo and Software info minimally
• • One way to help this would be to have a place in the survey that allows a user to retrieve a list of their repositories by searching GH by their username - they could then select relevant repos to add to the list.

[tinanowak]

Conditions for grabbing repository metadata using api url

• software produced at UW
• that is original and has collaborators

if fork == FALSE OR star > 0 OR watch > 0 OR forks_count > 0

Search string for finding public repositories associated with a known username
https://github.com/search?q=user%3Atinanowak&type=Repositories

[tinanowak]

Troubleshooting EAGER scripts:

So I tried to run the README search script, but I immediately got error messages HTTP Error 403: rate limit exceeded and HTTP Error 401: Unauthorized.

I have an .env folder storing my personal access token in the root directory that I am running the get_repositories.py script from. I thought storing the token in the .env folder would help avoid rate limiting. Maybe my token isn't legit enough?

The root directory also contains the venv that I am running the script in. Should the .env folder be inside the venv?

[nniiicc]

Three things to check:

1. Is your API key valid?
2. Double check how your env is declaring your API key
3. If all else fails - just declare it in with the token argument from the GhAPI library

[nniiicc]

Right now the token argument is set to args.token=None so the code attempts to load the token from a .env file (which is where this might be failing

[nniiicc]

Alternatively to authenticate you could just

# Replace `your_api_key_here` with your actual API key
api_key = "your_api_key_here"
api = GhApi(token=api_key)