- Fork https://github.com/chaoss/augur
- Clone your fork. We recommend creating a
githubdirectory in your user's base directory.
- Install NodeJS (Optional if only running the backend)
sudo apt updateandsudo apt install nodejs - Install NPM (Optional if only running the backend)
sudo apt install npm - Install nvm (node version manager: recommended)
sudo apt install curlandcurl https://raw.githubusercontent.com/creationix/nvm/master/install.sh | bash - Install vue.js (Optional if only running the backend)
- Install vue-cli (Optional if only running the backend)
- Obtain a GitHub Access Token: https://github.com/settings/tokens
- Obtain a GitLab Access Token: https://gitlab.com/-/profile/personal_access_tokens
- Python3 needs to be installed, and typically is by default on most systems.
- There are some Git configuration parameters that help when you are cloning repos over time, and a platform prompts you for credentials when it finds a repo is deleted:
git config --global diff.renames true
git config --global diff.renameLimit 200000
git config --global credential.helper cache
git config --global credential.helper 'cache --timeout=9999999999999'- Make sure all of your core libraries are installed at the operating system level. Often, these days, they are by default, and its important to make sure:
sudo apt update
sudo apt upgrade
sudo apt install software-properties-common
sudo apt install python3-dev
sudo apt install postgresql postgresql-contrib postgresql-client
sudo apt install build-essential- If you are running on Ubuntu 22.x right now, you will need to install python 3.9
sudo add-apt-repository ppa:deadsnakes/ppasudo apt install python3.9sudo apt install python3.9-distutils
- Install pip:
sudo apt install python3-pipandsudo apt install python3.9-venv
- Make sure docker, and docker-compose are both installed
- Modify the
environment.txtfile in the root of the repository to include your GitHub and GitLab API keys. - If you are already running postgresql on your server you have two choices:
- Change the port mappings in the
docker-compose.ymlfile to match ports for Postgresql not currently in use. - Change to variables in
environment.txtto include the correct values for your local, non-docker-container database.
- Change the port mappings in the
sudo docker build -t augur-new -f docker/backend/Dockerfile .sudo docker-compose --env-file ./environment.txt --file docker-compose.yml upto run the database in a Docker Container orsudo docker-compose --env-file ./environment.txt --file docker-compose.yml upto connect to an already running database.
- Follow the installation instructions for the database here: https://oss-augur.readthedocs.io/en/main/quick-start.html#postgresql-installation
- Clone Augur, or clone your fork of Augur if you wish to make contributions
- Install
redis-serverat the operating system levelsudo apt install redis-server - Make sure you have
Goversion is 1.19.3. If you don't know how to installGo, instructions are provided during the installation process. After following the instructions, you will need to add Go to your path for this session:export PATH=$PATH:/usr/local/go/bin. You should also add this to your shell's profile script. - Create a Python Virtual Environment
python3 -m venv ~/virtual-env-directory(usepython3.9 -m venvif on Ubuntu 22.04, as it defaults to python 3.10, which will not compile the machine learning workers.) - Activate your Python Virtual Environment
source ~/virtual-env-directory/bin/activate - From the root of the Augur Directory, type
make install - You will be prompted to provide your GitHub username and password, your GitLab username and password, and the postgresql database where you want to have the Augur Schema built. You will also be prompted to provide a directory where repositories will be clone into.
- To access command line options, use
augur --help. To load repos from GitHub organizations prior to collection, or in other ways, the direct route isaugur db --help. - Start a Flower Dashboard, which you can use to monitor progress, and report any failed processes as issues on the Augur GitHub site. The error rate for tasks is currently 0.04%, and most errors involve unhandled platform API timeouts. We continue to identify and add fixes to handle these errors through additional retries. Starting Flower:
(nohup celery -A augur.tasks.init.celery_app.celery_app flower --port=8400 --max-tasks=1000000 &)NOTE: You can use any open port on your server, and access the dashboard in a browser with http://servername-or-ip:8400 in the example above (assuming you have access to that port, and its open on your network.) - Start Augur:
(nohup augur backend start &) - When data collection is complete you will see only a single task running in your flower Dashboard.
- You can stop augur with
augur backend stop, followed byaugur backend kill. We recommend waiting 5 minutes between commands so Augur can shutdown more gently. There is no issue with data integrity if you issue them seconds apart, its just that stopping is nicer than killing. - If you wish to run the frontend, create a file called
frontend/frontend.config.json following this structure, with relevant values: (Default port is 5000. This can be changed in theaugur_operations.configtable.). Then runnpm installandnpm run buildin the frontend directory.npm run serve will make a development server (usually on your local machine)version of the frontend available. If you wish to run Augur's frontend through nginx, you can follow these instructions here: https://oss-augur.readthedocs.io/en/augur-new/deployment/nginx-configuration.html?highlight=nginx#nginx and here: https://oss-augur.readthedocs.io/en/augur-new/deployment/nginx-configuration.html?highlight=nginx#site-configuration NOTE:"host": "your resolvable server"{ "Frontend": { "host": "chaoss.tv", "port": 5000, "ssl": false }, "Server": { "cache_expire": "3600", "host": "0.0.0.0", "port": 5000, "workers": 6, "timeout": 6000, "ssl": false, "ssl_cert_file": null, "ssl_key_file": null } } - If you have frontend configuration issues that result in a failure to complete steps with npm, we recommend you install and use
nvm: https://tecadmin.net/how-to-install-nvm-on-ubuntu-20-04/ to set your nodejs release to the latest LTS of 12.x or 16.x. For example:nvm ls-remote | grep -i 'latest'andnvm alias default 16.??(whatever the latest version of 16 is.) - Also, please explore our new frontend, being developed at https://github.com/augurlabs/augur_view. The
devbranch is the most current.