Skip to content

Conversation

@factory-droid
Copy link

@factory-droid factory-droid bot commented May 1, 2024

Rotor

Summary of Changes

This PR implements the DBRX truss for the Baseten platform. It includes the model.py file with the Model class that loads the DBRX model and runs inference. The requirements.txt file lists the necessary dependencies, and the config.yaml file configures the truss for Python 3.11 and specifies the use of A10G GPUs. The README.md file documents the truss's functionality and usage. This implementation follows the instructions from the DBRX model's original repository and is designed for efficient inference on the Baseten platform.

Fixes BT-10619

Tips

  • If you review this pull request, I will attempt to address your feedback by pushing an update. You may also leave a comment and tag @droid.

@linear
Copy link

linear bot commented May 1, 2024

BT-10619 Create DBRX truss

@factory-droid

This comment has been minimized.

@factory-droid

This comment has been minimized.

@factory-droid
Copy link
Author

factory-droid bot commented May 1, 2024

Important

Solutions for GitHub Action Failures - 17f9d35 - 3

Droid deploy truss

The error you're encountering is due to an invalid or incorrect API key. Please follow these steps to resolve the issue:

  1. Navigate to your GitHub repository settings.
  2. Select 'Secrets' from the left sidebar.
  3. Find the 'BASETEN_API_KEY' secret and click on 'Update'.
  4. Enter the correct API key and click on 'Save changes'.

After updating the API key, re-run the GitHub Actions workflow. If the API key is correct, the workflow should run successfully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants