Skip to content

Remma-O1: An open-source Language Model with 1.17B Params, built on pytorch from scratch. Work in Progress!!! Open for collaboration.

License

Notifications You must be signed in to change notification settings

OpenVanguard/remma-o1

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

99 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

remma-o1

License Contributions Welcome Release Pending Releases

Overview

remma-o1 is an open-source Small Language Model (SLM) designed for collaboration, and accurate natural language processing. This project aims to empower developers and researchers by providing:

  • Versatile and context-aware AI capabilities.
  • A robust, adaptable foundation for building intelligent systems.
  • Opportunities for community-driven innovation and enhancements.

Key Features

  • Open Source: Built to foster collaboration and innovation.
  • Scalable: Easily adaptable for various NLP tasks and applications.
  • Efficient: Optimized for performance and accuracy.
  • Community-Centric: Encourages contributions to enhance features and usability.
  • Model Size: Model parameters: 1177.79M

Getting Started

Prerequisites

Ensure you have the following installed:

  • Python 3.10 or higher
  • Git

Installation

  1. Clone the repository:

    git clone https://github.com/OpenVanguard/.git
    cd 
  2. Install dependencies:

    pip install -r requirements.txt
  3. Verify installation by running a test script:

    python test_remma.py

Usage

Import the model and start using it in your Python projects:

from openvangaurd import Remma

model = Remma.load()
response = model.generate("What is open source?")
print(response)

Contributing

We welcome contributions to remma-o1! Whether it's reporting bugs, suggesting features, or submitting pull requests, your input helps improve this project. Please see the CONTRIBUTING.md file for guidelines.

Roadmap

  • Fine-Tuning Support: Enable fine-tuning for domain-specific tasks.
  • Multi-Language Support: Expand capabilities to support multiple languages.
  • API Integration: Provide a RESTful API for seamless integration.

License

This project is licensed under the MIT License. See the LICENSE file for details.


For updates and discussions, follow OpenVanguard.

About

Remma-O1: An open-source Language Model with 1.17B Params, built on pytorch from scratch. Work in Progress!!! Open for collaboration.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •