Skip to content
@foundation-model-stack

Foundation Model Stack

IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Pinned Loading

  1. foundation-model-stack foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    Python 207 81

  2. fms-fsdp fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    Python 258 42

  3. fms-hf-tuning fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    Python 47 63

  4. fms-acceleration fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    Python 11 18

  5. fms-guardrails-orchestrator fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    Rust 21 35

  6. bamba bamba Public

    Train, tune, and infer Bamba model

    Python 131 14

Repositories

Showing 10 of 27 repositories
  • multi-nic-cni Public
    foundation-model-stack/multi-nic-cni’s past year of commit activity
    Go 38 Apache-2.0 8 13 3 Updated Aug 7, 2025
  • fms-model-optimizer Public

    FMS Model Optimizer is a framework for developing reduced precision neural network models.

    foundation-model-stack/fms-model-optimizer’s past year of commit activity
    Python 20 Apache-2.0 14 14 (1 issue needs help) 7 Updated Aug 6, 2025
  • foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    foundation-model-stack/foundation-model-stack’s past year of commit activity
    Python 207 Apache-2.0 81 41 (4 issues need help) 51 Updated Aug 6, 2025
  • aiu-fms-testing-utils Public

    Tests/Scripts for use with foundation-model-stack models running on AIU

    foundation-model-stack/aiu-fms-testing-utils’s past year of commit activity
    Python 4 Apache-2.0 22 0 27 Updated Aug 6, 2025
  • fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    foundation-model-stack/fms-hf-tuning’s past year of commit activity
    Python 47 Apache-2.0 63 20 (2 issues need help) 20 Updated Aug 6, 2025
  • vllm-triton-backend Public

    A Triton-only attention backend for vLLM

    foundation-model-stack/vllm-triton-backend’s past year of commit activity
    Python 10 Apache-2.0 7 0 0 Updated Aug 5, 2025
  • fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    foundation-model-stack/fms-guardrails-orchestrator’s past year of commit activity
    Rust 21 Apache-2.0 35 28 (2 issues need help) 3 Updated Jul 31, 2025
  • fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    foundation-model-stack/fms-fsdp’s past year of commit activity
    Python 258 Apache-2.0 42 23 10 Updated Jul 24, 2025
  • vllm-detector-adapter Public

    Tiny adapter that runs on top of vllm and provides detector APIs

    foundation-model-stack/vllm-detector-adapter’s past year of commit activity
    Python 4 Apache-2.0 7 9 4 Updated Jul 24, 2025
  • ocp-efa-operator Public

    Operator that enables EFA and/or GDRCOPY in an OpenShift cluster

    foundation-model-stack/ocp-efa-operator’s past year of commit activity
    Go 1 Apache-2.0 0 0 0 Updated Jul 22, 2025
View all repositories

Most used topics

python pytorch