Commit db4edea
1 parent b777bd6 commit db4edea
File tree
301 files changed
+556832
-523784
lines changed- benchmarks
- cpp
- python
- cpp
- cmake/utils
- include/tensorrt_llm
- batch_manager
- common
- executor
- runtime
- tensorrt_llm
- batch_manager
- aarch64-linux-gnu
- x86_64-linux-gnu
- x86_64-windows-msvc
- common
- executor
- aarch64-linux-gnu
- x86_64-linux-gnu
- x86_64-windows-msvc
- executor_worker
- kernels
- contextFusedMultiHeadAttention/cubin
- cutlass_kernels
- moe_gemm
- decoderMaskedMultiheadAttention
- decoderXQAImplJIT/nvrtcWrapper
- aarch64-linux-gnu
- x86_64-windows-msvc
- instantiation
- mixtureOfExperts
- speculativeDecoding
- weightOnlyBatchedGemv
- layers
- plugins
- gemmPlugin
- gptAttentionCommon
- gptAttentionPlugin
- layernormQuantizationPlugin
- lookupPlugin
- ncclPlugin
- quantizePerTokenPlugin
- quantizeTensorPlugin
- rmsnormQuantizationPlugin
- smoothQuantGemmPlugin
- pybind
- batch_manager
- runtime
- thop
- tests
- common
- kernels
- allReduce
- fp8Gemm
- sampling
- layers
- resources
- data
- scripts
- runtime
- docs/source
- installation
- performance
- examples
- baichuan
- bloom
- chatglm
- dbrx
- enc_dec
- falcon
- gemma
- gpt
- gptj
- gptneox
- grok
- high-level-api
- internlm
- llama
- mamba
- medusa
- mixtral
- model_api
- mpt
- nemotron
- opt
- phi
- quantization
- qwen
- qwenvl
- recurrentgemma
- skywork
- smaug
- whisper
- scripts
- tensorrt_llm
- auto_parallel
- commands
- hlapi
- layers
- models
- dbrx
- enc_dec
- llama
- mpt
- phi3
- plugin
- quantization
- runtime
- tests
- bindings
- functional
- hlapi
- model
- model_api
- quantization
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
301 files changed
+556832
-523784
lines changedOriginal file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
159 | 159 |
| |
160 | 160 |
| |
161 | 161 |
| |
162 |
| - | |
| 162 | + | |
163 | 163 |
| |
164 | 164 |
| |
165 | 165 |
| |
|
Large diffs are not rendered by default.
0 commit comments