Search results

I have a question regarding the VRAM requirements for fine-tuning a 7B model.

Status: Open.

#322 In tatsu-lab/stanford_alpaca;

· mangyeong opened on Jan 15, 2025

why dose my finetuned model repeat the given prompt before generating its response

Status: Open.

#320 In tatsu-lab/stanford_alpaca;

· starrlee356 opened on Dec 5, 2024

ValueError: Trying to set a tensor of shape torch.Size([32769536]) in "weight" (which has shape torch.Size([32001, 4096])), this looks incorrect.

Status: Open.

#319 In tatsu-lab/stanford_alpaca;

· daidaiershidi opened on Sep 26, 2024

SFT Mistral；

Status: Open.

#317 In tatsu-lab/stanford_alpaca;

· feiying12343 opened on Jun 6, 2024

RuntimeError: The size of tensor a (65539072) must match the size of tensor b (262156288) at non-singleton dimension 0

Status: Open.

#316 In tatsu-lab/stanford_alpaca;

· YuyangJ0 opened on Apr 16, 2024

Tensors of the same index must be on the same device and the same dtype except <code>step</code> tensors that can be CPU and float32 notwithstanding

Status: Open.

#315 In tatsu-lab/stanford_alpaca;

· wurevvc opened on Mar 18, 2024

train.py fails with TypeError: Object of type Tensor is not JSON serializable

Status: Open.

#314 In tatsu-lab/stanford_alpaca;

· khayamgondal opened on Mar 8, 2024

Keyword arguments {'add_special_tokens': False} not recognized.

Status: Open.

#313 In tatsu-lab/stanford_alpaca;

· cswangxiaowei opened on Mar 2, 2024

Cuda OOM during training

Status: Open.

#308 In tatsu-lab/stanford_alpaca;

· hychaochao opened on Jan 31, 2024

The arugment order of Rouge score might be wrong.

Status: Open.

#307 In tatsu-lab/stanford_alpaca;

· zhaowei-wang-nlp opened on Dec 28, 2023

NotImplementedError: offload_to_cpu=True and NO_SHARD is not supported yet

Status: Open.

#306 In tatsu-lab/stanford_alpaca;

· mechigonft opened on Nov 28, 2023

weight_diff.py state_dict_recovered[key].add_(state_dict_raw[key]) RuntimeError: The size of tensor a (32001) must match the size of tensor b (32000) at non-singleton dimension 0

Status: Open.

#304 In tatsu-lab/stanford_alpaca;

· gaodexiaozheng opened on Nov 22, 2023