TechQA.

Question

Inconsistent completion for identical prompts and params with llama.cpp python and ctransformer

score 90 · Answer 1 · 2024-02-18T11:29:34.827000

0

Answer

90

Views

Inconsistent completion for identical prompts and params with llama.cpp python and ctransformer

90 views Asked by JayabalanAaron At 18 February 2024 at 11:29

score 136 · Answer 2 · 2023-12-13T15:29:18.697000

load LLama 2 on cpu

136 views Asked by yalicohen At 13 December 2023 at 15:29

score 6529 · Answer 3 · 2023-12-09T03:18:51.023000

How to run any gguf model using transformers or any other library

6.5k views Asked by DevEnma At 09 December 2023 at 03:18

score 124 · Answer 4 · 2023-12-02T02:48:26.553000

/usr/local/lib/python3.11/site-packages/ctransformers/lib/basic/libctransformers.so: cannot open shared object file: No such file or directory

124 views Asked by sunny1110 At 02 December 2023 at 02:48

score 2088 · Answer 5 · 2023-11-29T11:39:46.570000

Number of tokens exceeded maximum limit

2k views Asked by merkle At 29 November 2023 at 11:39

score 531 · Answer 6 · 2023-11-28T08:53:01.240000

Failed to create LLM 'stablelm' GGUF ctransformers Google Colab

531 views Asked by Jooo21 At 28 November 2023 at 08:53

score 344 · Answer 7 · 2023-11-19T15:56:41.697000

Unable to load Llama 2 (7b) model in Docker container

344 views Asked by Atinesh At 19 November 2023 at 15:56

score 359 · Answer 8 · 2023-11-14T03:07:58.300000

ctransformers module is not installed error in text-generation-webui

359 views Asked by Ko Win Htike At 14 November 2023 at 03:07

score 305 · Answer 9 · 2023-11-06T23:59:16.553000

creating llm instance from pretrained weights using ctransformers

305 views Asked by user3476463 At 06 November 2023 at 23:59

score 2176 · Answer 10 · 2023-11-03T12:14:30.383000

Cant load "TheBloke/Mistral-7B-v0.1-GGUF" model on GPU

2.1k views Asked by Katerina At 03 November 2023 at 12:14

TechQA.

List Question

Inconsistent completion for identical prompts and params with llama.cpp python and ctransformer

load LLama 2 on cpu

How to run any gguf model using transformers or any other library

/usr/local/lib/python3.11/site-packages/ctransformers/lib/basic/libctransformers.so: cannot open shared object file: No such file or directory

Number of tokens exceeded maximum limit

Failed to create LLM 'stablelm' GGUF ctransformers Google Colab

Unable to load Llama 2 (7b) model in Docker container

ctransformers module is not installed error in text-generation-webui

creating llm instance from pretrained weights using ctransformers

Cant load "TheBloke/Mistral-7B-v0.1-GGUF" model on GPU

Popular Questions

Popular Tags

Trending Questions