TechQA.

Question

llama.cpp llama_cublas enabled, but only 75mb/6gb of vram used when running ./main

score 183 · Answer 1 · 2023-10-24T18:03:49.200000

0

Answer

183

Views

llama.cpp llama_cublas enabled, but only 75mb/6gb of vram used when running ./main

183 views Asked by djbritt At 24 October 2023 at 18:03

score 536 · Answer 2 · 2023-10-30T05:36:37.273000

codellama generates newline character repeatedly

536 views Asked by benna121 At 30 October 2023 at 05:36

score 523 · Answer 3 · 2023-10-29T13:37:21.900000

Unexpected Continuous Conversation from LlamaCpp Model in LangChain

523 views Asked by Eren Kalinsazlioglu At 29 October 2023 at 13:37

score 707 · Answer 4 · 2023-11-14T01:05:58.160000

llama-index: multiple calls to query_engine.query always gives "Empty Response"

707 views Asked by Jamie Dixon At 14 November 2023 at 01:05

score 428 · Answer 5 · 2023-11-14T02:07:51.690000

I am trying to Integrate LLAMA-2 Model Locally using nextjs and Node js. getting error Error parsing JSON: Error: spawn UNKNOWN

428 views Asked by Ankit Vashishta At 14 November 2023 at 02:07

score 401 · Answer 6 · 2023-11-18T13:07:17.620000

Converting a TinyStories Llama model to GGUF for llama.cpp

401 views Asked by Ammar Husain At 18 November 2023 at 13:07

score 2192 · Answer 7 · 2023-11-23T06:09:36.613000

No GPU support while running llama-cpp-python inside a docker container

2.1k views Asked by Pratyush At 23 November 2023 at 06:09

score 234 · Answer 8 · 2023-11-28T15:06:44.877000

langchain with llama2 local slow inference

234 views Asked by Muhammad Muneeb Ur Rahman At 28 November 2023 at 15:06

score 606 · Answer 9 · 2023-06-27T18:45:11.017000

Suppress LLamaCpp stats output

606 views Asked by sten At 27 June 2023 at 18:45

score 282 · Answer 10 · 2023-06-30T12:13:41.760000

Deploy app with llama-cpp-python dependency on Vercel

282 views Asked by cbacelar At 30 June 2023 at 12:13

score 570 · Answer 11 · 2023-07-11T20:53:20.467000

How fix 'type=value_error' when loading a wizard-vicuna model to PrivateGPT?

570 views Asked by pol0 At 11 July 2023 at 20:53

score 3672 · Answer 12 · 2023-08-11T10:06:23.597000

Could not load Llama model from path: ./Models/llama-7b.ggmlv3.q2_K.bin. Received error Llama.init() got an unexpected keyword argument 'input'

3.6k views Asked by rahularyansharma At 11 August 2023 at 10:06

score 865 · Answer 13 · 2023-08-09T17:25:03.537000

How to use decapoda-research / llama-7b-hf with fine tuning LoRA in LLaMA.cpp?

865 views Asked by Khoi V At 09 August 2023 at 17:25

score 350 · Answer 14 · 2023-12-22T07:46:13.280000

Persist VectorStoreIndex (LlamaIndex) locally

350 views Asked by 6core At 22 December 2023 at 07:46

score 638 · Answer 15 · 2023-12-26T19:19:04.690000

llama-cpp-python on GPU: Delay between prompt submission and first token generation with longer prompts

638 views Asked by jhthompson12 At 26 December 2023 at 19:19

score 545 · Answer 16 · 2024-01-04T12:28:49.683000

CMAKE in requirements.txt file: Install llama-cpp-python for Mac

545 views Asked by Maxl Gemeinderat At 04 January 2024 at 12:28

score 239 · Answer 17 · 2024-01-12T15:52:00.073000

llama.cpp conversion of finetuned HF ( huggingface ) fails for LLaMA2 - 7B model

239 views Asked by Vikram Murthy At 12 January 2024 at 15:52

score 1698 · Answer 18 · 2024-01-23T16:36:43.087000

Streaming local LLM with FastAPI, Llama.cpp and Langchain

1.6k views Asked by Maxl Gemeinderat At 23 January 2024 at 16:36

score 223 · Answer 19 · 2024-01-29T03:22:53.093000

llama-cpp-python Log printing on Ubuntu

223 views Asked by San Vik At 29 January 2024 at 03:22

score 1389 · Answer 20 · 2024-02-02T12:55:27.620000

ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based project

1.3k views Asked by Kaustubh Ratna At 02 February 2024 at 12:55

TechQA.

List Question

llama.cpp llama_cublas enabled, but only 75mb/6gb of vram used when running ./main

codellama generates newline character repeatedly

Unexpected Continuous Conversation from LlamaCpp Model in LangChain

llama-index: multiple calls to query_engine.query always gives "Empty Response"

I am trying to Integrate LLAMA-2 Model Locally using nextjs and Node js. getting error Error parsing JSON: Error: spawn UNKNOWN

Converting a TinyStories Llama model to GGUF for llama.cpp

No GPU support while running llama-cpp-python inside a docker container

langchain with llama2 local slow inference

Suppress LLamaCpp stats output

Deploy app with llama-cpp-python dependency on Vercel

How fix 'type=value_error' when loading a wizard-vicuna model to PrivateGPT?

Could not load Llama model from path: ./Models/llama-7b.ggmlv3.q2_K.bin. Received error Llama.init() got an unexpected keyword argument 'input'

How to use decapoda-research / llama-7b-hf with fine tuning LoRA in LLaMA.cpp?

Persist VectorStoreIndex (LlamaIndex) locally

llama-cpp-python on GPU: Delay between prompt submission and first token generation with longer prompts

CMAKE in requirements.txt file: Install llama-cpp-python for Mac

llama.cpp conversion of finetuned HF ( huggingface ) fails for LLaMA2 - 7B model

Streaming local LLM with FastAPI, Llama.cpp and Langchain

llama-cpp-python Log printing on Ubuntu

ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based project

Popular Questions

Popular Tags

Trending Questions