Generative AI example on offline mode

163 views Asked by At

I would like to develop a script in Python (or other) that allows you to use a free AI (like GPT-2 for example) to answer any question.

Preferably I'd like it to be a pre-trained model that works in offline mode.

Would you have a suggestion please?

1

There are 1 answers

0
Ray On

Hugging Face has a leaderboard of many open LLM models, which you can filter according to various features (such as model size: the big ones are going to need some serious hardware to run). That's probably the first place I'd look.