Skip to content

100% Offline ChatGPT Alternative?



In this video I show I was able to install an open source Large Language Model (LLM) called h2oGPT on my local computer for …

26 thoughts on “100% Offline ChatGPT Alternative?”

  1. I agree with you on the llm’s… eventually you will probably even have certifications… like ai solutions engineer… different flavors or llm’s just like the different flavors of Linux… Every small to medium company will want their own private ai setup when they see the benefits.

  2. GPTs store popular recommendations:
    1. The magical GPT "Story King" allows children to interact with stories. When children listen to stories, they are both listeners and story creators, stimulating children's imagination and creativity.Parents with children must check it out.
    2. GPT "TOP NEWS ”, According to your needs, it is so convenient to grasp the real-time headlines and hot events around the world!
    3. GPT“1 To 1 Foreign Teacher”your best foreign language teacher!

  3. Sounds interesting. Installation for Linux assumes a .deb apt package manager. It also seems to have a dependency on X11. If it ever comes out as an appimage self-executable linux package, I may come back to explore it further. I also could not install the older torch 2.1.2. The current version is 2.2.0 and I could not find an archive to find an older version.

  4. Has anyone got the UI to work without the one click installer?
    I get the model to run but If I enter the commands that you show to run it with the UI I get and missing library error.
    Is there a step missing or is the repo missing something?

  5. Excuse me, I am new to this field and may have limited knowledge. Could you kindly inform me which software or program the terminal was opened in? Are there any that are commonly used to operate a terminal? Your expertise would be greatly appreciated.

  6. Hi. Nice job, and thanks for sharing it! i´m having trouble while working in local mode. The Chatbot works perfectly, even when ißm disconnected from the internet. the problem is that i cannot drag any documents to make my model work on this data. Any help please? i´m currantly testing it with a CPU model on windows (i know it´ll be slow, but it is initially for tests purpose).

  7. We have the problem that we need results in foreign languages. When doing this the results of the ai models are getting worse. Is there a practical solution for this problem?

Comments are closed.