Open-source ChatBot on local machine, now a possibility
Thread poster: Philippe Locquet
Philippe Locquet
Philippe Locquet  Identity Verified
Portugal
Local time: 00:30
English to French
+ ...
Jul 20, 2023

It seems the open-source community is hard at work making more and more LLMs alternatives available and improving the quality. It’s not exactly new (some options have been around for a while now. But we are slowly going towards systems that a tech-savvy user will be able to handle (like it’s been the case for Opus-MT which is now user-friendly).

These systems are not user-friendly yet, but a power-user with a last gen high end graphic card (over 1000 USD minimum if new). will b
... See more
It seems the open-source community is hard at work making more and more LLMs alternatives available and improving the quality. It’s not exactly new (some options have been around for a while now. But we are slowly going towards systems that a tech-savvy user will be able to handle (like it’s been the case for Opus-MT which is now user-friendly).

These systems are not user-friendly yet, but a power-user with a last gen high end graphic card (over 1000 USD minimum if new). will be able to run this locally and feed it context. AFAIK these are not able to translate at the moment.

If you’re interested, there’s a very interesting video by Rob Mulla https://www.youtube.com/watch?v=Coj72EzmX20&t=0s
If you’re curious but don’t want to dive into a technical tutorial, I made a short about this, summing things up. https://youtube.com/shorts/udeJe3yevBY?feature=share
Collapse


Mr. Satan (X)
 
Mr. Satan (X)
Mr. Satan (X)
English to Indonesian
Interesting Jul 21, 2023

Thanks. As an open-source software advocate, this sure does interest me. Will watch them videos this weekend.

Also, FYI:
https://www.theregister.com/2023/07/19/meta_llama_2/


Philippe Locquet
 


There is no moderator assigned specifically to this forum.
To report site rules violations or get help, please contact site staff »


Open-source ChatBot on local machine, now a possibility







Trados Studio 2022 Freelance
The leading translation software used by over 270,000 translators.

Designed with your feedback in mind, Trados Studio 2022 delivers an unrivalled, powerful desktop and cloud solution, empowering you to work in the most efficient and cost-effective way.

More info »
TM-Town
Manage your TMs and Terms ... and boost your translation business

Are you ready for something fresh in the industry? TM-Town is a unique new site for you -- the freelance translator -- to store, manage and share translation memories (TMs) and glossaries...and potentially meet new clients on the basis of your prior work.

More info »