Open-source ChatBot on local machine, now a possibility
Thread poster: Philippe Locquet
Philippe Locquet
Philippe Locquet  Identity Verified
Portugal
Local time: 23:19
English to French
+ ...
Jul 20, 2023

It seems the open-source community is hard at work making more and more LLMs alternatives available and improving the quality. It’s not exactly new (some options have been around for a while now. But we are slowly going towards systems that a tech-savvy user will be able to handle (like it’s been the case for Opus-MT which is now user-friendly).

These systems are not user-friendly yet, but a power-user with a last gen high end graphic card (over 1000 USD minimum if new). will b
... See more
It seems the open-source community is hard at work making more and more LLMs alternatives available and improving the quality. It’s not exactly new (some options have been around for a while now. But we are slowly going towards systems that a tech-savvy user will be able to handle (like it’s been the case for Opus-MT which is now user-friendly).

These systems are not user-friendly yet, but a power-user with a last gen high end graphic card (over 1000 USD minimum if new). will be able to run this locally and feed it context. AFAIK these are not able to translate at the moment.

If you’re interested, there’s a very interesting video by Rob Mulla https://www.youtube.com/watch?v=Coj72EzmX20&t=0s
If you’re curious but don’t want to dive into a technical tutorial, I made a short about this, summing things up. https://youtube.com/shorts/udeJe3yevBY?feature=share
Collapse


Mr. Satan (X)
 
Mr. Satan (X)
Mr. Satan (X)
English to Indonesian
Interesting Jul 21, 2023

Thanks. As an open-source software advocate, this sure does interest me. Will watch them videos this weekend.

Also, FYI:
https://www.theregister.com/2023/07/19/meta_llama_2/


Philippe Locquet
 


There is no moderator assigned specifically to this forum.
To report site rules violations or get help, please contact site staff »


Open-source ChatBot on local machine, now a possibility







Anycount & Translation Office 3000
Translation Office 3000

Translation Office 3000 is an advanced accounting tool for freelance translators and small agencies. TO3000 easily and seamlessly integrates with the business life of professional freelance translators.

More info »
Wordfast Pro
Translation Memory Software for Any Platform

Exclusive discount for ProZ.com users! Save over 13% when purchasing Wordfast Pro through ProZ.com. Wordfast is the world's #1 provider of platform-independent Translation Memory software. Consistently ranked the most user-friendly and highest value

Buy now! »