Skip to content

andsam/SaLaMa

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

SaLaMa

SaLaMa - Simple Assisted LlAMa Authoring

This is a quick and dirty vibecoded PoC

Allows editing and modifying text while LLM is producing more. If LLM digresses or goes off rails, stop it and restart it after removing / editing the part you didn't like.

Allows changing models 'on the fly' with dropdown selector. If one model is not able to continue the text properly, try another.

For fiction writing, small (7-30Gb) models seem to be good for trying out ideas. Larger (70Gb+) models seem much better with nuances and more coherent plot and not-so-stereotypical character interactions.

Currently needs to be run in an environment with local llama.cpp installation (assumes it's in the same directory).

Might be improved some day, or not. We'll see.

About

Simple Assisted LlAMa Authoring

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages