I’m interested in automatically generating lengthy, coherent stories of 10,000+ words from a single prompt using an open source local large language model (LLM) on low-spec hardware like a laptop without GPU and with i5-8250U, 16GB DDR4-2400MHz. I came across the “Awesome-Story-Generation” repository which lists relevant...
The limited context lengths for local LLMs will be a barrier to write 10k words in a single prompt. Approaches to this is to have the LLM have a conversation with itself or other LLMs. There are prompts out there that can simulate this, but you will need to intervene every few hundred words or so. Check out ‘AutoGen’ frameworks that can orchestrate this for you. CrewAI is one of the better ones. hope this helps
I wanted to install jackett and sonarr, they are complicated to use as is, moreover I am using Ubuntu. I am following fuidleine for installing jackett with STUPID command line making it EXTRA difficult. But now I have to change directory ownerships and what nots. I am the ONLY user on this machine. I want to own everything by...
I for one upvoted this post. I am tired of nanny state OSs restricting what we want to do thinking they are protecting the poor user who surely they must classify as noobs. We need a free open LIBERTARIAN OS now.
How can I use a local LLM on Linux to generate a long story?
I’m interested in automatically generating lengthy, coherent stories of 10,000+ words from a single prompt using an open source local large language model (LLM) on low-spec hardware like a laptop without GPU and with i5-8250U, 16GB DDR4-2400MHz. I came across the “Awesome-Story-Generation” repository which lists relevant...
How can i do whatever I want to do ?
I wanted to install jackett and sonarr, they are complicated to use as is, moreover I am using Ubuntu. I am following fuidleine for installing jackett with STUPID command line making it EXTRA difficult. But now I have to change directory ownerships and what nots. I am the ONLY user on this machine. I want to own everything by...
Budget 2024 'likely to be the worst' in decades, former BoC governor says (www.ctvnews.ca)