@Fingerthief@infosec.pub
@Fingerthief@infosec.pub avatar

Fingerthief

@Fingerthief@infosec.pub

Web Dev Person / Ex Performance ECU Calibrations Person

This profile is from a federated server and may be incomplete. Browse more on the original instance.

Fingerthief,
@Fingerthief@infosec.pub avatar

Web search is definitely something I want to add, haven’t quite figured out the route I want to take implementing it just yet though.

Hopefully I can get it added sooner rather than later!

Fingerthief,
@Fingerthief@infosec.pub avatar

Thanks!

Unfortunately currently there isn’t a true RAG implementation largely due to the fact that this site/app is fully self contained with no additional servers or database etc…which is typically required for RAG.

For now file uploads are stored in the browser’s own local database and the content can be extracted and added to the current conversation context easily.

I definitely want to add a more full RAG system but it’s a process to say the least, and if I implement it I want it to be quite effective. My experience with RAG generally has left me quite unimpressed with a few quite decent implementations being the exception.

Fingerthief, (edited )
@Fingerthief@infosec.pub avatar

I’m not sure I understand at all?

It’s fully open source, can run/connect any number of fully local models as well as the big name models if a user chooses to use them.

Can you expand on what you mean?

Fingerthief,
@Fingerthief@infosec.pub avatar

Ahh, I see lol

Fingerthief,
@Fingerthief@infosec.pub avatar

That seems like a pretty naive and biased approach to software to me honestly.

Ease of use, community support, feature set, CI/CD etc…all should come into play when deciding what to use.

Freedom at all costs is great until you limit the community development and potential user base by 90% by using a completely open repo service that 5% of the population uses or some small discord alternative.

So then the option is to host on multiple platforms/communities and the management and time investment goes up keeping them in sync and active.

As with most things in life, it’s best to look at things with nuance rather than a hard stance imo.

I may stand it up on another service at some point, but also anyone else is totally free to do that as well. There are no restrictions.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • fightinggames
  • All magazines