• 3 Posts
  • 8 Comments
Joined 1 year ago
cake
Cake day: June 12th, 2023

help-circle

  • inspxtr@lemmy.worldtoSelfhosted@lemmy.worldForgejo v1.21 is available
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    11 months ago

    yeah I guess maybe the formatting and the verbosity seems a bit annoying? Wonder what the alternatives solution could be to better engage people from mastodon, which is what this bot is trying to address.

    edit: just to be clear, I’m not affiliated with the bot or its creator. This is just my observation from multiple posts I see this bot comments on.



  • Thanks for the suggestions! I’m actually also looking into llamaindex for more conceptual comparison, though didn’t get to building an app yet.

    Any general suggestions for locally hosted LLM with llamaindex by the way? I’m also running into some issues with hallucination. I’m using Ollama with llama2-13b and bge-large-en-v1.5 embedding model.

    Anyway, aside from conceptual comparison, I’m also looking for more literal comparison, AFAIK, the choice of embedding model will affect how the similarity will be defined. Most of the current LLM embedding models are usually abstract and the similarity will be conceptual, like “I have 3 large dogs” and “There are three canine that I own” will probably be very similar. Do you know which choice of embedding model I should choose to have it more literal comparison?

    That aside, like you indicated, there are some issues. One of it involves length. I hope to find something that can build up to find similar paragraphs iteratively from similar sentences. I can take a stab at coding it up but was just wondering if there are some similar frameworks out there already that I can model after.



  • Here are some options:

    • crypt.ee: I tried this before, I don’t think it’s selfhostable but quite usable, and nice UI. Encryption available. Ghost folders if you want to. Multimedia available, not sure about storage
    • joplin: you can use Nextcloud (or many other options like Dropbox) for sync and hence storage depends on your cloud solution. E2EE, has plugins, and simple enough to use.
    • anytype.io and logseq: I’ve seen these mention in many places but I haven’t used either. But they seem to have very rich features, not sure about selfhosting though.