• 25 Posts
  • 71 Comments
Joined 1 year ago
cake
Cake day: August 9th, 2023

help-circle


  • will_a113@lemmy.mltoAI@lemmy.mlDo I understand LLMs?
    link
    fedilink
    English
    arrow-up
    15
    ·
    2 months ago

    The critical thing to remember about LLMs is that they are probabilistic in nature. They don’t know facts, they don’t reason, they don’t evaluate. All they do is take your input string, split that string into tokens that are about 3-4 characters long, and then go back into their vast, vast, pretrained database and say “I have this series of tokens. In the past when similar sets of tokens were given, what were the tokens that were most likely to be associated with them?” It will then construct the output string one token at-a-time (more sophisticated models can do multiple tokens at once so that words, phrases and sentences might hang together better) until the output is complete (the probability of the next token being relevant drops below some threshold value) or your output limit is reached.






  • will_a113@lemmy.mltoSelfhosted@lemmy.worldPower outage worries
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    2
    ·
    2 months ago

    As others have said, changing UPS batteries is required maintenance, and I agree 18-24 months is the typical service life for even high-end UPSs. However, you may want to look into LiFePO4 based UPSs, which can handle many more charge-discharge cycles and often have 5-year warranties. More expensive and potentially not as recyclable as lead acid batteries, but maybe appropriate for your use case.






  • Putting aside why you’d want to do this, it’d be pretty easy, actually. You’d still use a big model like GPT4 or Claude as your “base” but you would do two things:

    • Give it a knowledge base using your conversatons. You can manually vectorize them into a key-value database like Pinecone and build yourself an agent using a toolchain like Langchain, or just use a service (OpenAI Agents lets you upload data from your browser)
    • Have one of the big LLMs (with a large context size) ingest all of those conversations and build out a prompt that describes “you”

    you would then

    • Feed that generated prompt (with your own edits, of course) back into either your custom Langchain agent or OpenAI Agent


  • This is a good, short read. For those who are unfamiliar with the AGPL license that the author proposes we all start using, the main difference (and I am not a lawyer) is that under the AGPL, the source code including any modifications must also be made available to all users interacting with the software over a network. This prevents companies from making proprietary versions of AGPL software that are only accessible as a web service, which is one of the big ways that corporations are able to profit from GPL source code contributions these days.









  • will_a113@lemmy.mltoComics@lemmy.ml*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    13
    ·
    7 months ago

    I bought one of these when the Amazon meme first got big. It has become a family tradition to try to hide it in somebody’s drawer/under a pillow/etc and claim that it was the power of the wolves. And then wait for it to make its way back….

    My family’s spread out. Ours are well-traveled wolves.


  • will_a113@lemmy.mltoComics@lemmy.ml*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    61
    arrow-down
    10
    ·
    7 months ago

    This is why AI-created content will win the day. No complicated moral or ethical quandaries to navigate. Oh, except electricity usage. And copyright issues. And diminishing the value of human art and artists. And the possibility of skynet ending humanity.

    Looks like it’s back to scratching rough drawings into the dirt for me…