We could have AI models in a couple years that hold the entire internet in their context window.

  • Martineski@lemmy.fmhy.mlM
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    We could have AI models in a couple years that hold the entire internet in their context window.

    That’s a really bold claim.

    • Behohippy@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      Also not sure how that would be helpful. If every prompt needs to rip through those tokens first, before predicting a response, it’ll be stupid slow. Even now with llama.cpp, it’s annoying when it pauses to do the context window shuffle thing.

    • InternetPirate@lemmy.fmhy.mlOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      1 year ago

      Perplexity has pretty much solved that since it searches the internet and uses the information it finds. But I don’t know about any advances to solve it directly in LLMs.