swiftywizard@discuss.tchncs.de to Programmer Humor@programming.dev · edit-223 days agoLavalamp too hotdiscuss.tchncs.deimagemessage-square76fedilinkarrow-up1497
arrow-up1497imageLavalamp too hotdiscuss.tchncs.deswiftywizard@discuss.tchncs.de to Programmer Humor@programming.dev · edit-223 days agomessage-square76fedilink
minus-squareFishFace@piefed.sociallinkfedilinkEnglisharrow-up1·21 days agoThere is something wrong if it’s not discarding old context to make room for new
minus-squarebunchberry@lemmy.worldlinkfedilinkarrow-up1·20 days agoAt least llama.cpp doesn’t seem to do that by default. If it overruns the context window it just blorps.
minus-squareFishFace@piefed.sociallinkfedilinkEnglisharrow-up1·20 days agoI think there are parameters for that, from googling.
There is something wrong if it’s not discarding old context to make room for new
At least llama.cpp doesn’t seem to do that by default. If it overruns the context window it just blorps.
I think there are parameters for that, from googling.