codeinabox@programming.dev to

AI - Artificial intelligence@programming.devEnglish · 20 days ago

Prompt Caching Doesn't Cache Prompts

0

5

Prompt Caching Doesn't Cache Prompts

codeinabox@programming.dev to

AI - Artificial intelligence@programming.devEnglish · 20 days ago

0

It doesn't cache your prompt. It doesn't cache your tokens either. What it actually caches, and why that changes how you structure every API call.

You must log in or register to comment.

Chat

AI - Artificial intelligence@programming.dev

Aii@programming.dev

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !Aii@programming.dev

AI related news and articles.

Rules:

No Videos.
No self promotion: Don’t post links to your articles.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

8 users / day
169 users / week
368 users / month
1.03K users / 6 months
1 local subscriber
321 subscribers
359 Posts
369 Comments
Modlog