Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

cleanup storage? #742

ctron started this conversation in Ideas
Sep 2, 2024 · 0 comments
Discussion options

On the test instance I noticed an ever increasing use of disk storage, for storing the original, raw documents.

While it needs further investigation, I assume this is partly true to do re-ingesting documents with the same ID. Overwriting existing state, but keeping duplicates in the storage backend. Currently the strategy there is that we don't clean up.

The question is: should be change this strategy? One opinion I read about this, in the context of Mastodon IIRC, was that storage is cheaper than API calls cleaning up storage. On the other side, constantly increasing storage (and cost) just for being lazy also feels wrong.

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Ideas
Labels
None yet
1 participant

AltStyle によって変換されたページ (->オリジナル) /