Codeberg-e.V./requests
55
63
Fork
You've already forked requests
10

[REPOS] releases download attachment limit 100 MB exceeded #129

Open
opened 2023年12月31日 01:15:24 +01:00 by sciss · 14 comments
Member
Copy link

Hi. I'm having trouble attaching binary builds to my project: https://codeberg.org/sciss/Mellite-launcher/releases

The current interface rejects uploads greater than 100 MB. However, you can see that for the old tag 0.1.4 (which I want to delete once the uploads for 1.0.1 are complete) has actually a file greater than 100 MB, which seems was possible due to GitHub migration. Now the binaries are bundles with OpenJDK, and they easily exceed 100 MB depending on the compression and platform (.deb file being the biggest because worse compression than .zip).

Please increase the limit of releases attachment files to 200 MB.

Hi. I'm having trouble attaching binary builds to my project: https://codeberg.org/sciss/Mellite-launcher/releases The current interface rejects uploads greater than 100 MB. However, you can see that for the old tag 0.1.4 (which I want to delete once the uploads for 1.0.1 are complete) has actually a file greater than 100 MB, which seems was possible due to GitHub migration. Now the binaries are bundles with OpenJDK, and they easily exceed 100 MB depending on the compression and platform (.deb file being the biggest because worse compression than .zip). Please increase the limit of releases attachment files to 200 MB.
Owner
Copy link

This touches upon technical limitations. The file size limit can only be configured globally. Increasing it will be considered, however it will affect all other users and potentially (inevitably) leads to more abuse.

I think we either need per-user-quotas or better moderation tooling. Ideally both.

This touches upon technical limitations. The file size limit can only be configured globally. Increasing it will be considered, however it will affect all other users and potentially (inevitably) leads to more abuse. I think we either need per-user-quotas or better moderation tooling. Ideally both.
Member
Copy link

@fnetX I also share the opinion on 100MB being already a large value for release assets. In the end, git hosters are no file hosters (even though the "packages" option is questioning this a bit) and one could argue that everything beyond is better stored in a dedicated remote file storage.

FWIW GitHub also has a 100MB limit and everything beyond goes into git-lfs. But this is again a different topic.

@sciss Is the request still of interest? I see the last commit was around the time of this request.

@fnetX I also share the opinion on 100MB being already a large value for release assets. In the end, git hosters are no file hosters (even though the "packages" option is questioning this a bit) and one could argue that everything beyond is better stored in a dedicated remote file storage. FWIW [GitHub also has a 100MB limit](https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-large-files-on-github#file-size-limits) and everything beyond goes into `git-lfs`. But this is again a different topic. @sciss Is the request still of interest? I see the last commit was around the time of this request.
Owner
Copy link

The request is for release attachments, not for storing data in Git itself.

Raising the limits kinda requires having proper quota to prevent abuse and people uploading their s* without thinking twice.

The request is for release attachments, not for storing data in Git itself. Raising the limits kinda requires having proper quota to prevent abuse and people uploading their s* without thinking twice.
Member
Copy link

The request is for release attachments, not for storing data in Git itself.

I understood that.

Still, such large release attachments (which sum up to 300MB+ for every release) are better hosted externally, no matter if running on CB or other git hosters?

I am aware that this request is not trying to abuse anything, and while it would be great to store such (large) release assets alongside the release directly, I'd personally argue that users should be encouraged to store such large assets externally (and outsource the (long term) storage burden).

> The request is for release attachments, not for storing data in Git itself. I understood that. Still, such large release attachments (which sum up to 300MB+ for every release) are better hosted externally, no matter if running on CB or other git hosters? I am aware that this request is not trying to abuse anything, and while it would be great to store such (large) release assets alongside the release directly, I'd personally argue that users should be encouraged to store such large assets externally (and outsource the (long term) storage burden).

Sorry to revive this topic but our GodotSteam project has release files that creep over 100mb; the worst offender being the macOS ones or templates zips. While I'm not expecting Codeberg to raise this limit, is anyone aware of a good file storage solution that can be linked into the release section?

Sorry to revive this topic but our GodotSteam project has release files that creep over 100mb; the worst offender being the macOS ones or templates zips. While I'm not expecting Codeberg to raise this limit, is anyone aware of a good file storage solution that can be linked into the release section?
Member
Copy link

Use S3 and link to a dir which reflects the assets of your release tag

Use S3 and link to a dir which reflects the assets of your release tag

Ah, I was hoping to avoid US-based hosting; especially things like Amazon. Thanks for the suggestion though, I will keep hunting!

Ah, I was hoping to avoid US-based hosting; especially things like Amazon. Thanks for the suggestion though, I will keep hunting!
Owner
Copy link

@gramps Every file storage should work. Some people use Nextcloud or other providers, a static folder on their own server etc. Some people have put attachments into a Git repo with Git LFS.

I assume that we can raise the attachment size once we have enabled better storage quota.

@gramps Every file storage should work. Some people use Nextcloud or other providers, a static folder on their own server etc. Some people have put attachments into a Git repo with Git LFS. I assume that we can raise the attachment size once we have enabled better storage quota.

Hmm, I read putting them into repos through LFS was bad practice. I'd also like to avoid tanking Codeberg's storage as much as possible. I'm sure I can figure something simple enough out. Thanks for the information! Once I can get these releases under 100 mb or Codeberg raises it a bit, I'll start hosting them here.

Hmm, I read putting them into repos through LFS was bad practice. I'd also like to avoid tanking Codeberg's storage as much as possible. I'm sure I can figure something simple enough out. Thanks for the information! Once I can get these releases under 100 mb or Codeberg raises it a bit, I'll start hosting them here.
Member
Copy link

Ah, I was hoping to avoid US-based hosting; especially things like Amazon.

There are many non-US S3 providers out there which are on top also much cheaper than AWS.

> Ah, I was hoping to avoid US-based hosting; especially things like Amazon. There are many non-US S3 providers out there which are on top also much cheaper than AWS.

Oh really? I thought that term was specifically AWS; interesting.

Oh really? I thought that term was specifically AWS; interesting.
Owner
Copy link

It is an AWS term. Some other competitors and libre tools have implemented the API, though. See https://en.wikipedia.org/wiki/Amazon_S3#S3_API_and_competing_services

It is an AWS term. Some other competitors and libre tools have implemented the API, though. See https://en.wikipedia.org/wiki/Amazon_S3#S3_API_and_competing_services

Here you can find a list of European S3 alternatives: https://european-alternatives.eu/alternative-to/amazon-s3

Here you can find a list of European S3 alternatives: https://european-alternatives.eu/alternative-to/amazon-s3

Thank you both for the links and information!

Thank you both for the links and information!
Sign in to join this conversation.
No Branch/Tag specified
main
No results found.
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
5 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Codeberg-e.V./requests#129
Reference in a new issue
Codeberg-e.V./requests
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?