Archiving from Software Heritage blocked? #1918

bilke commented 2025年05月06日 16:09:01 +02:00

Comment

I would like to archive some repos on Software Heritage (https://www.softwareheritage.org), but it seems the last successfull archival is already a while ago, see e.g. https://archive.softwareheritage.org/browse/origin/visits/?origin_url=https://codeberg.org/guix-science/guix-science.

When I use the "Save code now" functionality the I get this error:

{
 "error": "HTTPSConnectionPool(host='codeberg.org', port=443): Max retries exceeded with url: /guix-science/guix-science/info/refs?service=git-upload-pack (Caused by ProtocolError('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')))"
}

So for me it looks like it somehow blocked. Is this intended? If yes I would kindly ask to allow archival on Software Heritage again.

Thanks a lot,
Lars

Related: #35

Edit: This is already tracked on Software Heritage: https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/5581

### Comment I would like to archive some repos on Software Heritage (https://www.softwareheritage.org), but it seems the last successfull archival is already a while ago, see e.g. https://archive.softwareheritage.org/browse/origin/visits/?origin_url=https://codeberg.org/guix-science/guix-science. When I use the "Save code now" functionality the I get this error: ``` { "error": "HTTPSConnectionPool(host='codeberg.org', port=443): Max retries exceeded with url: /guix-science/guix-science/info/refs?service=git-upload-pack (Caused by ProtocolError('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')))" } ``` So for me it looks like it somehow blocked. Is this intended? If yes I would kindly ask to allow archival on Software Heritage again. Thanks a lot, Lars Related: #35 Edit: This is already tracked on Software Heritage: https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/5581

Gusted commented 2025年05月07日 20:02:45 +02:00

Rate limiting can be lifted if IP ranges are known. Software Heritage should email to help@codeberg.org.

Rate limiting can be lifted if IP ranges are known. Software Heritage should email to help@codeberg.org.

bilke commented 2025年08月05日 09:51:31 +02:00

Software Heritage have changed something to help with this (https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/5581#note_215780) but now I get "not_found" errors when requesting a save in Software Heritage on codeberg repos., see e.g.

• https://archive.softwareheritage.org/browse/origin/visits/?origin_url=https://codeberg.org/guix-science/guix-science

Software Heritage have changed something to help with this (https://gitlab.softwareheritage.org/swh/infra/sysadm-environment/-/issues/5581#note_215780) but now I get "not_found" errors when requesting a save in Software Heritage on codeberg repos., see e.g. - https://archive.softwareheritage.org/browse/origin/visits/?origin_url=https://codeberg.org/guix-science/guix-science

randysimons commented 2026年01月03日 15:19:25 +01:00

Instead of blunt crawling, there seems to be a opt-in/push method as well, via listers. Gitea is supported, might (still) work for Forgejo as well?

Instead of blunt crawling, there seems to be a opt-in/push method as well, via [listers](https://docs.softwareheritage.org/user/listers.html). Gitea is supported, might (still) work for Forgejo as well?