Codeberg/Community
54
325
Fork
You've already forked Community
12

know estimate of time remaining to complete an import, and option to cancel it #723

Open
opened 2022年09月10日 22:13:14 +02:00 by bmorel · 5 comments

I started importing a github repo 3H ago, and the import is still running, no idea how much more time it will take.
I'd bet the thing is stuck... and would like to know if it really is, and if yes, or if too much time is required, how to cancel it, so that instead I could just git push instead (I'm pretty sure it will take a lot less time).

I started importing a github repo 3H ago, and the import is still running, no idea how much more time it will take. I'd bet the thing is stuck... and would like to know if it really is, and if yes, or if too much time is required, how to cancel it, so that instead I could just git push instead (I'm pretty sure it will take a lot less time).
Owner
Copy link

Imports are restricted by the API rate limits of external platforms (e.g. GitHub, GitLab). It's really hard to tell.

Improvements are hard as long as proprietary platforms enjoy you are vendor locked and don't want you to move away. Gitea is working on restoring GDPR data dumps instead, which might be a good option for the future.

Having a more verbose log of what the migration tool is actually doing might be worth a further look, though.

Imports are restricted by the API rate limits of external platforms (e.g. GitHub, GitLab). It's really hard to tell. Improvements are hard as long as proprietary platforms enjoy you are vendor locked and don't want you to move away. Gitea is working on restoring GDPR data dumps instead, which might be a good option for the future. Having a more verbose log of what the migration tool is actually doing might be worth a further look, though.

@fnetX is there a gitea-related issue on that? (Couldn't find one during a quick search.)

@fnetX is there a gitea-related issue on that? (Couldn't find one during a quick search.)

I have created a new "Find-grained personal access token" on GitHub and started a migration of a GitHub repository to Codeberg. 20+ minutes later, the token is still listed as "never used" on https://github.com/settings/tokens?type=beta

So it looks not like rate limiting on the GitHub side, but the migration getting stuck in some job queue of Codeberg.

I have created a new "Find-grained personal access token" on GitHub and started a migration of a GitHub repository to Codeberg. 20+ minutes later, the token is still listed as "never used" on https://github.com/settings/tokens?type=beta So it looks not like rate limiting on the GitHub side, but the migration getting stuck in some job queue of Codeberg.

So it looks not like rate limiting on the GitHub side, but the migration getting stuck in some job queue of Codeberg.

Keep in mind that these situations are very context-specific and change super fast. The job queue of Codeberg may play a role now, but it may not have played a role with OP's problem.

I would suggest opening a new issue for this using "Reference in a new issue" and that we open a new Gitea issue for what fnetX suggested as well. (I can't do this right now.)

> So it looks not like rate limiting on the GitHub side, but the migration getting stuck in some job queue of Codeberg. Keep in mind that these situations are very context-specific and change super fast. The job queue of Codeberg may play a role now, but it may not have played a role with OP's problem. I would suggest opening a new issue for this using "Reference in a new issue" and that we open a new Gitea issue for what fnetX suggested as well. (I can't do this right now.)
Owner
Copy link

I suppose that the access token is not used while cloning the Git repo itself, only for accessing the metadata like issues, releases etc.

Also note that the rate limiting is not imposed per token but per IP address, thus applies to Codeberg as a whole, and yes it sometimes does impact the Git cloning, too. (Not always, though)

I suppose that the access token is not used while cloning the Git repo itself, only for accessing the metadata like issues, releases etc. Also note that the rate limiting is not imposed per token but per IP address, thus applies to Codeberg as a whole, and yes it sometimes does impact the Git cloning, too. (Not always, though)
Sign in to join this conversation.
No Branch/Tag specified
main
No results found.
Labels
Clear labels
accessibility

Reduces accessibility and is thus a "bug" for certain user groups on Codeberg.
bug

Something is not working the way it should. Does not concern outages.
bug
infrastructure

Errors evidently caused by infrastructure malfunctions or outages
Codeberg

This issue involves Codeberg's downstream modifications and settings and/or Codeberg's structures.
contributions welcome

Please join the discussion and consider contributing a PR!
docs

No bug, but an improvement to the docs or UI description will help
duplicate

This issue or pull request already exists
enhancement

New feature
infrastructure

Involves changes to the server setups, use `bug/infrastructure` for infrastructure-related user errors.
legal

An issue directly involving legal compliance
licence / ToS

involving questions about the ToS, especially licencing compliance
please chill
we are volunteers

Please consider editing your posts and remember that there is a human on the other side. We get that you are frustrated, but it's harder for us to help you this way.
public relations

Things related to Codeberg's external communication
question

More information is needed
question
user support

This issue contains a clearly stated problem. However, it is not clear whether we have to fix anything on Codeberg's end, but we're helping them fix it and/or find the cause.
s/Forgejo

Related to Forgejo. Please also check Forgejo's issue tracker.
s/Forgejo/migration

Migration related issues in Forgejo
s/Pages

Issues related to the Codeberg Pages feature
s/Weblate

Issue is related to the Weblate instance at https://translate.codeberg.org
s/Woodpecker

Woodpecker CI related issue
security

involves improvements to the sites security
service

Add a new service to the Codeberg ecosystem (instead of implementing into Gitea)
upstream

An open issue or pull request to an upstream repository to fix this issue (partially or completely) exists (i.e. Gitea, Forgejo, etc.)
wontfix

Codeberg's current set of contributors are not planning to spend time on delegating this issue.
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
5 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Codeberg/Community#723
Reference in a new issue
Codeberg/Community
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?