fediverse/fep
37
268
Fork
You've already forked fep
100

Unarchived links to SocialHub may be lost #12

Closed
opened 2022年04月26日 07:58:52 +02:00 by weex · 11 comments
Owner
Copy link

SocialHub.activitypub.rocks has been down for over a week with no resolution in sight. For the history of FEP to be preserved, these links would also need to be archived.

SocialHub.activitypub.rocks has been down for over a week with no resolution in sight. For the history of FEP to be preserved, these links would also need to be archived.

@realaravinth wrote a script that crawls a forum, which was used to archive Feneas forum for ForgeFed discussion. When SocialHub is up it could be run on it.

There's also likely an robots.txt admin setting to determine whether crawlers are allowed to crawl, that may also affect how archive.org operates on the forum.

@realaravinth wrote a script that crawls a forum, which was used to archive Feneas forum for ForgeFed discussion. When SocialHub is up it could be run on it. There's also likely an `robots.txt` admin setting to determine whether crawlers are allowed to crawl, that may also affect how archive.org operates on the forum.

Thanks for the ping @circlebuilder :)

The script was meant to archive only the forgefed tag/topic but if required and with SocialHub admin's consent, I could modify it to periodically archive the whole SocialHub to archive.org.

There's also likely an robots.txt admin setting to determine whether crawlers are allowed to crawl, that may also affect how archive.org operates on the forum.

I took a look at it, it seems to be crawler-friendly.

Thanks for the ping @circlebuilder :) The script was meant to archive only the forgefed tag/topic but if required and with SocialHub admin's consent, I could modify it to periodically archive the whole SocialHub to archive.org. > There's also likely an robots.txt admin setting to determine whether crawlers are allowed to crawl, that may also affect how archive.org operates on the forum. I took a look at it, it seems to be crawler-friendly.

Note that Hellekin together with Hetzner provider managed to trace down the issue (likely due to new IPv6 functionality introduced at Hetzner), and since then the SocialHub is working alright again.

If it is crawler-friendly, then consent is not needed, the content is out there. For instance Sebastian found topics in Google Cache while the site was down. Archive.org doesn't archive in a manner that is browse-able. But we may ask anyway.

Note that Hellekin together with Hetzner provider managed to trace down the issue (likely due to new IPv6 functionality introduced at Hetzner), and since then the SocialHub is working alright again. If it is crawler-friendly, then consent is not needed, the content is out there. For instance Sebastian found topics in Google Cache while the site was down. Archive.org doesn't archive in a manner that is browse-able. But we may ask anyway.
Author
Owner
Copy link

Being mindful of scope for this issue, I think it's most important to archive FEP discussion threads when or after they've gone FINAL.

Being mindful of scope for this issue, I think it's most important to archive FEP discussion threads when or after they've gone FINAL.

Agree. That should really be part of the standard procedure of FEP finalization. Maybe even by checking in the entire discussion(s) as markdown docs to the FEP. I requested a markdown view of an entire topic which is now implemented.

But before FINAL when SocialHub is down all the 'prep work' is inaccessible. Now the outage was long, but fixed. Could as well have been permanent.

Agree. That should really be part of the standard procedure of FEP finalization. Maybe even by checking in the entire discussion(s) as markdown docs to the FEP. I [requested a markdown view of an entire topic](https://meta.discourse.org/t/export-topic-as-markdown/152185/18) which is now implemented. But before FINAL when SocialHub is down all the 'prep work' is inaccessible. Now the outage was long, but fixed. Could as well have been permanent.
Author
Owner
Copy link

Just used Archive.org to save the discussion for FEP-8fcf and since it was a long one I had to save it twice, once from the beginning of the thread and once from the end.

Just used Archive.org to save the discussion for FEP-8fcf and since it was a long one I had to save it twice, once from the beginning of the thread and once from the end.
Author
Owner
Copy link

Added links to archived discussion for each of FEP-8fcf and FEP-400e so this practice is current now. What's still left is to add this practice to FEP-ae4d.

Added links to archived discussion for each of FEP-8fcf and FEP-400e so this practice is current now. What's still left is to add this practice to FEP-ae4d.

The final FEPs are published to https://socialhub.activitypub.rocks/pub/fep-f6f8-title-of-the-fep and indexed at https://socialhub.activitypub.rocks/pub/fediverse-enhancement-proposals

So this is probably what you want to track for changes.

The final FEPs are published to `https://socialhub.activitypub.rocks/pub/fep-f6f8-title-of-the-fep` and indexed at https://socialhub.activitypub.rocks/pub/fediverse-enhancement-proposals So this is probably what you want to track for changes.
Author
Owner
Copy link

The final FEPs are published to https://socialhub.activitypub.rocks/pub/fep-f6f8-title-of-the-fep and indexed at https://socialhub.activitypub.rocks/pub/fediverse-enhancement-proposals

So this is probably what you want to track for changes.

Is that page generated automatically or how will it get updated?

> The final FEPs are published to `https://socialhub.activitypub.rocks/pub/fep-f6f8-title-of-the-fep` and indexed at https://socialhub.activitypub.rocks/pub/fediverse-enhancement-proposals > > So this is probably what you want to track for changes. Is that page generated automatically or how will it get updated?

Currently it's updated manually, but see the following post for ways to automate:

https://socialhub.activitypub.rocks/t/standards-fep-forum-permissions/2677/7?u=how

Currently it's updated manually, but see the following post for ways to automate: https://socialhub.activitypub.rocks/t/standards-fep-forum-permissions/2677/7?u=how
Author
Owner
Copy link

This was resolved with #48

This was resolved with https://codeberg.org/fediverse/fep/pulls/48
Sign in to join this conversation.
No Branch/Tag specified
main
pages
No results found.
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
4 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
fediverse/fep#12
Reference in a new issue
fediverse/fep
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?