Toolserver
Toolserver
The tool server zedler.knams.wikimedia.org (Sun V40z, 2 x 2.2GHz Opteron, 8GB RAM, 6x 146GB SCSI) was donated by Sun to Wikimedia Deutschland. Its purpose is to provide hosting and a combined access to all the useful tools which were written by different people for the Wikimedia projects. Interested programmers should get shell access there to update and care for their scripts.
TODO:
- write some documentation for users
- agree on a policy and some guidelines (naming conventions, directory structures, sharing and documenting code...)
Projects
Please see Toolserver/Projects for a list of available tools and other content.
Account policy
Account allocation
Accounts in the Toolserver are given upon request to those who want to use it to develop and run tools for Wikipedia or other projects of Wikimedia. To apply, give your nickname and specify reasons. It's very important, that on the toolserver run only tools. Programs must not be seems as part of the Mediawikisoftware or part of Wikimediaprojects.
Accounts are given for a period of six months. Accounts that have been inactive for six months will be deleted.
Next confirmation date: 1st April 2006
Using convention
You should put an index website directly in public_html, which links to all your tools and gives a short description of them. Files in public_html are accessible at http://tools.wikimedia.de/~yourusername/
. PHP is available.
We would like you to put two links at the bottom of every project site: "About this server" which links to http://tools.wikimedia.de, preferably using this button. The other link is "About this tool", which links to a form that says who wrote the script, where to find the source, full description (a template will be provided soon). Your Source code should be documented as well.
All sources should be free. That doesn't mean that you have to publish your code if it isn't ready and looks terrible, but when you're ready and the tool works, you have to clean up the code and put it on ~/public_html/project/source.tar.gz
. If you put it somewhere else, advise.
Some administrators have full access to the server to look for security issues and that the server is not abused.
Contact
The place to ask questions about the toolserver and accounts is the IRC channel #wikimedia-toolserver. The responsible and official contact for the toolserver from Wikimedia Deutschland is APPER; for new accounts DaB. Additionally, there is a mailing list at http://mail.wikipedia.org/mailman/listinfo/toolserver-l to which all users should subscribe. The current system administrators can be reached at <zedler-admins@wikimedia.org>.
Documentation
see /For users for usage documentation.
People
People with accounts
- de:Benutzer:DaB.: Problematic-Edit-Founder, also Quizbot (because latency) (done)
- de:Benutzer:JakobVoss: Personendatenauswertung [1] and extraction of data out of the dumps for further research (done)
- de:Benutzer:APPER: Personendaten-Tagger [2] (done)
- en:User:Alterego: WikiPulse, zeitgeist related stuffs. (done)
- de:Benutzer:Avatar: Checkusage for usage of images on Commons in the projects (it would be definitly a good/the only solution to re-write it, so that it uses the DB directly and not http-requests). (done)
- de:Benutzer:Bananeweizen: Wikify on http://bananeweizen.de/wikipedia/wikify/index.php -> This would enable the wikifyer to use more current data (either from DB or dump) while it currently uses a text file containing the titles of (German) articles only. (done)
- de:Benutzer:Flacus: Interwikilink checker on http://www.flacus.de/wikipedia/Interwiki-Link-Checker
- en:User:Gmaxwell: bulk statistics, edit classification, etc. (done)
- de:Benutzer:D: finding new ways do detect vandalism
- en:User:AllyUnion: Written the following bots: en:User:AFD Bot, en:User:Sandbot, en:User:Kurando-san, en:User:NekoDaemon. Would like to work on collaborative bot projects to maintain various pages on the Wikipedia and elsewhere. Also, I can't seem to fit dumps of Wikipedia anywhere. Would like to automate the update of useful pages such as en:Wikipedia:List of Wikipedians by number of edits, and other statistic pages on en: --AllyUnion 23:40, 3 October 2005 (UTC) [reply ]
- de:User:Duesentrieb (also on meta and commons): WikiSense project (see Wikimania presentation), MediaWiki development, several tools for wikipedians.
- en:User:Beland: Maintainer of the Wikibot, en:User:Pearle
- AllyUnion asked me to collaborate on a bot-writing repository. I am also interested in adding performance-monitoring tools, such as an HTTP service tracker for images; and perhaps contributing to a repository of offline analysis tools, such as those I use to update various reports. -- Beland 04:08, 11 October 2005 (UTC) [reply ]
- Well, more so on the collaboration of writing scripts and various other programs. In the spirit of wiki, programs should be updated in a similiar style, with an original program developed maybe by a single person then posted so that someone else can maintain it or change it as they see fit to improve it. In other cases, maybe a half finished program that someone's stuck on... and so on. --AllyUnion 09:38, 14 October 2005 (UTC) [reply ]
- AllyUnion asked me to collaborate on a bot-writing repository. I am also interested in adding performance-monitoring tools, such as an HTTP service tracker for images; and perhaps contributing to a repository of offline analysis tools, such as those I use to update various reports. -- Beland 04:08, 11 October 2005 (UTC) [reply ]
- de:User:Aka a few of my listed Wikipedia tools, the article analyzing tools I wrote especially for creature articles and more offline Wikipedia tools I created could certainly benefit from a faster server and a database access. -- Aka 13:53, 21 October 2005 (UTC) [reply ]
- Eloquence: possibly move FlickrLickr here to reduce bandwidth usage; interested in implementing a translation automation system. I have shell access to the regular server matrix.--Eloquence 23:04, 14 November 2005 (UTC) [reply ]
- en:User:Kelly Martin: Requesting access in order to generate statistics related to Jimbo's current "experiment" on en. Direct access to databases required to develop these efficiently. Other projects as time permits. Kelly Martin 15:13, 6 December 2005 (UTC) [reply ]
- User:Ral315 - I'd like to get an RSS feed going for the Wikipedia Signpost on the English Wikipedia. I've already got a simple RSS feed written. All I'd need to start with would be FTP access, though having a database table would allow me to compile the RSS feed easier, without having to do so manually. Ral315 (en) 18:35, 5 December 2005 (UTC) [reply ]
- Also, I can provide a link if requested, though I'd prefer not to do so publicly, as it's on my personal web server, which I'd like to keep private at this time. Ral315 (en) 14:51, 6 December 2005 (UTC) [reply ]
- en:User:Tony Sidaway: Vandalism report, and alternative ways of tracking ongoing activities. --Tony Sidaway|Talk 18:20, 30 December 2005 (UTC) [reply ]
- de:Benutzer:kolossos For geographical services like this [3], perhaps also as dynamical sidebar search-engine for whole system. An other thing is the dynamical presentation of wikipedia-places in Google Earth [4] An other thing is to create a better overview over the Categories [5]. de:Benutzer:kolossos23:52, 26 November 2005 (UTC)
- Robchurch - main interest is in developing a tool that will begin to help detect copyright infringement. Also thinking of efficient vandal-fighting bots, and I think the access will also be useful for developing MediaWiki (which I'm dipping my toes into, somewhat). Rob Church Talk 01:47, 2 November 2005 (UTC) [reply ]
- en:User:Phroziac: Interested in making editorial tools to assist in finding typos and common english grammar mistakes, among other things, including tons of vaporware ideas. 02:19, 10 December 2005 (UTC) [reply ]
- en:User:Ambush Commander: PHP Bot, Status. My home page is: ~edwardzyang
- en:User:Interiot: Interested in edit-count analysis similar to my original tool. --Interiot 15:53, 29 December 2005 (UTC) [reply ]
- en:User:HoodedMan: Interested in having a daily update of the Bad links page and will be considering other projects as they occur to me, including an advanced edit counter. If you need more details, please leave me a message on my talk page. I look forward to hearing from you; this is a great opportunity you offer.
- Mmm. And I might be interested in starting up another suspect edits bot (I've been interested in how it was coded) since Gmaxwell's might be off for a while, which is unfortunate.
- TDS Working on RSS feeds for logs, articles, talk pages, contribs, recent changes etc. TDS 08:10, 2 January 2006 (UTC) [reply ]
- de:Benutzer:Dapete I'm developing a database-driven RSS feed for German Wikinews, which is basically working (see example output). For testing and further development a "live" database would be ideal. —10:34, 4 January 2006 (UTC)
- en:User:Pgk - Developing additional janitorial tools, such as detection of insertion of swear words, spam links etc. Integrate into my existing IRC based bot. Also helpmebot for en:Wikipedia:Bootcamp, notifies an IRC channel when people insert a certain template (request for help) in their talk pages --Pgk 19:02, 16 February 2006 (UTC) [reply ]
- en:User:Bjelleklang: I am currently involved with the Bootcamp project on the english wikipedia. Bjelleklang -- talk 01:24, 1 February 2006 (UTC) [reply ]
- WebBoy - nl:Gebruiker:WebBoy - To run my vandalism IRC-bot (currently running on #wikipedia-nl-vandalism, but not 24/7). I'm using eggdrop and Tcl. WebBoy 18:32, 23 January 2006 (UTC) Also possible to run for other wiki's than wikipedia-NL. 62.251.18.213 18:51, 29 January 2006 (UTC) [reply ]
- de:Benutzer:Geonick: Small project start with the long term goal to make a Wiki-on-a-Map (see WikiOnAMap). The first step will be to extract articles tagged with Template Koordinate. The second step would be to offer geodata formats (like KML, GeoRSS) as well as a webservices (like a RESTfull service, WMS or a Google Earth network link). Step three will probably add an a UMN Mapserver running on Postgres, combined with an web mapping client (thus the project title Wiki-on-a-Map). --Geonick 00:49, 26 January 2006 (UTC) [reply ]
People interested to join
list your name here and describe what you want to do on the toolserver (with links to tools you have written)
- de:Benutzer:Fab: Copyvio check on http://www.affenkrieger.de/wiki/wikicc.php (ask Google for an API key?)
- Personal comment: de:Benutzer:Akl aked me if i would contribute the mentioned tool - well, yes. But it needs some rewriting (code looks a bit messy), could take some time until it is working with UTF8 etc. -- fab 12:08, 23 October 2005 (UTC) [reply ]
- en:User:Jdunck: Developing a fine-grained REST statistics service for pages as a complement to Zachte's coarse-gained stats. Also supplying overlays of these statistics onto content pages, i.e. background color varying as the number of editors since text introduction. -- 03:00 1 November 2005 UTC
- en:User:Tom Foolery - Developing a bot that will allow people to message a Jabber bot a page they want to watch. Said bot will IM them when an edit has been made. 19:44, 2 January 2006 (UTC) [reply ]
- User:Sam Korn/en:User:Sam Korn Developing tools that will generate citations to avoid the necessity of using meta-templates on those pages. Rob Church is currently hosting a demonstration of what I am intending to do at [6]. Sam Korn 23:22, 8 January 2006 (UTC) [reply ]
- Datrio - I would like access mainly to make the Polish Wikinews easier to browse, and to write up some anti-vandalism tools on the Polish Wikipedia (and then expand it to other Wikipedias). I'm also interested in creating some statistic pages for the Wikimedia projects, but these are only my further plans. Datrio 11:03, 20 January 2006 (UTC) [reply ]
- --porao (responder) 10:21, 22 January 2006 (UTC) Edit counting and other statistical scripts for es: wikipedia. Here you can check lists i have already generated with my script.
- Ok. He/she will gets his/her account soon. --DaB. 16:53, 31 January 2006 (UTC) [reply ]
- en:User: That Guy, From That Show! -
(削除) Create useful queries (for instance) looking at a category and showing recent article changes to articles that belong to that category as well as (if possible) articles in sub categories. This would be extremely useful to editors who want to efficiently check articles that relate to their expertise (削除ここまで). I am removing my request (02/11/2006). I'm working with a local copy of Mediawiki and will re-apply when I have some examples ready.
- I have a lot of database & PHP/etc experience and training, but I can't see specific information about what the tools.* tables include. I'd like to make tools that let editors find more efficent ways to watch categories/articles that they are more knowledgeable about. en:User Talk:That Guy, From That Show! 06:53, 24 January 2006 (UTC) [reply ]
- This is not an objection, but there is something like that on toolserver: [7] 62.251.18.213 18:10, 25 January 2006 (UTC) [reply ]
- Thank you very much for the information. That's one of the many possibilities I am very interested in. -- en:User Talk:That Guy, From That Show! 22:05, 25 January 2006 (UTC) [reply ]
- This is not an objection, but there is something like that on toolserver: [7] 62.251.18.213 18:10, 25 January 2006 (UTC) [reply ]
- de:User:Hendrik Brummermann: I am helping developing DaB.'s ShowProtectedSites tool and want to be able to test/debug it. --Hendrik Brummermann 21:42, 30 January 2006 (UTC) [reply ]
- Ok, will gets his account soon. --DaB. 20:49, 31 January 2006 (UTC) [reply ]
- Talrias, for working on suggestions/feature requests/bugs such as bug 4818. I am currently running the bot "khitan" in #wikipedia-bootcamp (a helper bot), and I have 4 RSS feeds of each reference desk page on en: generated hourly which I will transfer. Talrias 20:46, 2 February 2006 (UTC) [reply ]
- Michael Holzt (German Wikinews), for the german wikinews lottery bot, see here. Preferred login name: 'lottobot'. Thanks. -- wikinews:de:Benutzer:Michael Holzt 23:42, 6 February 2006 (UTC)
- Ok. Will get his account. --DaB. 13:29, 7 February 2006 (UTC) [reply ]
- de:Benutzer:Jokannes, for a script that generates M3U/PLS playlist files for Wikipedia media content (See german Template:Playlist). And a proof of concept for an automatic conversion, caching and delivery system, that converts OGG files to LAME based MP3 files. (Dreaming about a Podcast feed for Spoken Wikipedia - political discussion may start, if the concept works) (suggested by Kolossos) 84.59.244.221 15:13, 14 February 2006 (UTC) [reply ]
- ForteTuba, for converting SuggestBot from an experimental platform to a tool usable on demand. SuggestBot looks at your edit history and finds other things for you to work on. AllyUnion suggested that this might be a good idea and that toolserver would be a good place to go. -- 128.101.35.152 23:37, 15 February 2006 (UTC) (ForteTuba)[reply ]
- Any word? There's been some positive feedback; having run with it for a while on a local machine with dumps, it would be a lot nicer to run off the toolserver. -- ForteTuba 18:00, 14 March 2006 (UTC) [reply ]
- en:Oleg Alexandrov (talk) I have been running a bunch of jobs with en:User:mathbot (see that page for details). I would like to move some of them on the toolserver, especially the edit summary usage tool, now at http://www.math.ucla.edu/~aoleg/wp/rfa/edit_summary.html How long is it going to take to get access, I see a big backlog in here? en:Oleg Alexandrov (talk) 03:16, 22 February 2006 (UTC) [reply ]
- Dijxtra: I wrote a bot which helps maintain w:WP:AID. It gets the page, parses it, and sugests what to do (doesn't edit anything). At the moment I run it localy from my machine, but would like to put it online and make it usable for anybody.
(削除) It seems that both servers I have acount on have python version prior to 2.3, so I can't even test my php interface to the bot. Hence, no link to my bot. (削除ここまで)I put my bot online: [8]. It'd be great if I could move it to toolserver. --Dijxtra 14:18, 24 February 2006 (UTC) [reply ]
- en:User:Avriette. I've been speaking to en:User:Interiot about the possibility of writing a few tools written in perl [9]. Interiot suggested that I "apply" for toolserver access here, and follow up on irc. Avriette 02:48, 27 February 2006 (UTC) [reply ]
- Avriette had said he wanted to contribute patches to some of my tools, and I felt he might be able to more productively test patches out on the toolserver itself. Also he has experience in SQL, and already has several ideas of other tools that might be implemented. --Interiot 16:42, 27 February 2006 (UTC) [reply ]
- Will gis his account soon. --DaB. 21:06, 27 February 2006 (UTC) [reply ]
- en:User:AaronSw. I'm the developer of infogami a wiki-like system with a SQL backend. I want to apply some of the features I'm developing for Infogami to Wikipedia. For example, I've got some HTML blame software that calculates who wrote what piece of an article based on the revision history. (example) AaronSw 00:57, 3 March 2006 (UTC) [reply ]
- de:User:gnosos for working on suggestions/feature requests/bugs to the developers
- en:User:vangelisP interested in developing a "getWikipediaArticle" soap service that will return the text of an article maintaining section and sentence structure. The intention is to use your facility for prototyping purposes. Since the service will perform queries, the latter will be restricted to low frequency and small result size. -- 13 March 2006
- de:User:LeonWeber. I would like to work on several statistic-tools, like creating live-graphs of the current number-of-article. --Leon ¿! 20:46, 10 March 2006 (UTC) [reply ]
- This is the only tool I can link here (the others are on my personal computer), it tracks the Amazon.de Sales Rank of the Wikipedia-Book. This old version uses mrtg, a newer one uses rrdtool. --Leon ¿! 20:58, 10 March 2006 (UTC) [reply ]
- He will get his account soon. --DaB. 21:26, 19 March 2006 (UTC) [reply ]
- en:wikt:Connel MacKenzie. *sob* I've been looking for something like this for a very long time. I've been subsisting on XML dumps to generate things like this, this, this, this, this, this and especially this! Because the existence of this server is such a well kept secret, I'd have taken a different approach on all these. With the six or more pending bot requests I have, a lot of the inherent problems can be avoided by scripting the generation lists here. --Connel MacKenzie 06:38, 15 March 2006 (UTC) [reply ]
- He will get his account soon. --DaB. 21:26, 19 March 2006 (UTC) [reply ]
- de:User:MichaelDiederich I want to update some interval pages for maintaince, i want to contribute in some projects like DabPunkts or LeonWebers. Lets see if i have enough free time to develop something own.. -- MichaelDiederich 14:04, 17 March 2006 (UTC) [reply ]
- He will get his account soon. --DaB. 21:26, 19 March 2006 (UTC) [reply ]
- Tawker - due to the numbers of Wiki's I have had requests for I'm requesting access to the toolserver to run the bot. This would need to be a shared access account with Joshbuddy as he's written most of the code, I've just hosted / handled its public relations. I have been in discussions with pgk about running one copy of pgkbot (a portion of the Tawkerbot2 code) to save resources -- Tawker 01:31, 28 March 2006 (UTC) [reply ]
Pending adding
- en:User:Egil: geographical resources on http://kvaleberg.com/extensions/mapsources/ : The purpose would be to run and further develop the server for georesources currently running on kvaleberg.com here instead, so that the pages are not kept on an offsite server. (Privacy issues has been raised, and the current server solution runs over quota every month). Also build database of points/articles to enable neighborhood functionality etc. The software is already available as a Wikimedia extension. Further decription and documentation is available in Gis. See also en:Wikipedia:WikiProject Geographical coordinates which is built around this. -- Egil 20:19, 11 October 2005 (UTC) [reply ]
List of people to invite
if you find your name here and you'd like to use the toolserver, move your entry to the section above.
- en:User:Curps: English page move vandal detection and blocker bot
- en:User:fvw: English open proxy detection and blocker bot
- de:Benutzer:Filzstift: SQL queries on http://www.wikisign.org
- I think this will be problematic, because sql queries which runs for hours will slow down the toolserver. --Filzstift 11:12, 24 November 2005 (UTC) [reply ]
- de:Benutzer:Marco Krohn: Copyvio check on http://www.itp.uni-hannover.de/~krohn/wscan.html.utf8