Data Mining

I recently coded a system to suggest like-minded users and adversaries using voting_api. It's not yet a module, but if there's enough interest, I'll make a module out of it. See the details here.

Hello everyone,

The site, which contains from ~100k to ~1M nodes needs web analytics strategy. It may seem trivial but will describe the site and requirements I am talking about:
-3 different languages, nodes are localized: the same content but 3 different paths. 3 XML sitemap are used, so it is 3x more content for search engines
-Different content authors have to see the summary of their authored content: how much every node was visited total (on all 3 languages combined!!!), daily, weekly, monthly, some other minor stats. Ideally all the data is kept until node is published.

I will be presenting the first version of the content recommendation system I built for software.intel.com, a large Drupal 7 site.

The bulk of the presentation will be about content recommendation systems and our specific implementation. The Drupal portion of the project is a small piece of the puzzle (loading a JSON file from Amazon S3 via AJAX in a block).

I could also present this at the DUG if there is interest.

From the Meetup:

I am trying to create an infograph about Drupal showcasing its strengths and advantages, especially showing how it has grown since it's inception, numbers of modules and themes by year possibly, etc... or any other Ideas I may not have thought of. I am not a Drupal user myself(yet), so if anyone has any Ideas I would be welcome to them. If anyone has any good links to data or any data or know anyone who would have this information it would be a great help.

We are compiling a historic overview of Drupal for a book project, the Definitive Guide to Drupal 7 by APress. As the main research monkey on the project, i (Kasey Qynn Dolin, a complete Drupal newbie) am trying to gather Drupal user and usage statistics data, which we promise we will make easily available to the community as we compile this data.

I've finished these things so far:

<

ul>

I've created initial snapshots for CiviCluster and CiviConference for
users of Drupal 5. It may take up to 24 hours for them to appear in the
Drupal.org release system, but they are already in the DRUPAL-5 CVS branch.

CiviCluster will rapidly identify duplicate contacts and walk users
though merging them. CiviCluster supports CiviCRM 1.6 and 1.7 (except
for CiviEvent). CiviCluster will be updated shortly to support CiviEvent
schema changes.

http://drupal.org/project/civicluster

CiviConference allows online conference management and ticket sales by

I've released an in-development version of PressFlow Transaction for developers interested in convenient encapsulation of SQL transactions. The key features are intelligent use of scope for COMMITs and ROLLBACKs as well as safe, intelligent nesting of transactions to get exception-like semantics.

Usage details are on the project page. Requires PHP 5.

(I posted this to the High-Performance group because encapsulating updates in transactions can dramatically improve performance.)

On November 15th Gerhard released the download statistics for all packages on Drupal.org (with formatting by Earl). Here are two charts that summarize the data and the accompanying Excel. Suggestions are welcome on how to improve them or on other ways to analyze and display the data.

1. Top 30 Packages (click thumbnail to enlarge)

These top packages are comprised of 3 versions of Drupal, 20 modules, 5 themes, and 2 videos.

2. Overall Distribution (click thumbnail to enlarge)

When looking at the distribution of downloads we see noticeable breaking points at 16, 36, and about 590, which segment packages into four classes: Tier 1 (critical), Tier 2 (very popular), Tier 3 (moderately popular), and Tier 4 (unpopular).

There has been some recent work analyzing the growth on drupal.org, and I think we should do something similar for groups.drupal.org.

I would be interested in charts/histograms showing the distribution of:

1. Groups by number of subscribers
2. Groups by posts/week in the past three months
3. Users by number of subscriptions (without identifying information)
4. Users by number of posts (without identifying information)
5. Users by number of posts (without identifying information)
6. Total posts over time
7. Total posts per week over time
8. Total groups over time
9. New groups per week over time
10. Median subscriptions per user over time

Did I forget anything or should some of these be removed/tweaked? I am willing to generate the charts if someone can run the queries, and I can figure out the exact sql queries if needed.

In preparation for starting the 5.0 drumbeat, I was able to get killes (thx Gerhardt!) to run some analysis on drupal.org. I think if we can keep up this kind of growth (and with the spiking numbers of developers, projects, and activity on the site I think we can) 2007 could be a sort of tipping point for Drupal!

UPDATE: here's my blog post on the subject.

The source XLS file is also attached for your own viewing pleasure.