Last modified: 2014-02-28 16:21:08 UTC
Hacked up some harvesting a time ago: mysql> SELECT COUNT(*) FROM commonscat; +----------+ | COUNT(*) | +----------+ | 12015 | +----------+ 1 row in set (0.00 sec) CREATE TABLE `commonscat` ( `site` enum('be-x-old','ca','da','de','en','es','et','fr','gl','lb','nl','no','pl','pt','ro','sv') NOT NULL, `title` varchar(255) NOT NULL DEFAULT '', `commonscat` varchar(255) DEFAULT NULL, `changed` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP, PRIMARY KEY (`site`,`title`) ) ENGINE=MyISAM DEFAULT CHARSET=utf8 Should set up daily harvesting so this can be used by other tools.