Last modified: 2014-05-08 21:41:11 UTC
A installation of Postgresql with PostGIS and hstore would be nice to work with Wikipedia-coordinates there. I assume the amount of data will be relatively small compared with the data we will have later from OpenStreetMap on an other Server.
*** Bug 51885 has been marked as a duplicate of this bug. ***
We are currently working on setting up a Mysql DB on physical servers for Labs' use; given that there are also nice things that can be done with a working pgsql in general (testing mw against it comes to mind), I think this should be provided as a general service. The current mysql DB plan calls for a master/slave setup, it'd be easy to set up a postgres server on those same servers as well -- switching roles so that performance is distributed.
Nice things possible with psql would be: *Have PostGIS to play with Wikipedia-coordinates or other geospatial data as mention before. *pgsql has a nice key-values store (hstore) *pgsql starts to support JSON[1]. This is perhaps a really nice way to make data from WikiDATA accessible. [1]http://www.postgresql.org/docs/9.3/static/functions-json.html
[moving from "Tools" to "WM Labs > tools"]
Silke, what tools are waiting on this?
Silke: Do you know tools which are waiting for this (Postgres on Tool labs)?
This is for the part of OSM that is going to move to the Wikimedia Labs.
One tool which is waiting for it is Wikipedia coordinates [1], which is with 6 Mio. entries relatively small but often used. This tool is independent from OSM and was the reason for me to open this ticket, because it seems to be an easy task. Other tools like WIWOSM, Addtags, ... need off course the full OSM database. Existing OSM tools can be found here [2] (by using the search function). If the database in WMF production is now running I hope we can get OSM database in Labs really soon. Greetings [1]https://de.wikipedia.org/wiki/Wikipedia:WikiProjekt_Georeferenzierung/Wikipedia-World/en [2]https://www.mediawiki.org/wiki/Wikimedia_Labs/Tool_Labs/List_of_Toolserver_Tools
Is there an schedule for it? I read something about Postgresql-server for Labs in the WMF engineering report of November.
The hardware has been set aside for it in eqiad (the datacenter labs is moving to). Since we are moving all of labs, it didn't seem reasonable to set it up for a month and then have to migrate it, so the postgresql instance will be available in the new location (we are gunning for early Feb).
Thanks for the info.
Postgresql might be also needed to keep the toolserver wiki somewhere in Tool Labs (see #60220). Giving high priority for after the migration to equiad.
PostgreSQL master/server databases are good and ready to go labsdb1004 is the master, labsdb1005 is the slave. Streaming asynchronous replication is setup between them, as configured by the puppet module. Some minor manual steps to get the architecture fully working will be documented in the puppet module. PostGIS is scheduled to be enabled soon. OSM syncing from planet.osm still needs some work and will be ready ASAP.
So, can this ticket be closed?
Indeed it can. Closing it. Thanks Silke
