Last modified: 2014-07-24 12:01:53 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T61683, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 59683 - Add some of the missing tables in commonswiki_f_p
Add some of the missing tables in commonswiki_f_p
Status: RESOLVED FIXED
Product: Wikimedia Labs
Classification: Unclassified
tools (Other open bugs)
unspecified
All All
: High enhancement
: ---
Assigned To: Marc A. Pelletier
:
Depends on:
Blocks: labs-replication tool-missing-ts-feat merl-tools
  Show dependency treegraph
 
Reported: 2014-01-05 15:44 UTC by Maarten Dammers
Modified: 2014-07-24 12:01 UTC (History)
8 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Maarten Dammers 2014-01-05 15:44:08 UTC
commonswiki_p currently contains the following tables:

MariaDB [commonswiki_p]> show tables;
+-------------------------+
| Tables_in_commonswiki_p |
+-------------------------+
| abuse_filter            |
| abuse_filter_action     |
| abuse_filter_history    |
| abuse_filter_log        |
| archive                 |
| archive_userindex       |
| category                |
| categorylinks           |
| change_tag              |
| externallinks           |
| geo_killlist            |
| geo_tags                |
| geo_updates             |
| global_block_whitelist  |
| globalimagelinks        |
| hashs                   |
| hitcounter              |
| image                   |
| imagelinks              |
| interwiki               |
| ipblocks                |
| ipblocks_ipindex        |
| iwlinks                 |
| l10n_cache              |
| langlinks               |
| localisation            |
| localisation_file_hash  |
| logging                 |
| logging_logindex        |
| logging_userindex       |
| mark_as_helpful         |
| math                    |
| module_deps             |
| msg_resource            |
| msg_resource_links      |
| oldimage                |
| oldimage_userindex      |
| page                    |
| page_props              |
| page_restrictions       |
| pagelinks               |
| pif_edits               |
| povwatch_log            |
| povwatch_subscribers    |
| protected_titles        |
| recentchanges           |
| recentchanges_userindex |
| redirect                |
| revision                |
| revision_userindex      |
| site_identifiers        |
| site_stats              |
| sites                   |
| tag_summary             |
| templatelinks           |
| transcode               |
| updatelog               |
| updates                 |
| user                    |
| user_former_groups      |
| user_groups             |
| valid_tag               |
| wikilove_image_log      |
| wikilove_log            |
+-------------------------+
64 rows in set (0.04 sec)

The federated version only contains a very small subset of these:

MariaDB [commonswiki_f_p]> show tables;
+---------------------------+
| Tables_in_commonswiki_f_p |
+---------------------------+
| image                     |
| logging                   |
| logging_userindex         |
| page                      |
| revision                  |
| revision_userindex        |
| user                      |
+---------------------------+
7 rows in set (0.04 sec)

I would like to see all the missing tables added, but that seems to be a bridge
to far at this moment. So to get about this deadlock please at least add these
tables:

* categorylinks
* globalimagelinks 
* imagelinks
* langlinks
* oldimage
* oldimage_userindex
* page_props
* pagelinks
* recentchanges
* recentchanges_userindex
* templatelinks
Comment 1 Silke Meyer (WMDE) 2014-01-23 17:44:15 UTC
Why aren't those tables part of the federated version?
Comment 2 Gerrit Notification Bot 2014-04-04 19:51:50 UTC
Change 123916 had a related patch set uploaded by coren:
Labs: automate federated table maintenance

https://gerrit.wikimedia.org/r/123916
Comment 3 Gerrit Notification Bot 2014-04-04 19:52:54 UTC
Change 123916 merged by coren:
Labs: automate federated table maintenance

https://gerrit.wikimedia.org/r/123916
Comment 4 Marc A. Pelletier 2014-04-04 19:54:23 UTC
Federation now provides, by default, the set of public tables.
Comment 5 merl 2014-06-18 13:07:37 UTC
globalimagelinks is still missing
Comment 6 merl 2014-06-18 13:22:46 UTC
Also filearchive, filearchive_userindex, user_daily_contribs, user_properties and betafeatures_user_counts are missing compared to s4.labsdb.commonswiki_p
Comment 7 Silke Meyer (WMDE) 2014-06-18 15:47:12 UTC
Hi Sean, I'm assigning this to you because Coren isn't available, this has been reopened and is needed for the Toolserver migration.
Can you help?

Best Silke
Comment 8 Sean Pringle 2014-06-26 06:09:29 UTC
Federated filearchive, filearchive_userindex, user_daily_contribs, user_properties should now exist, pointing to the sanitized labsdb1002 commonswiki_p versions.

Need to get input from Coren on the replica maintenance scripts for globalimagelinks and betafeatures_user_counts.
Comment 9 Silke Meyer (WMDE) 2014-06-26 10:00:43 UTC
Thanks Sean and ping Coren!
Comment 10 merl 2014-06-28 12:20:49 UTC
On s5

SELECT * FROM commonswiki_f_p.recentchanges limit 1;

fails with an error:

ERROR 1296 (HY000): Got error 10000 'Error on remote system: 1054: Unknown column 'rc_moved_to_ns' in 'field list'' from FEDERATED
Comment 11 merl 2014-06-29 17:18:55 UTC
Also on s5 (others not testet)

>SELECT * from commonswiki_f_p.page limit 3;
ERROR 1296 (HY000): Got error 10000 'Error on remote system: 1054: Unknown column 'page_content_model' in 'field list'' from FEDERATED
Comment 12 nosy 2014-07-03 11:21:15 UTC
Seems to be a general problem.
Comment 13 Silke Meyer (WMDE) 2014-07-03 12:06:44 UTC
Any chance we get this resolved? Please increase priority so that Merl can finish his migration, too.
Comment 14 Marc A. Pelletier 2014-07-03 14:23:19 UTC
There's a complicated issue with schema variation between databases that is causing probems.  The one caused by rc_moved_to_ns is gone, I'm working on the other one now.
Comment 15 krd 2014-07-05 15:35:43 UTC
I'm also stuck with one or another script on the "Unknown column 'page_content_model' in 'field list'" problem.
Comment 16 Marc A. Pelletier 2014-07-06 13:55:22 UTC
Both views should now work properly.
Comment 17 Silke Meyer (WMDE) 2014-07-07 08:26:43 UTC
Thanks, Coren! merl, can you please check and confirm this?
Comment 18 merl 2014-07-07 08:58:48 UTC
No, globalimagelinks is still missing (mentioned in comment #1 and #5):

$mysql -hs5.labsdb commonswiki_f_p -e "show tables like 'globalimagelinks'"
Empty Set
Comment 19 merl 2014-07-07 12:36:59 UTC
Also templatelinks problem on s5

select * from commonswiki_f_p.templatelinks limit 1;
ERROR 1296 (HY000): Got error 10000 'Error on remote system: 1054: Unknown column 'tl_from_namespace' in 'field list'' from FEDERATED
Comment 20 Marc A. Pelletier 2014-07-07 14:19:46 UTC
globalimagelinks added, tl_from_namespace has issues (being worked on)
Comment 21 Marc A. Pelletier 2014-07-07 14:29:19 UTC
BTW, now would be a good time to mention if there are other irregularities and not just after I fixed both of those.  :-)
Comment 22 Marc A. Pelletier 2014-07-07 14:55:54 UTC
templatelinks updated to track the recent schema changes.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links