Last modified: 2010-05-15 15:37:46 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T7195, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 5195 - rebuildrecentchanges.inc fails with SQL error (regression in 1.5.7)
rebuildrecentchanges.inc fails with SQL error (regression in 1.5.7)
Status: RESOLVED FIXED
Product: MediaWiki
Classification: Unclassified
Database (Other open bugs)
1.5.x
All All
: Normal normal with 1 vote (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: 6463
  Show dependency treegraph
 
Reported: 2006-03-07 15:36 UTC by Griff Phillips
Modified: 2010-05-15 15:37 UTC (History)
1 user (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Griff Phillips 2006-03-07 15:36:19 UTC
Function "insertSelect" in Database.php has been modified recently and now contains:

$sql = "INSERT $options INTO $destTable (" . implode( ',', array_keys( $varMap )
) . ')' .
	' SELECT ' . implode( ',', $varMap ) . 
	" FROM $srcTable";

This is invalid SQL syntax ... it is not valid to place column names between
INSERT and INTO.

This causes rebuildall.php to crash with "Error: 1064 You have an error in your
SQL syntax..."
Comment 1 Brion Vibber 2006-03-07 22:12:38 UTC
The column names are clearly after INTO, not between INSERT and INTO.
Can you explain what you mean and what you think is the correct syntax?
Comment 2 Griff Phillips 2006-03-08 09:29:12 UTC
Yes you are absolutely right, I meant the values, not the column names. These
are generated from $options inbetween INSERT and INTO, ie "INSERT $options
INTO". Removing the $options variable allows rebuildall.php to complete
correctly. Whether this workaround version completes exactly as the programmer
intended I don't know. But looking at the syntax guide in the MySQL docs, there
doesn't seem to be any situations where it is considered valid to insert tokens
of any kind between INSERT and INTO, so the placing of $option looks to be
incorrect.
Comment 3 Brion Vibber 2006-03-08 10:40:50 UTC
The documentation clearly shows that LOW_PRIORITY, HIGH_PRIORITY, and 
IGNORE may appear between INSERT and INTO on an INSERT ... SELECT 
statement.

http://dev.mysql.com/doc/refman/5.0/en/insert-select.html

The IGNORE option is commonly used when merging things which might 
have duplicate (already-existing) entries which would violate unique 
index constraints.

It all looks correct to me; this is a total non-sequitur which 
obscured the actual error. The offending SQL is:

INSERT rev_timestamp 5000 INTO `recentchanges` 
(rc_timestamp,rc_cur_time,rc_user,rc_user_text,rc_namespace,rc_title,r
c_comment,rc_minor,rc_bot,rc_new,rc_cur_id,rc_this_oldid,rc_last_oldid
,rc_type) SELECT 
rev_timestamp,rev_timestamp,rev_user,rev_user_text,page_namespace,page
_title,rev_comment,rev_minor_edit,0,page_is_new,page_id,rev_id,0, IF
(page_is_new != 0, 1, 0)  FROM `page`,`revision` WHERE (rev_timestamp 
> 20060301103344) AND (rev_page=page_id)

The calling code uses these options:
array( 'ORDER BY' => 'rev_timestamp', 'LIMIT' => 5000 )

The problem here seems to be that this code is expecting to set 
options for the SELECT portion, but Database::insertSelect uses them 
for the INSERT. However since this function didn't *HAVE* an $options 
parameter previously, it never would have worked -- the options would 
have been silently dropped and never made it into the SQL.

It might be a good idea to add another parameter for SELECT options 
and treat it as for the various SELECT wrappers.
Comment 4 Griff Phillips 2006-03-08 10:53:35 UTC
I think "non-sequitur" is overstating the case somewhat! OK, I've now learnt it
is allowable to put certain keywords inbetween INSERT and INTO... but still not
"rev_timestamp 5000". So the value contained in $options was the problem, rather
than the placement of $options between the keywords. Hey, I'm just trying to
tell people about a bug I found which stopped my MediaWiki installation working.
If I'm going to get shot down, I won't bother reporting it next time.
Comment 5 Brion Vibber 2006-03-08 11:11:11 UTC
If digging to find out the exact cause of the error you saw and recommending a 
fix for it is getting "shot down", I don't want to know what us being helpful 
looks like. :)
Comment 6 Griff Phillips 2006-03-08 11:22:09 UTC
OK, well for future reference "this is a total non-sequitur which obscured the
actual error" kind of reads like "get lost and stop wasting our time". But if
that's not what you meant by it, fair enough. I'm not actually a programmer
(these days) so I'm not in a position to try and fix up the code - I'm just
trying to get a MediaWiki installation up and running in our company so that I
can persuade them that Wikis are a good thing. So I thought that it might be
useful to you if I raised the error. Out of interest, is this kind of bug
something that Wikimedia would be likely to fix up in a forthcoming release, or
does it require someone in the open-source community to volunteer to do it ? As
far as I can tell, it seems like a reasonable showstopper if people can't run
rebuildall.php anymore ?
Comment 7 Brion Vibber 2006-03-08 11:29:08 UTC
I'd expect most people in your situation to be running a release version; if this
is a recent change in CVS it shouldn't be affecting you. Can you provide some detail
of your installation, such as what version you're running, if you're performed any
upgrades, etc?

If this is in a release version, it's a regression and thus a bit more important than
if you're running this on the development branch. (rebuildall is not something we use,
ever, on our own servers.)
Comment 8 Griff Phillips 2006-03-08 11:44:55 UTC
We usually run rebuildall.php after a big Import, because we get no Search
matches on the imported data until we have done so. 

Regarding the version of MediaWiki, I've got the package from "Current version"
on the MediaWiki download page, file mediawiki-1.5.7.tar.gz. So I guess that
counts as a release version ? I think this is a regression, because we managed
to run rebuildall.php fine with earlier versions of MediaWiki (but I can't tell
you exactly which ones, sorry.)



Comment 9 Brion Vibber 2006-03-08 12:47:20 UTC
Looks like the change was backported to 1.5.7; changed bug summary to target the
problem area.

Griff, as a workaround try rebuildtextindex.php instead of rebuildall.php. If all
you want is to update the search index, this will skip the other unnecessary
scripts.
Comment 10 Griff Phillips 2006-03-08 12:55:01 UTC
Thanks Brion, I'll give it a try and let you know.
Comment 11 Stefan Pausch 2006-03-08 16:46:27 UTC
Running into the "same" problems with running rebuildall on a 1.5.7 installation:

** Rebuilding recentchanges table:
Loading from page and revision tables...
A database error has occurred
Query: INSERT rev_timestamp 5000 INTO `wiki_recentchanges` (rc_timestamp,rc_cur_time,rc_user,rc_user_text,
rc_namespace,rc_title,rc_comment,rc_minor,rc_bot,rc_new,rc_cur_id,rc_this_oldid,rc_last_oldid,rc_type) 
SELECT rev_timestamp,rev_timestamp,rev_user,rev_user_text,page_namespace,page_title,rev_comment,
rev_minor_edit,0,page_is_new,page_id,rev_id,0, IF(page_is_new != 0, 1, 0)  FROM `wiki_page`,`wiki_revision` 
WHERE (rev_timestamp > 20060301164330) AND (rev_page=page_id)
Function: rebuildRecentChangesTablePass1
Error: 1064 You have an error in your SQL syntax; check the manual that corresponds to your MySQL server 
version for the right syntax to use near '5000 INTO `wiki_recentchanges` (rc_timestamp,rc_cur_time,rc_user,
rc_user_text,rc' at line 1 (localhost)
Comment 12 Griff Phillips 2006-03-14 15:23:25 UTC
Hi Brion,

Yes, rebuildtextindex.php works fine for situations after I have just run an
Import, thanks for that.

(But I still need rebuildall.php to run in situations after I have made changes
to Language.php.)
Comment 13 Rob Church 2006-03-14 15:29:41 UTC
(In reply to comment #12)
> (But I still need rebuildall.php to run in situations after I have made changes
> to Language.php.)

Again, as a workaround; give rebuildMessages.php a whirl.

Comment 14 Brion Vibber 2006-04-04 06:07:19 UTC
Fixed on trunk in r13453.
Will be in 1.6.0; could be backported to 1.5.9 if desired.
Comment 15 Martin 2006-06-28 09:56:58 UTC
i vote for a backport to 1.5.9 because i use the unchanged distribution
from debian.

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links