Last modified: 2012-10-17 19:22:45 UTC
mediawiki-config$ git fetch origin +refs/changes/*:refs/changes/* fatal: git fetch_pack: expected ACK/NAK, got 'ERR want 52e7dd5c76cd4c6e673a9aa6cc7cadee9ad77fb7 not valid' fatal: internal server error Broken server repo? Upgraded gerrit now rejects a previously accepted changeset? I do have 52e7dd in Working copy. Tested from 4d12ee39 (2012-09-07 17:57:04)
Same error here.
Have you read Chad's announcement on wikitech-l?
Yes, he saw it.
Seems that the gerrit server misses several patchsets from https://gerrit.wikimedia.org/r/12185 $ ls .git/refs/changes/85/12185 1 2 3 4 8 9 10 11 12 13 14 15 16 and is then trying to get them from the pulling client, which panics. I have all the blobs, but seems that when trying to pull, it overwrote my local copy of the changes references, since they are now missing here.
(In reply to comment #4) > Seems that the gerrit server misses several patchsets from > https://gerrit.wikimedia.org/r/12185 > > $ ls .git/refs/changes/85/12185 > 1 2 3 4 8 9 10 11 12 13 14 15 16 > > and is then trying to get them from the pulling client, which panics. > > I have all the blobs, but seems that when trying to pull, it overwrote my local > copy of the changes references, since they are now missing here. The refs are actually present on the server: root@manganese:/var/lib/gerrit2/review_site/git/operations/mediawiki-config.git/refs/changes/85/12185# ls 1 10 11 12 13 14 15 16 2 3 4 5 6 7 8 9 But the ones that are missing in your clone (5, 6 and 7) point to hashes that are missing: 5:51661c745ae294e736f383e4f5fdc413003b3dfc 6:b77ecd76ea9bdd29733a7763fb6d83083d9e0ed2 7:52e7dd5c76cd4c6e673a9aa6cc7cadee9ad77fb7 For each of these, I get: # git show 52e7dd5c76cd4c6e673a9aa6cc7cadee9ad77fb7 fatal: bad object 52e7dd5c76cd4c6e673a9aa6cc7cadee9ad77fb7 Whereas the other patchsets point to refs that it did find. git fsck tells me about these: # git fsck --full --no-reflogs error: refs/changes/85/12185/5 does not point to a valid object! error: refs/changes/85/12185/6 does not point to a valid object! error: refs/changes/85/12185/7 does not point to a valid object! This is concerning, because I didn't get these errors before; it looks like somehow Gerrit is losing *more data*. If you have these three commits locally, could you help me restore them? You can do that as follows: $ git push Gerrit change #51661c745ae294e736f383e4f5fdc413003b3dfc:refs/heads/sandbox/platonides/12185-5 $ git push gerrit b77ecd76ea9bdd29733a7763fb6d83083d9e0ed2:refs/heads/sandbox/platonides/12185-6 $ git push Gerrit change #52e7dd5c76cd4c6e673a9aa6cc7cadee9ad77fb7:refs/heads/sandbox/platonides/12185-7 This would create branches in your sandbox space that contain these changes, and it should also automatically fix the error because it will cause the relevant commits to come back into existence on manganese.
Ping. What's the status on this? I know the commits are still missing since gerrit complains on replication.
I completely missed Roan reply. :( Seems I no longer have those objects. In fact, not even the references to any of changes/85/12185 They must have been removed by git gc. They are there in gitweb, though. We could obtain them from there. Even manually if needed (although that would be quite hard).
Forget about comment 7, I had been looking at mediawiki/core instead of mediawiki-config. Pushed to the heads mentioned by Roan.
Woooooo, WOKSFORME now. -> FIXED
Kicked off a manual replication of the project to the slave to double check. No errors, so this is indeed fixed. Thanks Platonides!
You are welcome :D