Last modified: 2013-09-30 06:30:29 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T47795, the corresponding Phabricator task for complete and up-to-date bug report information.
First Last Prev Next    This bug is not in your last search results.
Bug 45795 - Excessive noise in log files due to attempts to reach non-existent host
Excessive noise in log files due to attempts to reach non-existent host
Status: RESOLVED FIXED
Product: Wikimedia
Classification: Unclassified
lucene-search-2 (Other open bugs)
unspecified
All All
: High normal (vote)
: ---
Assigned To: Nobody - You can work on this!
:
Depends on:
Blocks: code_quality
  Show dependency tree / graph
 
Reported: 2013-03-06 18:30 UTC by Munagala Ramanath (Ram)
Modified: 2013-09-30 06:30 UTC (History)
6 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Munagala Ramanath (Ram) 2013-03-06 18:30:26 UTC 
In the Lucene global config file lsearch-global-2.1.conf we map disabled indexes to a non-existent host named "search1000x". This causes a large number of exception stack traces to be dumped to the log file, for example on search1016:

ram@search1016:/a/search/log$ grep -c 'java.rmi.UnknownHostException: Unknown host: search1000x;' *
log:851206
log.2013-03-02:1130806
log.2013-03-03:1126806
log.2013-03-04:1125606
log.2013-03-05:1124406

This can be remedied by adding a property (such as 'nullHost') to explicitly identify a non-existent host and have the Java code ignore that host.
Comment 1 Munagala Ramanath (Ram) 2013-03-06 22:24:58 UTC 
Here is a sample of the stack trace from NetworkStatusThread:

2013-03-06 19:41:23,390 [Thread-14] WARN  org.wikimedia.lsearch.interoperability.RMIMessengerClient  - Cannot contact RMI registry for host search1000x : Unknown host: search1000x; nested exception is:
        java.net.UnknownHostException: search1000x
2013-03-06 19:41:23,390 [Thread-14] WARN  org.wikimedia.lsearch.search.NetworkStatusThread  - Host search1000x for fiu_vro-titles.tspart2 still down.
java.rmi.UnknownHostException: Unknown host: search1000x; nested exception is:
        java.net.UnknownHostException: search1000x
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:598)
        at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
        at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
        at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
        at org.wikimedia.lsearch.interoperability.RMIMessengerClient.messengerFromCache(RMIMessengerClient.java:135)
        at org.wikimedia.lsearch.interoperability.RMIMessengerClient.getSearcherPoolStatus(RMIMessengerClient.java:367)
        at org.wikimedia.lsearch.search.NetworkStatusThread.pingHosts(NetworkStatusThread.java:82)
        at org.wikimedia.lsearch.search.NetworkStatusThread.run(NetworkStatusThread.java:52)
Caused by: java.net.UnknownHostException: search1000x
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:195)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at org.wikimedia.lsearch.interoperability.CustomSocketFactory.createSocket(CustomSocketFactory.java:46)
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
        ... 8 more


And here is one from SearcherCache:

2013-03-06 20:38:38,482 [pool-1-thread-48] WARN  org.wikimedia.lsearch.search.SearcherCache  - Cannot get searcher status for en-titles.tspart2 on search1000x : Unknown host: search1000x; nested exception is:
        java.net.UnknownHostException: search1000x
java.rmi.UnknownHostException: Unknown host: search1000x; nested exception is:
        java.net.UnknownHostException: search1000x
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:598)
        at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
        at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
        at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
        at org.wikimedia.lsearch.interoperability.RMIMessengerClient.messengerFromCache(RMIMessengerClient.java:135)
        at org.wikimedia.lsearch.interoperability.RMIMessengerClient.getSearcherPoolStatus(RMIMessengerClient.java:367)
        at org.wikimedia.lsearch.search.SearcherCache.initializeRemote(SearcherCache.java:445)
        at org.wikimedia.lsearch.search.SearcherCache.initializeRemote(SearcherCache.java:432)
        at org.wikimedia.lsearch.search.SearcherCache.getRandomHost(SearcherCache.java:338)
        at org.wikimedia.lsearch.search.WikiSearcher.makeMultiSearcher(WikiSearcher.java:65)
        at org.wikimedia.lsearch.search.WikiSearcher.<init>(WikiSearcher.java:100)
        at org.wikimedia.lsearch.search.SearchEngine.fetchTitles(SearchEngine.java:898)
        at org.wikimedia.lsearch.search.SearchEngine.search(SearchEngine.java:731)
        at org.wikimedia.lsearch.search.SearchEngine.search(SearchEngine.java:136)
        at org.wikimedia.lsearch.frontend.SearchDaemon.processRequest(SearchDaemon.java:106)
        at org.wikimedia.lsearch.frontend.HttpHandler.handle(HttpHandler.java:197)
        at org.wikimedia.lsearch.frontend.HttpHandler.run(HttpHandler.java:114)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.UnknownHostException: search1000x
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:195)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at org.wikimedia.lsearch.interoperability.CustomSocketFactory.createSocket(CustomSocketFactory.java:46)
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
        ... 20 more
Comment 2 Munagala Ramanath (Ram) 2013-03-06 23:19:50 UTC 
Change-Id: Ia68eef0307fe69843ccfcd678b62c42e91e1d3ec
Change-Id: I2764c45a9ce4391b88576b9122142b47e900956e

Patch pushed for review.
Comment 3 Munagala Ramanath (Ram) 2013-03-15 16:47:43 UTC 
This patch is merged and now in production. Log files now are much less noisy.
Comment 4 Andre Klapper 2013-03-26 11:24:32 UTC 
[Merging "MediaWiki extensions/Lucene Search" into "Wikimedia/lucene-search2", see bug 46542. You can filter bugmail for: search-component-merge-20130326 ]
Comment 5 Gerrit Notification Bot 2013-04-16 22:13:02 UTC 
Related URL: https://gerrit.wikimedia.org/r/59533 (Gerrit Change Ie6be47113e57b8419d041909bff458b171b263a0)
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.

Navigation
Links