Last modified: 2014-11-17 09:46:56 UTC
Our "list is based on one by Neil Harris, which was derived by unknown methods". At some point it will get easier to rely on CLDR, probably via the cldr MediaWiki extension. Documents: * http://www.unicode.org/reports/tr36/#visual_spoofing * http://www.unicode.org/reports/tr39/#Confusable_Detection Toy: * http://unicode.org/cldr/utility/confusables.jsp Data: * http://www.unicode.org/Public/security/revision-03/confusablesSummary.txt
(In reply to Nemo from comment #0) > * http://www.unicode.org/reports/tr39/#Confusable_Detection The author of which mentioned to me a certain ICU API... https://ssl.icu-project.org/apiref/icu4c/uspoof_8h.html#details
I've added bug 63242 as dependency: it seems that the standard ICU API can easily solve a concrete problem (in AbuseFilter) that has been intractable for years. Perhaps the old and new data sources can co-exist for a while, with the new ones being used first for user-invisible parts like the username creation and for new functions/interfaces like what proposed in bug 63242. When we're confident enough about the data quality (possibly after feeding CLDR with some of our own), and/or old interfaces are used less, we'll consider dropping the custom data sources.
(In reply to Nemo from comment #1) > (In reply to Nemo from comment #0) > > * http://www.unicode.org/reports/tr39/#Confusable_Detection > > The author of which mentioned to me a certain ICU API... > https://ssl.icu-project.org/apiref/icu4c/uspoof_8h.html#details That is, http://www.php.net/manual/en/class.spoofchecker.php
(In reply to Nemo from comment #0) > Our "list is based on one by Neil Harris, which was derived by unknown > methods". > At some point it will get easier to rely on CLDR, probably via the cldr > MediaWiki extension. > > Documents: > * http://www.unicode.org/reports/tr36/#visual_spoofing > * http://www.unicode.org/reports/tr39/#Confusable_Detection > > Toy: > * http://unicode.org/cldr/utility/confusables.jsp > > Data: > * http://www.unicode.org/Public/security/revision-03/confusablesSummary.txt It doesn't contains zh-hans / zh-hant pairs which are contained in current AntiSpoof equivsets.
(In reply to Liangent from comment #4) > It doesn't contains zh-hans / zh-hant pairs which are contained in current > AntiSpoof equivsets. Can you file a CLDR bug then please?
(In reply to Nemo from comment #5) > Can you file a CLDR bug then please? I can't find the CLDR bug tracker for confusable data...? Forgot to say -- there're also [[Variant Chinese character]]s, which create more confusion than simple traditional / simplified Chinese differences.
http://unicode.org/cldr/trac/ticket/7189
