Commit graph

7 commits

Author SHA1 Message Date
Konstantin Isakov d66d4269ad *! When performing diacritics folding, weed out any combining marks which
managed to get past the normal diacritic folding routine.
2009-08-04 22:57:08 +00:00
Konstantin Isakov 7e503fcedd * Dsl articles now render and behave more closely to the original Lingvo. 2009-05-10 15:44:21 +00:00
Konstantin Isakov babde3d53d *! Introduce gd::wstring and gd:wchar and switch to them from std::wstring and
wchar_t. This changes nothing on Linux and most other systems, but on Win32
   it causes to use normal UCS-4 strings instead of Win32's usual UTF-16.
2009-04-18 17:20:12 +00:00
Konstantin Isakov 01a0ee113c + Add fullcase folding phase when ranking words in wordFinder.
+ Add Folding::trimWhitespaceOrPunct() function, which will be used later.
2009-04-08 21:22:50 +00:00
Konstantin Isakov 41b312074c + Folding algoritms now incorporate punctuation and whitespace folding.
+ When headwords contain multiple words, each of them is indexed now.
+ Wordfinder now employs an intelligent, rank-based sorting algoritm.
2009-04-08 16:02:12 +00:00
Konstantin Isakov 4bae99aeb5 Mass-update email to point to a @berlios one. 2009-02-05 14:21:47 +00:00
Konstantin Isakov c05781368b Created /trunk/src and moved everything there. 2009-01-28 20:55:45 +00:00