[fix](inverted index) better support for Chinese tokenizer with default conversion to lowercase

[zzzxl1993]

…ult conversion to lowercase

Proposed changes

#32841

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[zzzxl1993]

run buildall

[doris-robot]

TeamCity be ut coverage result:
Function Coverage: 37.79% (8075/21367)
Line Coverage: 29.45% (65927/223885)
Region Coverage: 28.92% (33941/117373)
Branch Coverage: 24.78% (17423/70306)
Coverage Report: http://coverage.selectdb-in.cc/coverage/245c7872fa1363c1289ede7256e385646482da4f_245c7872fa1363c1289ede7256e385646482da4f/report/index.html

[zzzxl1993]

run feut

[zzzxl1993]

run buildall

[doris-robot]

TeamCity be ut coverage result:
Function Coverage: 37.80% (8078/21369)
Line Coverage: 29.45% (65952/223911)
Region Coverage: 28.92% (33956/117398)
Branch Coverage: 24.78% (17427/70322)
Coverage Report: http://coverage.selectdb-in.cc/coverage/14b0d6772e4f947df1f80a1b3fa57fb5aa68f1d3_14b0d6772e4f947df1f80a1b3fa57fb5aa68f1d3/report/index.html

[zzzxl1993]

run p0