TestRandomStrings/TestRandomHugeStrings Failures

[paulirwin]

Is there an existing issue for this?

• I have searched the existing issues

Describe the bug

Split out from #269

The following tests fail with enough repeated iterations:

• Lucene.Net.Analysis.Th.TestThaiAnalyzer::TestRandomStrings()
• Lucene.Net.Analysis.Th.TestThaiAnalyzer::TestRandomHugeStrings()
• Lucene.Net.Analysis.Icu.TestICUTokenizerCJK::TestRandomStrings()
• Lucene.Net.Analysis.Icu.TestICUTokenizerCJK::TestRandomHugeStrings()
• Lucene.Net.Analysis.Icu.TestICUTokenizer::TestRandomStrings()
• Lucene.Net.Analysis.Icu.TestICUTokenizer::TestRandomHugeStrings()

These are all due to a bug in ICU4N, fixed in NightOwl888/ICU4N#96

Once an ICU4N release is published with this fix, we can remove the [AwaitsFix] from these tests and re-enable them.

Also, as part of fixing this, we should remove the static locking in these tokenizers to improve performance.

See: #313 (comment)

Expected Behavior

The tests pass.

Steps To Reproduce

Remove [AwaitsFix] attribute from these tests, and add a [Repeat(100)] (or higher count) attribute. May require running multiple times to reproduce due to it being a concurrency bug.

Exceptions (if any)

No response

Lucene.NET Version

No response

.NET Version

No response

Operating System

No response

Anything else?

No response