Thai Subject getting through killfiltering

Jaimie

Hi Andre - v1.27.2 build 383

rec.arts.sf.written has lately been splashed with a lot of Thai-language spam, eg today

I’ve picked out some Thai letters and put them into an “any” match against the subject, but despite definitely including the simple unaccented form of some letters in the title it doesn’t fire. Hard to see due to size, but there are definite matches:

I presume this is all down to character encoding mismatches between what Usenapp is looking for and what’s technically in the header, but is there any way to widen the scope so it’ll decode/encode and catch them?

Message-ID: d07866c6-6ab9-45a6-93bc-424918df14den@googlegroups.com
Subject: =?UTF-8?B?4p2H77iPIOC5gOC4muC4l+C4n+C4tOC4gTExIOKdh++4jyBCRVRGTElLMTEg4Liq4Lil?==?UTF-8?B?4LmH4Lit4LiVIOC4hOC4suC4quC4tOC5guC4mSDguJrguLLguITguLLguKPguYjguLIg4LmC4Lib4Lij?==?UTF-8?B?4LmC4Lih4LiK4Lix4LmI4LiZ4Liq4Lih4Liy4LiK4Li04LiB4LmD4Lir4Lih4LmIIOC5gOC4hOC4ow==?==?UTF-8?B?4LiU4Li04LiV4Lif4Lij4Li1?=
From: =?UTF-8?B?8J+SmuC4quC4peC5iuC4reC4leC5gOC4p+C5h+C4muC4leC4o+C4h/Cfkpog4Lid4Liy4LiBLQ==?==?UTF-8?B?4LiW4Lit4LiZIFdBTExFVA==?= sunisaphakdi589@gmail.com

I know 90% of computing issues come down to character encoding or DNS and I’m pretty sure this isnt DNS 🙂

Cheers! - Jaimie

Jaimie

Oh. So, when I’m in the Filters panel and “Apply selected” it works and deletes the Thai spam.

That seems diagnostically useful - at the original download time, is the filter routine running before a header normalisation step, when it should be afterwards?

Andre

Jaimie That seems diagnostically useful - at the original download time, is the filter routine running before a header normalisation step, when it should be afterwards?

Good question, let me check that for you.

Jaimie

There’s a fresh pile of thai spam in rec.arts.sf.written again today if you want it 🙂

Jaimie

Hm! This seems to be filtering the Thai spams okay on download now.

I went to https://rec.arts.sf.written.narkive.com/ and saw that some of the Thai threads were replied to in the last day, but I haven’t seen any of those reply posts in Usenapp. Perhaps I’m misinterpreting how it’s working.

Jaimie

Nope - still a problem, had one come through today.

Andre

It is almost impossible to fight spam. It seems to have increased a lot lately anyway