Highlight method creates malformed characters


#1

Hello list,

I’ve just updated to 0.11.3 and I came upon this problem.
When using the highlight function in a rails application I sometimes
get the error “Malformed UTF-8 character.”

It is just on certain documents and if I change the excerpt length
the error disappears so it feels that if the highlight method cuts
the text at the wrong character the function returns a string with
malformed characters.
This then causes the error when the text is outputted.

Is this a problem with ferret or with rails?
I’m still on 1.1.6 and I haven’t upgraded to rails 1.2 yet so I’m not
using the new multi byte unicode functions.

Regards,
henrik


#2

On 3/6/07, Henrik Z. removed_email_address@domain.invalid wrote:

This then causes the error when the text is outputted.

Is this a problem with ferret or with rails?
I’m still on 1.1.6 and I haven’t upgraded to rails 1.2 yet so I’m not
using the new multi byte unicode functions.

Hi Henrik,
This must be a problem with Ferret. I’m not sure how it is happening
though. If you can narrow it down to a failing test case it would be
really helpful.

Thanks,
Dave


#3

6 mar 2007 kl. 12:04 skrev David B.:

malformed characters.
This then causes the error when the text is outputted.

Is this a problem with ferret or with rails?
I’m still on 1.1.6 and I haven’t upgraded to rails 1.2 yet so I’m not
using the new multi byte unicode functions.

Hi Henrik,
This must be a problem with Ferret. I’m not sure how it is happening
though. If you can narrow it down to a failing test case it would be
really helpful.

Hi Dave,

I’ll do some more testing and I’ll try to present a small test case
for you.

You’ll have it in a day or two.

Cheers,
Henrik


#4

On 3/6/07, Henrik Z. removed_email_address@domain.invalid wrote:

Hi Dave,

I’ll do some more testing and I’ll try to present a small test case
for you.

You’ll have it in a day or two.

Hi Henrik,

If it is any easier, all I probably need is the failing search string.
It’d be even better if you could give me the matching text that is
supposed to be highlighted but I can probably work it out from there.

Cheers,
Dave


Dave Balmain
http://www.davebalmain.com/