Removing Whitespace using regexp

Hi,
Previously I posted a topic on how to strip all html tags and getting
the remaining text using regexp. Luckily I got one. This is the regexp:

/([^>])(?=<[^>]?>)/im

In this case I’m able to get all the data between the html tags. But one
small problem. I’m getting output like this :

Example Web Page

You have reached this web page by typing "example.com",
"example.net",
or "example.org" into your web browser.
These domain names are reserved for use in documentation and are not
available
for registration. See RFC
2606, Section 3.

This is the output which I get when I parse the html content of
example.com using the above regexp. Here you can see some white space
between the data(ie. between ‘Example web page’ and ‘You have
reached…’. These whitespaces are generated in place of the html tags
which I avoided using the above regexp. I want to remove those
whitespaces. I think that modifying the above regexp will give me the
right output without white spaces. Can somebody please help me.

Thanks
Arun

Hi,
Previously I posted a topic on how to strip all html tags and getting
the remaining text using regexp. Luckily I got one. This is the regexp:

/([^>])(?=<[^>]?>)/im

And what do you do with this regexp?

In this case I’m able to get all the data between the html tags. But one
small problem.

Hasn’t everybody told you, there are problems with parsing HTML with
regexps?

This is the output which I get when I parse the html content of
example.com using the above regexp. Here you can see some white space
between the data(ie. between ‘Example web page’ and ‘You have
reached…’. These whitespaces are generated in place of the html tags
which I avoided using the above regexp.

Really? Aren’t they just from all the meaningless whitespace that’s in
a typical HTML document?

I want to remove those
whitespaces. I think that modifying the above regexp will give me the
right output without white spaces. Can somebody please help me.

There are easy ways to strip all the whitespace, which is certainly not
what you want, and there is a simple way to reduce all runs of
whitespace
by just one space (gsub(/\s+/, ’ '), which probably also not what you
want.

Selectively removing some of the whitespace isn’t easy at all, but it is
probably a lot easier with a real HTML parser.

mfg, simon … l

Hey Arun,

How about doing a gsub on the output to remove white spaces.

For example:

“Example Web Page”.gsub(" “,”")

This would remove the white spaces.

Hope this helps.

Regards
Sriram.

I know your boss and whoever it is who is dangling your carrots won’t
let
you use Hpricot, but tell him you will use Hpricot to get properly
formatted
html and then write a parser to parse the properly formatted html. Even
he
can’t be opposed to that(seeing as how he wants you to reinvent wheels).
That way you can get rid of your whitespace problem and deal with the
cosmos
at large.

Jayanth

2009/5/6 Sriram V. [email protected]:

How about doing a gsub on the output to remove white spaces.

For example:

“Example Web Page”.gsub(" “,”")

This would remove the white spaces.

I would rather do

s.gsub /\s+/, ’ ’

Because your statement removes all whitespace:

irb(main):002:0> “Example Web Page”.gsub(" “,”")
=> “ExampleWebPage”

This is usually not what you want.

Hope this helps.

Dito.

Cheers

robert

I know your boss and whoever it is who is dangling your carrots won’t let
you use Hpricot, but tell him you will use Hpricot to get properly formatted
html and then write a parser to parse the properly formatted html. Even he
can’t be opposed to that(seeing as how he wants you to reinvent wheels).
That way you can get rid of your whitespace problem and deal with the cosmos
at large.

Here’s what we know about Arun from his previous posts…

  • he is a “trainee” doing assignments.
  • he is learning ruby
  • “nobody else” around him knows ruby
  • his “boss”/teacher is giving him specific assignments that seem to
    be purely academic exercises, because the constraints (e.g. don’t use
    gsub, parse “example.com”) would otherwise be completely ridiculous.
  • He doesn’t have the authority to re-scope the assignment or offer
    alternate solutions.

I believe he is asking us to do his homework.

How many places do you know that have extensive Ruby training programs
that
expect you to write HTML parsers armed with nothing but regular
expressions?
:wink:

I live in Bangalore, and I don’t know one. Either he truly has a
sadistic
boss, or his truth is stranger than fiction. I don’t doubt that it is
homework of some sort.

Jayanth

This forum is not affiliated to the Ruby language, Ruby on Rails framework, nor any Ruby applications discussed here.

| Privacy Policy | Terms of Service | Remote Ruby Jobs