Given a users search query my app goes off and scrapes a few sites and
provides the results to the user. The user can also choose to filter
these results even further by category, age etc and this will be updated
via ajax without refreshing. All result items are not static. Except for
its title the information for one item will change every 2 hours so
theres no point in caching the data to a database.
Given that i want to allow filtering of the results how should i go
about storing the results after scraping? There will be at most about
1000 results each comprising about 300chars.
Can i just store them in a @@results variable? How do i overcome the
wiping of the data whilst in development mode?
im new to rails but ive also read stuff on sessions, memcache etc but
not really sure if they are whats needed for this situtation?
Can anyone help?