This is my first experience with any kind of programming language. I purchased The Pragmatic Programmers Guide (for Ruby) aka "Pickaxe." I started to read through it, but found it dived in a bit too deep initially; making references to perl and not fully explaining the construction of the first example program, regardless of the aforementioned it looks to be a great guide for someone with a little more experience than myself. Ruby-lang.org led me to Chris Pine's tutorial which was excellent for someone who knows nothing, but I can't find anything that picks up where he leaves off that carries that same style and in depth teaching. Where I have interest in going with Ruby -Screen scraping eBay for specific products/information -(unrelated but need help finding this)Image recognition software -Web based management for screen scraping and storing of data/pdf creation of auctions could anyone point me in the right direction, maybe any articles on this stuff? I know of scrAPI and Ruby on Rails, but I am new and do need direction. Thanks in advance for your help. Cheers, Alex
on 2006-12-21 19:46
on 2006-12-21 21:25
Alexander York wrote: > someone who knows nothing, but I can't find anything that picks up where > stuff? I know of scrAPI and Ruby on Rails, but I am new and do need > direction. I have found "Ruby for Rails" the best fit for this situation (I also felt that the pickaxe is about a level or two higher what I needed in the beginning). Actually I just blogged about this: http://www.rubyrailways.com/book-review-ruby-cookbook/ (it is mainly a review of the Ruby cookbook, but the starting part is addressing your situation a bit). wrt the screen scraping: I am just finishing a (IMHO) very easy to use (=considerably easier than scrAPI since you need no CSS/XPath or any kind of special knowledge) yet quite powerful Web scraping framework called scRUBYt! (scRUBYt! eats ebay for breakfast ;-) - basically I am waiting for the release of HPricot 0.5 (I am using some features from the edge-Hpricot trunk) and I need to add a few minor features but basically I am more or less ready - the exact release time depends on _why more than on me I guess :). I would be more than happy if you could try it so I would have some real-life scenario feedback. Cheers, Peter __ http://www.rubyrailways.com
on 2006-12-22 04:41
Peter Szinek wrote: > I would be more than happy if you could try it so I would have some > real-life scenario feedback. > > Cheers, > Peter Thanks for the informative reply, the book looks promising and I would love to try out your scraper when it is ready. The scraping i will need to do is going to be pretty advanced I think. Could you shoot me your email address or is it on your site? Cheers, Alex
on 2006-12-22 05:42
Peter Szinek wrote: > I have found "Ruby for Rails" the best fit for this situation (I also > felt that the pickaxe is about a level or two higher what I needed in > the beginning). I second the suggestion of getting Ruby for Rails, regardless of any plans to use Rails. For screen-scraping, I wrote up my experience with Mechanize in creating rubystuff.com by extracting data from CafePress sites. http://www.neurogami.com/cafe-fetcher/ It may be a bit dated; Mechanize has changed some. I would also suggest looking into Hpricot; my recent site snarfing forays have been fairly pain-free thanks to this library. -- James Britt http://www.ruby-doc.org - Ruby Help & Documentation http://beginningruby.com - Beginning Ruby: The Online Book http://www.rubystuff.com - The Ruby Store for Ruby Stuff http://www.jamesbritt.com - Playing with Better Toys
on 2006-12-22 07:04
On 12/21/06, Alexander York <firstname.lastname@example.org> wrote: > > Where I have interest in going with Ruby > > -Screen scraping eBay for specific products/information > -(unrelated but need help finding this)Image recognition software > -Web based management for screen scraping and storing of data/pdf > creation of auctions Screen scraping is good fun and all, but have you looked into the web services APIs that eBay makes available? There may be much easier ways to get at data than screen scraping. Look at the "Developers" link at the bottom of their homepage.
on 2006-12-22 07:14
Troy Denkinger wrote: > On 12/21/06, Alexander York <email@example.com> wrote: >> >> Where I have interest in going with Ruby >> >> -Screen scraping eBay for specific products/information >> -(unrelated but need help finding this)Image recognition software >> -Web based management for screen scraping and storing of data/pdf >> creation of auctions > > > Screen scraping is good fun and all, but have you looked into the web > services APIs that eBay makes available? There may be much easier ways > to > get at data than screen scraping. Look at the "Developers" link at the > bottom of their homepage. Hmm looks like good advice, could you perhaps give me an example of how I could apply this with ruby? (I'm still new) I will need to be able to search a brand of products and search each individual auction for specific text.
on 2006-12-22 09:14