Mp3scrape

Ruby
1

NAME
mp3scrape

SYNOPSIS
mp3scrape uri [options]+

DESCRIPTION
mp3scrape will scour any url for it’s mp3 content - the script
mirrors,
never downloading the same file twice. it does not, however, crawl a
website for links, it simple scapes all the songs from a single page.

PARAMETERS
uri (1 → uri(uri))
the uri to scrape
–pattern=pattern, -p (0 ~> pattern='"
["'])
specifiy the mp3 pattern
–basedir=basedir, -b (0 ~> basedir=/Users/ahoward/mp3)
specifiy the base download dir - default(/Users/ahoward/mp3)
–destination=destination, -d (0 ~> destination)
specifiy the absolute download dir -
default(/Users/ahoward/mp3/auto-based-on-uri)
–list
only list the mp3s that would be scraped
–threads=threads, -t (0 ~> integer(threads=8))
specify the number of threads to download with in parallel -
default(8)
–noop, -n
show the downloads that would be performed
–help, -h

INSTALL
sudo gem install mp3scrape

URI
http://codeforpeople.com

EXAMPLES

  1. get a bunch of xmas tunes
    mp3scrape
    I AM FUEL, YOU ARE FRIENDS: Christmas mixery

  2. get a bunch of tunes
    mp2scrape http://troubledsoulsunite.blogspot.com/

a @ http://codeforpeople.com/

2

On Fri, Aug 1, 2008 at 1:10 PM, ara howard [email protected]
wrote:

website for links, it simple scapes all the songs from a single page.
default(/Users/ahoward/mp3/auto-based-on-uri)
sudo gem install mp3scrape

URI
http://codeforpeople.com

EXAMPLES

  1. get a bunch of xmas tunes
    mp3scrape I AM FUEL, YOU ARE FRIENDS: Christmas mixery

  2. get a bunch of tunes
    mp2scrape http://troubledsoulsunite.blogspot.com/

Nice, i’ve been doing similar stuff with a script of mine:
http://p.ramaze.net/1818

That i would use like:
curl -s I AM FUEL, YOU ARE FRIENDS: Christmas mixery
| uris | egrep ‘.mp3$’ | xargs wget

But thanks, I’ll check this one out :slight_smile:
^ manveru

3

On Aug 3, 2008, at 7:18 PM, Michael F. wrote:

Nice, i’ve been doing similar stuff with a script of mine:
http://p.ramaze.net/1818

That i would use like:
curl -s I AM FUEL, YOU ARE FRIENDS: Christmas mixery
| uris | egrep ‘.mp3$’ | xargs wget

But thanks, I’ll check this one out :slight_smile:
^ manveru

cool. my next plan is to make it crawl - but limiting is a big
issue… rfc :wink:

a @ http://codeforpeople.com/

4

Thanks for this gem, Ara.

Attached is a patch which changes mp3scrape to use Hpricot. It also
prepends
the supplied URL to relative URLs (that do not match with /^http:/).
This
allows mp3scrape to be used on pages such as

http://staff.telkomsa.net/packages/SRPMS/openldap/

to download RPMs instead. Please let me know what you think.

5

On Thu, Aug 7, 2008 at 9:08 AM, Joel VanderWerf
[email protected] wrote:

ara howard wrote:

mp3scrape will scour any url for it’s mp3 content - the script mirrors,
never downloading the same file twice. it does not, however, crawl a
website for links, it simple scapes all the songs from a single page.

Might be nice as a firefox plugin, too.

See http://www.downthemall.net/

^ manveru

6

ara howard wrote:

mp3scrape will scour any url for it’s mp3 content - the script mirrors,
never downloading the same file twice. it does not, however, crawl a
website for links, it simple scapes all the songs from a single page.

Might be nice as a firefox plugin, too.