1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

wget scrape images on photobucket

Discussion in 'General Programming Chat' started by Ruriko, May 5, 2008.

  1. Ruriko

    Ruriko Power Member

    Joined:
    May 4, 2008
    Messages:
    525
    Likes Received:
    12
    Can someone tell me the command for wget to scrape all the images on photobucket? For example I want to grab all the pics on this tag http://photobucket.com/images/banana/ I don't want it to scrape the thumbnails but I want the full sized pictures.
     
  2. MoneyMafia

    MoneyMafia Regular Member

    Joined:
    Dec 2, 2007
    Messages:
    290
    Likes Received:
    310
    Well you need a script to do

    1 - Get the urls from all pages of selected keyword
    2 - Visit the url with cURL and grab the URL of the picture
    3 - Got with Curl on the url of the picture
    4 - Get the content and save it to file
     
  3. boomboomer

    boomboomer Executive VIP

    Joined:
    Feb 7, 2008
    Messages:
    705
    Likes Received:
    865
    If you can code, MoneyMafia has mentioned the specs of the script you need to write.

    If you can't code, you can get this done cheaply at rentacoder or other sites. You should also check out the freelance jobs section of this forum ..
     
  4. indieinc

    indieinc Newbie

    Joined:
    Apr 2, 2008
    Messages:
    7
    Likes Received:
    0
    nah save your money you can grab files recursively with wget... heres how you can do it for mp3's

    http://www.granneman.com/techinfo/tools/grabwebcontent/wget.htm
     
  5. boomboomer

    boomboomer Executive VIP

    Joined:
    Feb 7, 2008
    Messages:
    705
    Likes Received:
    865
    indieinc, that would work if Ruriko wanted all image files. Turns out he wants to exclude the thumbnails .. that would require some form of custom coding ..