1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Do you know how to scrape urls from page?

Discussion in 'Black Hat SEO Tools' started by bleach, Aug 24, 2010.

  1. bleach

    bleach Senior Member

    Joined:
    Oct 12, 2008
    Messages:
    934
    Likes Received:
    82
    Location:
    New York
    Do you know how to scrape urls from page?
    i want to scrap urls from page
     
  2. toptips44

    toptips44 Regular Member

    Joined:
    Jul 10, 2009
    Messages:
    249
    Likes Received:
    45
    Yes but there are many ways to do it. Which language do you want to use, or do you want a program to do it ?
     
  3. simpleonlinetest

    simpleonlinetest Regular Member

    Joined:
    Feb 18, 2010
    Messages:
    208
    Likes Received:
    25
    Ubot works great..you have to setup the page that you want to scrape using the software but it's pretty easy to do and no programming knowledge required.


    If your looking to create something like a Google scraper....then check out Footprint Finder.....it works great....f
     
  4. bleach

    bleach Senior Member

    Joined:
    Oct 12, 2008
    Messages:
    934
    Likes Received:
    82
    Location:
    New York
    ubot is suck with support
    i tried it before :(
     
  5. speakeasy602

    speakeasy602 Junior Member

    Joined:
    Aug 4, 2009
    Messages:
    126
    Likes Received:
    39
    I use iMacros SE, but it requires a little more skill editing macros than Ubot. Are you looking for something completely automated or a small macro that scrapes links from the browser?
     
  6. summertime1

    summertime1 Junior Member

    Joined:
    Jun 11, 2010
    Messages:
    130
    Likes Received:
    22
    are you looking for an application or for code?
     
  7. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Scrapebox -> Link Extractor -> enter url, select External links only (i.e. OBLs)

    then you will get all outgoing links on that page
     
  8. cnick79

    cnick79 Jr. VIP Jr. VIP

    Joined:
    Jun 10, 2010
    Messages:
    653
    Likes Received:
    341
    Location:
    Google's SandBox
    Yes I know how to scrape URLs from page. :stupid:
     
  9. .Oscar

    .Oscar Regular Member

    Joined:
    Jul 18, 2010
    Messages:
    414
    Likes Received:
    133
    Gender:
    Male
    • Open up scrapebox
    • Go to plugins
    • Url extractor
    • Check "internal"
    • Select link list "harvester"
    • Click start.

    Dont have scrapebox... Get it
     
    • Thanks Thanks x 1