1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scraping words from a website help?

Discussion in 'Black Hat SEO Tools' started by jezlad, Mar 17, 2013.

  1. jezlad

    jezlad Regular Member

    Joined:
    Dec 24, 2007
    Messages:
    251
    Likes Received:
    36
    Can anyone help me with a problem?

    I'm trying to scrape a list of all the usernames on this site.

    http://www.lolstatistics.com/ladders/solo5x5/

    What footprint in scrapebox or program would I need to get these 10,000 usernames?
     
  2. 0_00_0

    0_00_0 Senior Member

    Joined:
    Oct 7, 2010
    Messages:
    1,024
    Likes Received:
    486
    Location:
    Canada
    Whip up a quick script in autoit. It will take hardly any time and its very easy to automate IE with it. There are many other languages that you can do but this is a very easy task. Not sure you can do it with Scrapebox.
     
  3. ScrapeboxWorker

    ScrapeboxWorker Regular Member

    Joined:
    Jul 23, 2012
    Messages:
    465
    Likes Received:
    266
    Home Page:
    • Thanks Thanks x 1
  4. seriousjoker

    seriousjoker Registered Member

    Joined:
    Feb 12, 2013
    Messages:
    75
    Likes Received:
    33
    With jsoup or selenium or watij or watir you can scrap all of them, from path html>body>div#outer_content>div#content>table.gamelist>tbody>tr>td>a, you can extract the value of attribute "href".
     
  5. stubo1903

    stubo1903 Junior Member

    Joined:
    May 22, 2011
    Messages:
    120
    Likes Received:
    192
  6. seriousjoker

    seriousjoker Registered Member

    Joined:
    Feb 12, 2013
    Messages:
    75
    Likes Received:
    33
    I made a small scraper and scraped all the 24441 user name :ranger:
    But I do not know how to share it here as I cannot post link :pat:
     
  7. jezlad

    jezlad Regular Member

    Joined:
    Dec 24, 2007
    Messages:
    251
    Likes Received:
    36
    Awesome. Thanks.

    Now all I need to do is append them with common passwords and go hunting! muahahaha
     
  8. ampakine

    ampakine Newbie

    Joined:
    Jun 1, 2011
    Messages:
    1
    Likes Received:
    0
    That would be easy to do with PHP. Do you want me to whip up a quick script for you?

    To write a script to do that, just setup a loop for the number of pages of usernames (11161 in this case), then use file_get_contents() to get the source of each page, then just use preg_match to extract each username and add it to an txt file or xml file or whatever. I've made a few web spiders for different tasks in the past, a spider for this task would be very simple to make.

    If I make one for you, can you teach me some hacking related skills (I'm a beginner when it comes to hacking related topics) in return?
     
    Last edited: Mar 18, 2013