1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Tool Needed to Build list of URL's

Discussion in 'Black Hat SEO' started by CoyoteAssassin, Mar 18, 2011.

  1. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    I know that these tools are on here, but I am new to this side of things.

    I need a tool that will allow me to build a list of URL's from keywords on Google or another search engine.

    That's it. I do not need to post comments, build backlinks, or anything else.

    What recommendations do you all have?

    Thanks!
     
  2. roberteb

    roberteb Regular Member

    Joined:
    Oct 30, 2010
    Messages:
    402
    Likes Received:
    120
    Location:
    UK
    Even if you don't want to do comment spam ScrapeBox will do the job easily and quickly and is dirt cheap with the BHW link.
     
  3. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    I have owned it for more than a year but have never used it. I have it saved somewhere but not sure where. Thanks for the suggestion though!

    If anyone is willing to do this for me for a few keywords, I would greatly appreciate it. I highly doubt I am competition for you.

    Thanks.
     
  4. roberteb

    roberteb Regular Member

    Joined:
    Oct 30, 2010
    Messages:
    402
    Likes Received:
    120
    Location:
    UK
    If you have it you could do it yourself in a few mins. Use the built in Public Proxy finder shove your keywords in the box and start harvesting. Remove duplicates and you're good to go.

    If you like you can PM me the keywords and an Email address and I'll do it for you. How many are you looking to get?
     
    • Thanks Thanks x 1
  5. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    As many as possible.

    I'll send a PM to you.

    +3 rep waiting on you. :)
     
  6. igor1

    igor1 Newbie

    Joined:
    Jan 3, 2010
    Messages:
    35
    Likes Received:
    7
    Google URL harvester is you want something really simple.

    Demo http://www.youtube.c0m/watch?v=YW9Q6YsTKtc

    Install from here:
    Code:
    http://userscripts.org/scripts/show/42998 
    I agree with the previous poster; stopped using it after i bought Scrapebox.
     
    • Thanks Thanks x 1
    Last edited: Mar 18, 2011
  7. roberteb

    roberteb Regular Member

    Joined:
    Oct 30, 2010
    Messages:
    402
    Likes Received:
    120
    Location:
    UK
    CoyoteeAssassin Done let me know if you get them OK.
     
    • Thanks Thanks x 1
  8. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    +3 rep given. Thanks for your help.
     
  9. DisavowedKing

    DisavowedKing Regular Member

    Joined:
    Sep 1, 2010
    Messages:
    243
    Likes Received:
    84
    Gender:
    Male
    Occupation:
    Marketing - Email, Direct Mail, and Internet
    Location:
    San Diego, CA
    Really appreciate this. Helps out a lot.
     
  10. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA

    I some how skipped over this and did not see it.

    I installed this program yesterday and it has not worked for me. I am running Firefox 4 RC1. Is anyone else able to get it to work on RC1?

    Thanks!
     
  11. JenniferMartin

    JenniferMartin Regular Member

    Joined:
    Jan 29, 2011
    Messages:
    391
    Likes Received:
    699
    HI,

    PM me your keywords, i will do it for you :)
     
  12. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    Hey Jennifer. Thanks for your help.

    PM Sent.
     
  13. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    Can anyone else provide some tips on how I can extract a huge amount of URL's? I only want to scrape unique URLs.

    I will pay for results of 200k+

    Thanks!
     
  14. CyrusVirus

    CyrusVirus BANNED BANNED Premium Member

    Joined:
    Aug 20, 2009
    Messages:
    1,110
    Likes Received:
    686
    like robert said:

    get scrapebox, you don't have to use it for the commenting part, but you can use it for just 1 or 2 things on it.

    if you buy from this link:

    http://scrapebox.com/bhw

    then you get a HUGE discount,
     
  15. bk071

    bk071 Jr. Executive VIP Jr. VIP Premium Member

    Joined:
    Nov 24, 2010
    Messages:
    3,105
    Likes Received:
    7,917
    Occupation:
    I don't have a job
    Location:
    .............
    Why pay?
    Scrapebox is your best friend :)

    It can harvest as many URLs as you want with a blazing speed of 1000/sec. So you can easily scape 6Million URLs in an hour or so. Even if 70% of them are duplicate, you got a big list ;)

    I'll set up my SB on a VPS today. Let me know if you need any help regarding that. I'd be happy to be helpful :p

    Cheers,
    Bk...
     
  16. dribbleonline

    dribbleonline Registered Member

    Joined:
    Mar 15, 2011
    Messages:
    85
    Likes Received:
    18
    what about spider crawler?
     
  17. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    Thanks again all for your input. It sounds like I need to reinstall Scrapbox as I already own it.

    Will I need proxies for this and if so, apx how many?

    Thanks!
     
  18. bk071

    bk071 Jr. Executive VIP Jr. VIP Premium Member

    Joined:
    Nov 24, 2010
    Messages:
    3,105
    Likes Received:
    7,917
    Occupation:
    I don't have a job
    Location:
    .............
    Yeah you will need proxies. I'd recommend going for private proxies as they are fast and reliable.
    http://Yourprivateproxy.com is a nice option IMO.

    Cheers
    Bk...
     
    • Thanks Thanks x 1
  19. CoyoteAssassin

    CoyoteAssassin Elite Member

    Joined:
    Jan 3, 2010
    Messages:
    1,862
    Likes Received:
    3,906
    Occupation:
    Full Time IMer
    Location:
    USA
    I've seen them before and used them for a project last year.

    Thanks!
     
  20. JenniferMartin

    JenniferMartin Regular Member

    Joined:
    Jan 29, 2011
    Messages:
    391
    Likes Received:
    699
    Hey,

    Just send you url list, check ur email
     
    • Thanks Thanks x 1