1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Free Scrapers - Tell Me What You Want!

Discussion in 'Black Hat SEO Tools' started by macdonjo3, Dec 21, 2013.

Thread Status:
Not open for further replies.
  1. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,564
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    I'm a novice programmer, with a pretty good handle on data scraping. In order to get more experience, I'm looking to make website scrapers for BHW members. Just reply below (or PM me if you really have to) with a very detailed explanation of what you're looking for. I'll choose the ideas I like the best, program them and I'll post the link here to get the .exe file when it's done. I will share all of the free bots that I make to the BHW community.
     
    • Thanks Thanks x 13
  2. ericsson

    ericsson Elite Member Premium Member

    Joined:
    Apr 25, 2009
    Messages:
    2,642
    Likes Received:
    8,132
    Occupation:
    www
    Location:
    Swe
    Home Page:
    Hi, Mcdon!

    A form of scraper that can list available domains to register from a keyword list?

    /Jim
     
  3. Asif WILSON Khan

    Asif WILSON Khan Executive VIP Premium Member

    Joined:
    Nov 10, 2012
    Messages:
    10,132
    Likes Received:
    28,598
    Gender:
    Male
    Occupation:
    Fun Lovin' Criminal
    Location:
    London
    Home Page:
    I would like a scraper for BHW that scrapes email addresses and Skype ID's, then compares matches to find duplicate/banned accounts.



    j/k
     
    • Thanks Thanks x 4
  4. algprince

    algprince Newbie

    Joined:
    Nov 2, 2009
    Messages:
    44
    Likes Received:
    6
    really want a manta com scraper that scrapes manta profile link,business name,website url,email address,and if it is possible facebook page and twitter page :) all these infos are on a manta profile page of a business.
    hope it's not too mutch . thanks.
     
  5. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,564
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    Do you want exact match, or similar keywords?
     
  6. drsyr75

    drsyr75 Newbie

    Joined:
    Dec 21, 2013
    Messages:
    1
    Likes Received:
    0
    Hi,

    I can not PM you. As new here.
    I would like to have any scraper please or even if you have url scraper v1.4 !
    That would be appreciated.

    Thanks
     
  7. Seanblaque

    Seanblaque Newbie

    Joined:
    Dec 28, 2012
    Messages:
    13
    Likes Received:
    0
    Occupation:
    Self Employed
    Location:
    Georgia
    Home Page:
    Would you be open to doing a scraper for social media sites?
     
  8. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,564
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    Please be more specific as to what you want made.

    Yes, what are you thinking?
     
  9. YouFeelMeDawg?

    YouFeelMeDawg? BANNED BANNED

    Joined:
    Aug 10, 2011
    Messages:
    266
    Likes Received:
    371
    WOW, your back man! wtf happened to you.
     
  10. intrepid

    intrepid Regular Member

    Joined:
    Jun 27, 2011
    Messages:
    318
    Likes Received:
    47
    I second this type of scraper but include phone numbers and ALL contacts per listing. Thanks.
     
  11. KELLOGGS

    KELLOGGS Supreme Member

    Joined:
    Aug 3, 2012
    Messages:
    1,413
    Likes Received:
    1,393
    Location:
    London (more or less)
    Two options:

    One builds on the scraper mentioned above. Able to find local leads given a keyword from Manta, Yellow Pages, Yelp etc. Search "doctor" and get contact details for doctors in a given area.

    A twitter scraper for harvesting Tweets. Input a popular account's URL and then end up with a list of Tweets in a CSV.
     
  12. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,564
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
  13. vaidavytas

    vaidavytas Power Member

    Joined:
    Mar 21, 2011
    Messages:
    521
    Likes Received:
    189
    Gender:
    Male
    Occupation:
    IM
    Location:
    Online
    It would be great to have a scraper which scrapes 2-5 word keywords from chosen website, or it's specific pages.
     
  14. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,564
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    Summarizing the above:

    1. Manta scraper, given business type and location.
    2. Tweet harvester, given twitter account.
    3. Keyword scraper, given a webpage.

    Get your votes in for what next. I'm going to start another shortly.
     
  15. jbelland

    jbelland Newbie

    Joined:
    Dec 23, 2013
    Messages:
    1
    Likes Received:
    0
    A Google scraper that extracts all bold keywords from the meta descriptions to collect LSI Data.
     
  16. KELLOGGS

    KELLOGGS Supreme Member

    Joined:
    Aug 3, 2012
    Messages:
    1,413
    Likes Received:
    1,393
    Location:
    London (more or less)
    That's a good order of priority IMO. 1-> 3 I mean.
     
  17. tahworld

    tahworld Regular Member

    Joined:
    Aug 16, 2013
    Messages:
    457
    Likes Received:
    393
    Location:
    ✔✔✔✔✔✔✔
    I would love to have a scraper that can scrape every email ending in a specific domain.

    for example, every email ending in @example123456789.com

    But not limited to searching just that website for it.

    That would be pretty neat.
     
  18. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,564
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    How would the semantics work behind that? It seems you want to scrape every website on the web, and only show the emails that are hosted on a certain domain. That's a bit inefficient.
     
  19. tahworld

    tahworld Regular Member

    Joined:
    Aug 16, 2013
    Messages:
    457
    Likes Received:
    393
    Location:
    ✔✔✔✔✔✔✔
    I should have been more clear.
    I was thinking of something like intext:domain.com
    Then scraping those sites.
     
  20. richardbraceros

    richardbraceros Regular Member

    Joined:
    Mar 9, 2012
    Messages:
    287
    Likes Received:
    67
    Location:
    HELL
    A tumblr or blogger expired blog scraper w/PR or without... =D
     
Thread Status:
Not open for further replies.