1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Making Money With Data From Web Scraping?

Discussion in 'BlackHat Lounge' started by yellowcat, Feb 9, 2017.

Tags:
  1. yellowcat

    yellowcat Regular Member

    Joined:
    Aug 27, 2015
    Messages:
    305
    Likes Received:
    176
    Location:
    internet 24/7
    Home Page:
    Hey all, i feel i am pretty proficient at scraping data from 95% of websites online.
    I was wondering if anyone had any ideas of how one could profit from this information.

    I was thinking of scraping sites like yelp/business directories then re-posting it on my own site.

    I have the skills to create custom tools just not sure on what i should use them for :/
     
  2. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,787
    Likes Received:
    11,434
    Occupation:
    COINZ
    Location:
    BUYAH
    Home Page:
    Every job involves some kind of scraping. Images, etc.

    It's what you do later that counts. Can you categorize the images? The text? And so on.
     
  3. yellowcat

    yellowcat Regular Member

    Joined:
    Aug 27, 2015
    Messages:
    305
    Likes Received:
    176
    Location:
    internet 24/7
    Home Page:
    Of course i can categorize images/text, Every job involves scraping? This seems a little over the top.
    Could you elaborate on what jobs, would be helpful :)

    I see on your website you have bulk lists of links for for Facebook ( https://zeminer.com/lists/facebook ) I was wondering what is the purpose behind having Facebook Page Lists. How does this benefit someone ?
    edit#2 i'm assuming people would want quality id lists scraped for advertising.
     
    Last edited: Feb 9, 2017
  4. Pinktoe

    Pinktoe Regular Member

    Joined:
    Sep 26, 2016
    Messages:
    353
    Likes Received:
    173
    I would pay for this service, I just pm'd you
     
  5. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,787
    Likes Received:
    11,434
    Occupation:
    COINZ
    Location:
    BUYAH
    Home Page:
    What jobs? Look around the journeys section and see. You need to collect emails, or collect users that are members of a group, or collect users which like something that you later will sell, you'll want to scrape those same users' info for your marketing.

    ZeMiner FB lists contain URLs to FB page id mapping. When you find a URL in there that interests you and you want to compete with them, you can use a different bot to scrape data from a Facebook page based on that ID. Or just do https://graph.facebook.com/ID to query info about the page.

    For example, you can get the users who like that FB page as they're already selected by that particular URL, so you can use that to promote your own site to compete with URL. Others use those lists to find competitors based on Adsense IDs or Analytics IDs.
     
  6. terrycody

    terrycody Elite Member

    Joined:
    Sep 29, 2012
    Messages:
    1,526
    Likes Received:
    432
    Occupation:
    marketer
    Location:
    Hell
    Your skill is very very helpful, especially when building some "passive" sites, like HD windows background image site, etc PIC site, and recently a guy in BHW here posted his journey, to scrape movie info and repost to his site, aimed to $10K a month.

    I was always envy such skills lol, but I have 0 knowledge of coding, could you tell us what skills you have learned to reach today's YOU? If detailed as much as possible would be very appreciated!
     
  7. yellowcat

    yellowcat Regular Member

    Joined:
    Aug 27, 2015
    Messages:
    305
    Likes Received:
    176
    Location:
    internet 24/7
    Home Page:
    Yeah i made a video site too but didn't know how to gain traffic to it so i dropped that project.

    " HD windows background image site" That seems like a pretty good niche thanks

    I started with python/selenium then moved onto bs4/lxml/scrapy/requests

    If you are willing to learn i could teach you ;) send me a pm
     
    Last edited: Feb 9, 2017
  8. W9go

    W9go Elite Member

    Joined:
    May 16, 2011
    Messages:
    5,210
    Likes Received:
    1,089
    Gender:
    Male
    Occupation:
    chasing girls
    Location:
    chasing girls
    images are quite risky because of copyright claims ...... and sooner or later there will be one.
     
  9. yellowcat

    yellowcat Regular Member

    Joined:
    Aug 27, 2015
    Messages:
    305
    Likes Received:
    176
    Location:
    internet 24/7
    Home Page:
    I understand using facebook id's for targeting
    But how does one do this for "Google Adsense/Analytics IDs"
    What useful data comes from adsense and analytical id's that can be put to use for targeting ?.,,.?
     
  10. yellowcat

    yellowcat Regular Member

    Joined:
    Aug 27, 2015
    Messages:
    305
    Likes Received:
    176
    Location:
    internet 24/7
    Home Page:
    True id look for none copy righted images though :)
     
  11. Capo Dei Capi

    Capo Dei Capi BANNED BANNED

    Joined:
    Oct 23, 2014
    Messages:
    754
    Likes Received:
    7,211
    Depending on the project, where you are and who and where the copyrighted images are from you can use copyrighted images without any issue.
     
    • Thanks Thanks x 3
  12. ladyboyboom69

    ladyboyboom69 Regular Member

    Joined:
    Feb 15, 2016
    Messages:
    309
    Likes Received:
    104
    Occupation:
    Tony Stark
    Location:
    Your closet
    Hello Just sent you a PM highly interested also where are you located?
     
  13. mynameisfrankenstein

    mynameisfrankenstein Regular Member

    Joined:
    Apr 2, 2015
    Messages:
    431
    Likes Received:
    346
    Gender:
    Male
    Location:
    BC, Canada
    Lol I took a look at your data, it's very interesting. I liked the list of links that are owned by Facecrooks.

    Especially this one: http://www.virtualrealityscam.net/

    Wtf... they don't want anyone outing their Oculus scam :D


    At YellowCat... user @outscrape has written some nice threads on scraping
    https://www.blackhatworld.com/seo/b...ow-to-make-money-with-scraped-content.902232/
    https://www.blackhatworld.com/seo/t...h-scraped-content-real-estate-edition.909300/
     
    • Thanks Thanks x 2
  14. yellowcat

    yellowcat Regular Member

    Joined:
    Aug 27, 2015
    Messages:
    305
    Likes Received:
    176
    Location:
    internet 24/7
    Home Page:
    Thanks for the links
     
  15. thisisnotadrill

    thisisnotadrill Newbie

    Joined:
    Feb 9, 2017
    Messages:
    26
    Likes Received:
    1
    Gender:
    Male
    Drop me a pm
     
  16. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,787
    Likes Received:
    11,434
    Occupation:
    COINZ
    Location:
    BUYAH
    Home Page:
    Great links!

    Be creative mate!
     
  17. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,787
    Likes Received:
    11,434
    Occupation:
    COINZ
    Location:
    BUYAH
    Home Page:
  18. LennyFreeman

    LennyFreeman Newbie

    Joined:
    Feb 25, 2017
    Messages:
    17
    Likes Received:
    1
    Hi
    I am interested in your services. I need a scraping master :)
    Please PM me
    thanks