1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[HELP] - need help scraping a website v2

Discussion in 'Black Hat SEO' started by CosmicSoundz, Apr 19, 2013.

  1. CosmicSoundz

    CosmicSoundz BANNED BANNED

    Joined:
    Apr 30, 2012
    Messages:
    1,230
    Likes Received:
    1,296
    Ok so I have this web directory and here is how its structured.


    So if you dont understand let me explain.

    Each page has a list of company names. If you click on that link it will take you to the company profile page. On that page it has the company name, phone, website and physical address.

    All my scrappers I have cant go inner link then back out then inner link then back out. They can only scrape whats on the page and then go to the next page.

    SO... Any suggestions?
     
  2. ying-yang

    ying-yang BANNED BANNED

    Joined:
    Jul 18, 2010
    Messages:
    751
    Likes Received:
    101
    sorry no suggestions , but i do need an email scraping service if you know anyone who does it ??? thx...
     
  3. CosmicSoundz

    CosmicSoundz BANNED BANNED

    Joined:
    Apr 30, 2012
    Messages:
    1,230
    Likes Received:
    1,296
    PM sent
     
  4. Panther28

    Panther28 Elite Member

    Joined:
    May 2, 2010
    Messages:
    2,268
    Likes Received:
    3,405
    Occupation:
    Internet.
    Location:
    Internet.
    Download the full site, with httrack, and see if there is anything you can do with it offline? Obviously you have to set it to get links within pages.
     
  5. CosmicSoundz

    CosmicSoundz BANNED BANNED

    Joined:
    Apr 30, 2012
    Messages:
    1,230
    Likes Received:
    1,296
    hmm not sure what i can do with it online. I dont have anything that can scrape inner pages like that. Not that i know of anyway.

    I need it to be organized too. I dont want to just spit out a list of urls , addresses and company names.. they all have to be organized.