scraping techniques

Discussion in 'Visual Basic .NET' started by mward, Oct 19, 2010.

  1. mward

    mward Newbie

    Joined:
    Oct 19, 2010
    Messages:
    43
    Likes Received:
    3
    Occupation:
    manager
    Location:
    uk
    what rules should people follow to scrape undetected, changing user agent, ip ? what are the main variables.
     
  2. patmiller27

    patmiller27 BANNED BANNED

    Joined:
    Jul 25, 2010
    Messages:
    179
    Likes Received:
    190
    That is your first post.. read before asking such questions... you will find a lot of info on this forum
     
  3. mward

    mward Newbie

    Joined:
    Oct 19, 2010
    Messages:
    43
    Likes Received:
    3
    Occupation:
    manager
    Location:
    uk
    some more information is need, the scraping must occur on a website, as we scrape sales content to aggregate onto one site, site is .net.
     
  4. mward

    mward Newbie

    Joined:
    Oct 19, 2010
    Messages:
    43
    Likes Received:
    3
    Occupation:
    manager
    Location:
    uk
    I am looking for some advise on what to configure, user agent? Request images? Refferer. Happy to pay for help.
    Posted via Mobile Device