1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

scraping techniques

Discussion in 'Visual Basic .NET' started by mward, Oct 19, 2010.

  1. mward

    mward Newbie

    Joined:
    Oct 19, 2010
    Messages:
    43
    Likes Received:
    3
    Occupation:
    manager
    Location:
    uk
    what rules should people follow to scrape undetected, changing user agent, ip ? what are the main variables.
     
  2. patmiller27

    patmiller27 BANNED BANNED

    Joined:
    Jul 25, 2010
    Messages:
    179
    Likes Received:
    190
    That is your first post.. read before asking such questions... you will find a lot of info on this forum
     
  3. mward

    mward Newbie

    Joined:
    Oct 19, 2010
    Messages:
    43
    Likes Received:
    3
    Occupation:
    manager
    Location:
    uk
    some more information is need, the scraping must occur on a website, as we scrape sales content to aggregate onto one site, site is .net.
     
  4. mward

    mward Newbie

    Joined:
    Oct 19, 2010
    Messages:
    43
    Likes Received:
    3
    Occupation:
    manager
    Location:
    uk
    I am looking for some advise on what to configure, user agent? Request images? Refferer. Happy to pay for help.
    Posted via Mobile Device