scraping techniques

M

mward

Newbie

Oct 19, 2010

43

3

• Oct 19, 2010

• #1

what rules should people follow to scrape undetected, changing user agent, ip ? what are the main variables.

 

P

patmiller27

BANNED

Jul 25, 2010

179

192

• Oct 19, 2010

• #2

That is your first post.. read before asking such questions... you will find a lot of info on this forum

 

M

mward

Newbie

Oct 19, 2010

43

3

• Oct 19, 2010
• Thread Starter Thread Starter

• #3

some more information is need, the scraping must occur on a website, as we scrape sales content to aggregate onto one site, site is .net.

 

M

mward

Newbie

Oct 19, 2010

43

3

• Oct 21, 2010
• Thread Starter Thread Starter

• #4

I am looking for some advise on what to configure, user agent? Request images? Refferer. Happy to pay for help.
Posted via Mobile Device