Copying a website

OnlineGodfather

Senior Member

Mar 3, 2010

1,122

413

• Aug 9, 2011

• #21

Httrack does the job done for me. For simple stuff.

 

hgear

Power Member

Feb 8, 2008

546

197

• Aug 9, 2011

• #22

I think about $125 and you can get any site copied.. I pefer to outsource this work since I'm not that technical with css and all that stuff

 

B

Baybo.it

Registered Member

Aug 9, 2011

73

40

• Aug 10, 2011

• #23

On Linux machines, wget can be used to recursively pull down a webpage as well as all the images and dependencies referenced. As noted, this works only for static websites and will not retrieve a website's server-side dynamic code.

 

seeplusplus

Power Member

Aug 18, 2008

525

179

• Aug 10, 2011

• #24

Baybo.it said:

On Linux machines, wget can be used to recursively pull down a webpage as well as all the images and dependencies referenced. As noted, this works only for static websites and will not retrieve a website's server-side dynamic code.

Click to expand...

Yeah, works a treat.

Code:

wget -r -p -e robots=off -U mozilla http://www.domainname.com/

The above command rips the website, ignores the robots.txt file and uses a firefox user agent.

 

orzyman

Senior Member

May 22, 2011

807

198

• Aug 10, 2011

• #25

i have also been wondering about this for some time now nice thread