how to rip a site?

Paranoid Android · Oct 6, 2010

ok guys, so i managed to make quite good looking site with weebly, but i don't like their footer advertising their service, and i don't want it to be hosted with them either, one prime reason being their servers are too slow, and would rather host it on my servers.

how do i rip a site? I searched google and found all sorts of misleading info, any tips would be highly appericiated.

Chief Ranker · Oct 6, 2010

I could copy it for you, I'd just do it from scratch and redesign the thing for you.

intrug · Oct 6, 2010

there is a firefox plugin called "Save complete as" Google it and u can rip the whole site..
its different from normall save page as ...
It will be handy and u can edit the HTML which has been ripped off..

millhugz · Oct 6, 2010

Too bad that won't work for scripts and stuff.. it would only work for plain html sites.

wickedguy · Oct 6, 2010

1. First get the page contents with curl.
2. Then do regex for stuff you want on the page, like this: IN PHP

PHP:

$pattern='/<title>(.*?)<\/title>/si';
preg_match($pattern, $data,$match);
$title = $match[1];

Now you have a starting point, huh?

Paranoid Android · Oct 6, 2010

intrug said:
there is a firefox plugin called "Save complete as" Google it and u can rip the whole site..
its different from normall save page as ...
It will be handy and u can edit the HTML which has been ripped off..

thanks intrug, its a good idea, will try that in some time

any other advise guys?

dheer · Oct 6, 2010

try IDM

goldstrike4u · Oct 6, 2010

free site ripper program is httrack

toxicco · Oct 6, 2010

There are some programs out there on the internet that can help you rip the html websites off such as drk-spider and other web spiders .To make it simple for you is to go to the source of the page and copy the source intro an notepad and after user the web-spiders to locate the css files and the pictures to rip it complete.[This rip is for HTML websites only ]

As for the PHP and other web coded pages wickedguy given you a good start , but there are payd programers that can do the rip of the script.

madlind · Oct 6, 2010

toxicco said:
As for the PHP and other web coded pages wickedguy given you a good start , but there are payd programers that can do the rip of the script.

I may need something similar done, however what wickedguy said meant nothing to me. Any idea what it would cost for a paid programmer to do this? Just an estimate.

toxicco · Oct 7, 2010

if you want i can rip the website if its coded in HTML

mydomainidea · Oct 7, 2010

Hey I created a thread a couple month ago about this

Check it here

Code:

http://www.blackhatworld.com/blackhat-seo/black-hat-seo-tools/225930-guide-how-rip-website-1-minute.html

madlind · Oct 7, 2010

toxicco said:
if you want i can rip the website if its coded in HTML

Thanks for your reply. I have Winhttrack, but it doesn't work to get the script, or database files. I really need the script for a house swap site, and the only thing I can find is a paid script, however there are endless house swap sites out there, and I really don't think many of them paid for this script, and I don't want to either!

I have already managed to rip the html files from one of the sites, but its not much good to me without the script, but thanks anyway for your offer.

madlind · Oct 7, 2010

mydomainidea said:
Hey I created a thread a couple month ago about this

Check it here

Code:

http://www.blackhatworld.com/blackhat-seo/black-hat-seo-tools/225930-guide-how-rip-website-1-minute.html

Thanks very much for your help. I read through the thread. I have tried with winhttrack but it won't rip the sript. I couldn't find webextractor on torrents, but did find an open source one which I have downloaded and am about to try. If not I will try the other one that you mentioned if I can find it.

Your help is much appreciated

lived66 · Oct 7, 2010

If you're using mac, you can try:

Code:

http://www.sitesucker.us/mac.html

madlind · Oct 8, 2010

lived66 said:
If you're using mac, you can try:

Code:

http://www.sitesucker.us/mac.html

Thanks, but not using Mac, that may help someone else though with the same problem.

titan_lyy · Oct 13, 2010

i wanna rip a college paper site, with over 200,000 pages.. anyone could do it for me?

behealthy · Oct 14, 2010

....Or there is another firefox plugin called Firebug. You can edit/copy whatever website you are on IN REALTIME - change logos and rewrite texts and see it live on the actual website you want to rip/copy. Excellent plugin.

https://addons.mozilla.org/en-US/firefox/addon/1843/

millhugz · Oct 15, 2010

behealthy said:
....Or there is another firefox plugin called Firebug. You can edit/copy whatever website you are on IN REALTIME - change logos and rewrite texts and see it live on the actual website you want to rip/copy. Excellent plugin.

Code:

https://addons.mozilla.org/en-US/firefox/addon/1843/

Does it work for scripts?

behealthy · Oct 19, 2010

Yup. The power of this cannot be underestimated IMO.

Firebug + TBS = Kerchhingg

Code:

http://getfirebug.com/

how to rip a site?

Elite Member

Power Member

Junior Member

Regular Member

Supreme Member

Elite Member

Elite Member

Junior Member

Junior Member

Registered Member

Junior Member

Junior Member

Registered Member

Registered Member

Regular Member

Registered Member

Newbie

Registered Member

Regular Member

Registered Member

Main Menu

Marketplace

Making Money

BlackHat World