Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
- Jan 25, 2009
- 6,378
- 3,774
Glad you like my videos.
No your not paranoid. I mean personally I think majestic is hands down a better metric then moz. But if your talking bulk and free, moz is the choice. If you have paid majestic account, then by all means login and use it to your advantage.
You might also do it in steps, do the bulk with moz and then take the best of the moz run and run it in majestic to filter it down some more.
No. httrack is free and excellent and can do this.
Joseph Lich
BANNED
- Nov 25, 2015
- 401
- 79
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
I am unable to use proxies while harvesting urls.
It just shows error while selecting server based proxies or using my own google passed proxies from proxy manager. Working only when not using proxies at all.
And many videos need updated for latest version
As 2.0 is totaly different from 1.5 version.
From UI to its work.
It just shows error while selecting server based proxies or using my own google passed proxies from proxy manager. Working only when not using proxies at all.
And many videos need updated for latest version
As 2.0 is totaly different from 1.5 version.
From UI to its work.
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
1 more thing now pg no longer works
How do I harvest high quality url?
Any tutorial?
How do I harvest high quality url?
Any tutorial?
- Jan 25, 2009
- 6,378
- 3,774
The servers show 100% uptime with pingdom, servers 1 and 2 are the activation servers
http://stats.pingdom.com/vz0wm9714wj5
So whitelist scrapebox in all security software.
That means the ips are blocked.
There are different kinds of IP bans with Google. The proxy tester only tests against basic keyword search for google. However google can simultaneously allow basic keyword scraping and block other queries, especially advanced operators.
Google can block on many levels for multiple different things. Here is a video that further explains it:
Additionally this video on how to safely scrape google in 2016 and beyond is helpful:
Server proxies are heavily used and ban lightning fast with google, so I would only expect to use them on non google engines.
The majority of the core functionality and UI is the same, or at least I feel so, from V1 to V2. V2 does more and is more efficient of course. There are a lot of V2 videos for a lot of things, and I plan to do more, but I can only go so fast. A lot of people have missed the V2 videos and are only finding older ones when there are already newer ones anyway. Is there a specific video your talking about?
videos newest first are here
https://www.youtube.com/user/looplinescrapebox/videos
You can use the page authority addon to check moz data for urls.
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
Thq
I have a suggestion for proxy harvest like there are 3000 proxies I test them then had to stop then 2000 were done many were failed So there should be an option to delete failed ips and when start to test ip it should not to restart from the top rather then resume where it stopped
I have a suggestion for proxy harvest like there are 3000 proxies I test them then had to stop then 2000 were done many were failed So there should be an option to delete failed ips and when start to test ip it should not to restart from the top rather then resume where it stopped
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
Hello sir I need a suggestion from you
Which proxy scraper is good and fast as you use most of the time, So you know best.
Which should I go for
Gsa, proxy multiply, no hands proxies or any other suggestions?
Which proxy scraper is good and fast as you use most of the time, So you know best.
Which should I go for
Gsa, proxy multiply, no hands proxies or any other suggestions?
Winston_
BANNED
- Jul 9, 2016
- 41
- 12
There is a trick. ScrapeBox can “classify sources” so you can tell which ones have the highest % of working and Google proxies. When using classify, duplicate proxies are not automatically removed, so it know accurately which sources have the most working.
Also to find good sources, take a fresh working proxy and search it in Google with either 24 hours or 7 days timespan.
Like this (24 hours): https://www.google.com/#q=%22213.136.79.124:80%22&tbs=qdr:d
Or this (1 week): https://www.google.com/#q=%22213.136.79.124:80%22&tbs=qdr:w
To uncover other fresh sources. It requires some manual work.
Proxyfire software (?) does all these methods. Port scanning proxy ranges and also scanning the web using a list of hard coded sources and also scanning for new sources from search engines using working proxies as keywords.
Last edited:
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
Thanx that means it is better than all the listed?
And its site is not loading proxyfire. Net
Is this the site?
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
Thanx Its not about source even good source provide bad proxies I asking this because it will be easy to delete and resume rather restarting again and thanx for the link
and regarding proxifire I checked its a ip changer not a scraper
I am looking for a scrapper like gsa, no hands proxies etc.
- Jan 25, 2009
- 6,378
- 3,774
I think you could go about this multiple ways but if you want to removed failed ones just click on the columns at the top of the proxy manager and sort by whatever you want. click the top most result you want to remove, then hold down the shift key, then click the bottom most result you want to remove. That will highlight them all then right click and remove selected. Then you can export whatever you want etc..
why can't you just use Scrapebox? I mean your posting in the scrapebox thread, asking what "other" program to use and the very program whose thread your posting in already does what you want.
Scrapebox has a full harvester and as mentioned above proxy classifier etc.. You can have good proxies saved to file every X often, you can even get the automator and run it in a loop for every and ever.
you can also use the automator to gather new sources and delete old ones. Aside from port scanning I would say Scrapebox is one of the most versatile proxy harvesters out there. Besides if your going to use the proxies with scrapebox what better program to test them in?
These videos should help
I feel like Im regurgitating the youtube channel on BHW. You can simply go to youtube and watch these videos and learn everything your asking and heaps more.
https://www.youtube.com/user/looplinescrapebox/videos
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
Hi sir thq
But the thing is I do over 11000 scraping
Than some time it takes time so what I do stop it to do my work in That I have tested 3000 in which already took time test so 1500 to 2500 are use less. Holding shift key and dragging to 1500 or 2000 deleting it 1 or 2 proxies will be good after that then holding shift key and again doing it for next 500 is a time taking it better to rather click delete failed it done in one sec.
And (didnt used snapshot feature yet) resume feature so it does not need to test those which are already tested
And sir out 3 4 videos I have downloaded them and checked for classify source which shows from which I am getting good proxies
But air I need to know how do I delete duplicate source I have over 1500 sources which I found which took me days to collect but in 1500 1700 sources I have 100 - 200 dup sources so how do I delete these sources?
Because I didnt found any info on it in video nor on google. If its not there then its my suggestion too
But the thing is I do over 11000 scraping
Than some time it takes time so what I do stop it to do my work in That I have tested 3000 in which already took time test so 1500 to 2500 are use less. Holding shift key and dragging to 1500 or 2000 deleting it 1 or 2 proxies will be good after that then holding shift key and again doing it for next 500 is a time taking it better to rather click delete failed it done in one sec.
And (didnt used snapshot feature yet) resume feature so it does not need to test those which are already tested
And sir out 3 4 videos I have downloaded them and checked for classify source which shows from which I am getting good proxies
But air I need to know how do I delete duplicate source I have over 1500 sources which I found which took me days to collect but in 1500 1700 sources I have 100 - 200 dup sources so how do I delete these sources?
Because I didnt found any info on it in video nor on google. If its not there then its my suggestion too
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
Thq sir I ll try that way
Regarding I was asking because it was difficult to find new sources
I didnt new that about scrapebox
Sir I understand now
The reason was to suggest it for to save time but does need resume thing it is stop then it starts from the scratch
Regarding I am already downloading all the videos for it.
Winston_
BANNED
- Jul 9, 2016
- 41
- 12
In automator you don't have to havest and test all the proxy sources.
Or you can havest all the them without testing, Save all to File and Split text File; then test them in automator.(?)
When add proxy sources, I would rather check/add one; then find/test the second source; Just several good sources will yield many proxies. It seems a "slow" process, but I have to decide that less is more.
Public proxies aren't updated in daily basis, not very frequently.
Besides "Remove the Selected Proxies", you can also choose "Test Selected Proxies only".
- Jan 25, 2009
- 6,378
- 3,774
If your stopping and pausing and coming back later, there is a decent chance most of the proxies will be dead anyway. However if you do save state you can save it all off. Then you can keep only good ones and export. Then load state and removed all failed and good quite quickly and then save those.
However if I might lend an option to do it differently all together. Pretty much the only thing public proxies are good for is scraping, so you can spend $10 and buy 10 shared proxies from buyproixies.org or wherever else and load them up in scrapebox, choose detailed harvester, set a 60 delay and then just let it scrape.
Sure its a 60 second delay, but that shouldn't intterupt any other activity on the machine so it can run all day and all night. We have been days talking about how to get public proxies to work and you probably spend hours messing with them, in all that time you could have harvested hundreds of thousands of results by now, with no hassle at all.
Also may I ask, why are you pausing it in the first place? As there may be another option.
Just load the sources in the urls harvested grid in the main scrapebox window and go to filter / remove >> remove duplicate urls - and then export and load them back as sources. (And of course delete the ones already there).
Mayur Pahuja
Junior Member
- Jun 23, 2016
- 103
- 10
Thq sir
1
thq sir I am looking for more cheaper ones though
2
The reason is sir that I have added many url adding words to get more harvesting from inside I did added to sb source forgot to do that in my list but after harvesting I added few more from another list so everything is messed up thats y.
If I remove the sources then again I have to hunt down them, because in yesterday at that time I added 40+ sources directly to scrapebox but forgot to add them in a list.
Before adding I did the that exactly imported in url harvester and removed duplicate links
Last edited:
- Status