inmygarage
Newbie
- Jan 2, 2017
- 33
- 1
Using the manual comment poster, with private proxies - but nothing happens. It's just stuck at 'reading' and PU 100%.
What am I doing wrong?
What am I doing wrong?
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
- Jan 25, 2009
- 6,378
- 3,774
Scrapebox won't do it, but perhaps there is some tool, you could google for it. Or just do a find/replace with the invalid characters.
Are they ip authenticated or user/pass? Due to how its setup, you can't use user/pass proxies with the manual poster. But for the most part you could probably do better to not use the manual poster at all. To be honest firefox or chrome with a proxy changing plugin and a form filling plugin will out perform the manual poster. I mean I love Scrapebox but they are well aware that internet explorer rendering engine is limited and problematic. In fact they almost didn't even add manual poster into V2 of Scrapebox as its pretty much extinct. my 2 cents.
Its probably that there are no write permissions for the folder scrapebox is in, or your hard drive is full.
But that means that the update is being downloaded but not saved. So make sure Scrapebox is running from a folder on the desktop or in the documents folder. Else if not move it there.
Failing all else just download a fresh copy.
You can download scrapebox from here:
http://www.scrapebox.com/payment-received
Unzip it to a folder on your desktop or in your documents folder.
D
Deleted member 986121
Guest
I have a problem with the scrapebox proxy harvester. The harvester runs fine and gets lots of decent proxies until its nearly finished. When the threads used go down from 500 to the last ~ 5 to 10 the program just "freezes". I can wait for hours and the program does nothing. If i shut it down manually the proxies are saved and i can use them but i need the tool to run without issues because i want to use the automater.
Thats an example screenshot. Threads stayed at 5 for atleast 30 minutes before i closed it. Its pretty strange. I reinstalled windows yesterday because of other issues and the error occured on my old and on my new installation.
Thats an example screenshot. Threads stayed at 5 for atleast 30 minutes before i closed it. Its pretty strange. I reinstalled windows yesterday because of other issues and the error occured on my old and on my new installation.
- Jan 25, 2009
- 6,378
- 3,774
I have a problem with the scrapebox proxy harvester. The harvester runs fine and gets lots of decent proxies until its nearly finished. When the threads used go down from 500 to the last ~ 5 to 10 the program just "freezes". I can wait for hours and the program does nothing. If i shut it down manually the proxies are saved and i can use them but i need the tool to run without issues because i want to use the automater.
Thats an example screenshot. Threads stayed at 5 for atleast 30 minutes before i closed it. Its pretty strange. I reinstalled windows yesterday because of other issues and the error occured on my old and on my new installation.
This means that 1 or more of the threads is being locked by something. So whitelist scrapebox in all security software such as anti-virus, malware checkers and firewalls. Take note that disabling security software often only stops new rules from forming, but allows existing rules to still fire. Also some security software requires you to whitelist in more then 1 place.
Further try closing down any uneeded programs. Basically anything can lock a thread, skype, utorrent, pc optimization software etc..
You can go to configuration (Seen in your screenshot) >> stop proxy manager when running threads are less or equal to – try setting this to 10. What this does is when the threads reach the number you choose, the tester will kill the remaining threads.
You can experiment with this up and down. Basically the premise is Scrapebox will try and auto kill threads that are locked. This is especially useful if you are using the automator plugin to automate runs.
Just wanted to share my experience with the detailed harvester scraping Google. I use shared proxies from a good provider, so the result might depend on the way the other 2 people I share them with use them. But still, this might be something you can learn from.
Last month I used 100 shared proxies. There was no way I could use them without delay, they got blocked pretty fast. In the end I settled on a 30-40 second delay when scraping with advanced operators, that was the interval where everything ran smooth.
This month I decided to use 30 proxies, so the delay is obviously supposed to be bigger. I tried 60 sec, 120, 300, proxies were still banned pretty fast. Finally, I've been using a 400 seconds delay in the last 24 hours and it seems to work fine. Now that's a huge delay, but still it's the best way to get really good results when scraping Google, which in my tests is a lot better than Yahoo and Bing, so the wait is worth it. So less proxies, huge waiting time.
Last month I used 100 shared proxies. There was no way I could use them without delay, they got blocked pretty fast. In the end I settled on a 30-40 second delay when scraping with advanced operators, that was the interval where everything ran smooth.
This month I decided to use 30 proxies, so the delay is obviously supposed to be bigger. I tried 60 sec, 120, 300, proxies were still banned pretty fast. Finally, I've been using a 400 seconds delay in the last 24 hours and it seems to work fine. Now that's a huge delay, but still it's the best way to get really good results when scraping Google, which in my tests is a lot better than Yahoo and Bing, so the wait is worth it. So less proxies, huge waiting time.
adamex1970
Regular Member
- Feb 12, 2012
- 318
- 29
How we can modify unregistered domains addon? I mean in whois server and delay setup we can edit both whois server and not found text. Let's say we have popular whois.ripn.net - it currently redirects to ripn.net/nic/whois/. Does scrapebox put there domain in corresponding search field? Or maybe it only adds backslash at the end of whois server with concatenated domain name like whois.ripn.net/mydomain.de adn search for text there?
- Jan 25, 2009
- 6,378
- 3,774
Thanks for sharing!
Neither, Scrapebox uses the actual WHOIS servers on Port 43, it does not use port 80 web based sites/servers at all for WHOIS checking.
adamex1970
Regular Member
- Feb 12, 2012
- 318
- 29
I see. So how we can find actual sources for those 43 based sites/whois? For few country extensions seem not to be responding corectly - I can do same check with alive checker.
- Jan 25, 2009
- 6,378
- 3,774
429 is a rate limit error. It means your going too fast. Too many connections. So I assume this is all with the same domain? You would need more proxies or less connections.
You can look at the whois records and it will tell you what the actual WHOIS server is. Scrapebox maintains an update list. But Im lost, are you talking about the WHOIS addon?
When you say its not responding correctly, what do you mean? can you give me an example?
Some domains like .es or .sk etc... don't work because those domains whois servers will return the same exact data for every single domain and on top of that for unregistered domains.
adamex1970
Regular Member
- Feb 12, 2012
- 318
- 29
Yes, I mean those regional (country) tlds with grab/check unregistered domains (not separate sb addon). So you say that it's impossible to correctly sort them (registered, free or sometimes reserved state), despite we can edit custom text?
- Jan 25, 2009
- 6,378
- 3,774
For some tlds no, you can not. Because you can edit it all you want, but any WHOIS response from a whois server on port 43 will be the same. Scrapebox doesn't scrape a registries website, it uses WHOIS. So there is no source you can point it at that will give you what you want for a select few tlds.
Can you be more specific, does it actually say "bad connection" or what is the error exactly?
inmygarage
Newbie
- Jan 2, 2017
- 33
- 1
did anyone find an actual synonym database to download ?
I'm trying to find a synonym database which is in foreign language, to use with the premuim article plugin, to use with spintax.
but every time I search for synonym database, I get, funny enough, synonyms for that word lol
I'm trying to find a synonym database which is in foreign language, to use with the premuim article plugin, to use with spintax.
but every time I search for synonym database, I get, funny enough, synonyms for that word lol
- Jul 13, 2008
- 2,219
- 5,431
did anyone find an actual synonym database to download ?
I'm trying to find a synonym database which is in foreign language, to use with the premuim article plugin, to use with spintax.
but every time I search for synonym database, I get, funny enough, synonyms for that word lol
You can create a new database by importing articles containing spintax that have been created with any other rewriter, or by hand and the Article Scraper plugin can build your database from spintax articles by associating all words in spintax with the other words in the spintax. So if your article has
{car|vehicle|automobile}
When it's imported, each word from now on will have the other 2 words as synonyms in the database. So if you have a number of articles with spintax in German for example, then you would be able to create a German database.
inmygarage
Newbie
- Jan 2, 2017
- 33
- 1
Great, thanks for the tips. I tried to mess around with chimp rewriter as this one has my language, but I can see it is not at all that impressive with the amount of synonyms it has, unfortunately. :/
inmygarage
Newbie
- Jan 2, 2017
- 33
- 1
Does the batch poster only work with blogger and wordpress?
What if I want to batch post articles to a website without wordpress ?
What if I want to batch post articles to a website without wordpress ?
- Jan 25, 2009
- 6,378
- 3,774
It actually only works with wordpress now. blogger changed some things so that it will no longer work.Does the batch poster only work with blogger and wordpress?
What if I want to batch post articles to a website without wordpress ?
If you want to post to another site besides wordpress then you would need to use something besides scrapebox.
- Jan 25, 2009
- 6,378
- 3,774
To the end of importing articles in your language, you could pay someone on fiverr or a VA on upwork or whatever to take several articles in your language and spin them by hand. Assuming they were of course fluent in that language. Then you could load all those spun articles into scrapebox and it would associate all that and build your own database. You might get something really decent for a couple hundred bucks. Never done this so don't know how expensive that might actually be, but its a thought.
Another thought would be take a bunch of spun articles that are spun in english and run them thru google translate and then load them in.
Maybe a combo, spin a bunch with google translate and just pay someone that is fluent, maybe just grab a relative or friend that speaks your language. Then have them go thru the ones that google translate built and edit out the words that don't make sense/aren't related. Then load them into Scrapebox.
For that matter if you wound up with a decent database, you could always sell it for a few bucks and maybe get back all your investment and have no total outlay in it. Maybe even chimp rewriter would buy it, who knows.
- Status