Hi, I have a small percentage of link found. Everytime I post it, I only have 20-30% of successful posting from the links I scrape. When I do link checker, it's usually <10% of successful links. I feel it's way under than normal people do. I only use 5 private proxies (when posting) and I use them in 3 instances simultaneously. Does it affect my lower percentage? I check off the proxy use when doing link checker. Should I add more private proxies? What number do you suggest when I want to use it on 3 instances simultaneously? Please reply. Thanks =)
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
yep... all good now.
Have another question. Addon "scrapebox backlink cheker" , where does it pull data from?
- Jan 25, 2009
- 6,378
- 3,774
YES R2 is ideal.
windows server 2008 used same engine with windows 7
it's worked on win 7, but waiting for someone answer it
i forgot to asking this
format for trackback
website format
and comment format
thank you
Yes on 2008, thats all I run.
trackback format:
anchor
url
space
anchor
url
space
What do you mean website format?
Comments is just put the anchors in the names file and websites in websites file or use link lock:
You can lock a specific anchor to a specific url when posting. This allows you to post to many urls with different anchors in the same posting run. This feature is called Link Lock.
You use link lock in the websites.txt file. It should be formatted like this:
http://www.site.com {anchor1|anchor2|etc..}
http://www.site1.com {anchor1|anchor2|etc..}
You still are required place something in the names.txt file, as this is the backup file that will be used if something goes wrong. For instance if your spin syntax was messed up, scrapebox may not be able to understand what anchor you wanted, so it would use a line from the names file.
SRC: http://scrapeboxfaq.com/how-do-you-lock-a-specific-anchorname-to-a-specific-url
You can also just use my free tool and it will do it all for you.
http://www.scrapestuff.com/free-tools/scrape-formatter-tool
Also I would encourage you to help your self out by doing some reading, this info you asked for is very widely avialable in this thread, on
Scrapebox Official Usage Guide:
http://scrapebox.com/usage-guide/
On my Scrapebox FAQ site:
http://scrapeboxfaq.com/
Also a simple google search would yield it. I don't mind answering it for the 7438th time, but if you really want to get the most out of this program you should do some self learning.
A central resource I have is Scrapestuff, it links to everything official from scraped media for all their products as well as everything I have:
http://www.scrapestuff.com/
Any chance of having proxy support added to the link checker?
Sure, just go into the main scrapebox folder >> configuration folder >> scrapebox.ini
Look for
[Advanced]
UseProxiesInLinkChecker=False
change it to true
[Advanced]
UseProxiesInLinkChecker=True
Make sure the use proxies box is ticked. FYI in most cases proxies are not needed for the link checker, and you can expect reduced success rates and I would recommend rechecking failed/not found for accuracy due to proxy related failures.
By way of note, statistically wordpress has a 2% auto approve rate, so if you are commenting to ONLY wordpress blogs, meaning you ran them thru blog analyzer or something to qualify them as wordpress and live (Cause google isn't that accurate), then you could expect 2%AA. Else my straight posting to scraped urls from google is about .75% -1.2% AA
Successful posting is often confused with link stick rate. When a comment is submitted to a blog, it just means it was successfully submitted. Most of the time it will then go to a moderator and must be approved before it goes live. Link stick is when the link is live. If you post and then check links, the only ones that are going to immediately show up is auto approve links. Here is a video I made that goes more into depth on it:
[video=youtube_share;kpRAqHfDqVc]http://youtu.be/kpRAqHfDqVc[/video]
Alexa. Its the best free source that can withstand the pounding scrapebox users give.
one more question. Tried to set up bing ip, and as far as I understand, bing is not providing Api ID's any more, instead they offer authentication key or smthng, I paste this key to Api IDS and nothing going on, scrapebox doesnt scrape bing. am i doing smthng wrong, or we just should wait for scrapebox update that gonna work with new bing update?
rebornishard
Regular Member
- Mar 20, 2010
- 244
- 67
thanks loopline, i use scrape-formatter now
and for trackback excerpts
something like this right ?
{hello|hi} {sir|madam} how are u today?
My title
thank you very much
and for trackback excerpts
something like this right ?
{hello|hi} {sir|madam} how are u today?
My title
thank you very much
PeaceLoveSubmission1
Regular Member
- Sep 30, 2011
- 480
- 261
Scrapebox isent scraping Google very well at all, any idea whats going on?
- Nov 2, 2008
- 59,100
- 26,627
in what way isnt is scraping - can you be more specific ?
PeaceLoveSubmission1
Regular Member
- Sep 30, 2011
- 480
- 261
Its scraping 1 url per minute, i have fresh google passed proxies 25 connections 1 url per minute. Its been like that for a bit now. Really slow scraping before a scrap that would normally collect 1 million results iss now collectiong 30,000 results in total. Yahoo and stuff are working fine but i never use them anyway, it's Google that is the problem
Hi, thanks for the video. I know what it's meant by successful posting and link stick rate and what I ask you is the AA lists rate that normally people will get. It turns out that yours is quite low too is about 0.75 - 1.2 % AA. I just wondering many people sharing their trick of finding millions of AA list easily. I have tried many times their techniques, but only got 2 % of AA from the list I scrape.
One more thing, is it normal if I blast the AA list for the second or third times and the percentage of found AA links is decreasing? Here is the sample case, I scrape 1 million blogs and 30% (about 300k) is successful, then I check the links and it's only 50k found link. Then, I blast the 50k found link, and it's only 30k found link. I did another blast of 50k links and it's only 10k links. Is it normal?
Besides, how many private proxy you recommend to have to run 3 instances scrapebox simultaneously for posting?
One more thing, is it normal if I blast the AA list for the second or third times and the percentage of found AA links is decreasing? Here is the sample case, I scrape 1 million blogs and 30% (about 300k) is successful, then I check the links and it's only 50k found link. Then, I blast the 50k found link, and it's only 30k found link. I did another blast of 50k links and it's only 10k links. Is it normal?
Besides, how many private proxy you recommend to have to run 3 instances scrapebox simultaneously for posting?
Matt, I was having a similar issue a while back. I had an AA .edu list of nearly 4k, of course they were on very few unique domains. I'm sure I was hitting their servers with too many open requests. At first I was able to post to them with at a good rate and got a good link count in the link checker, then eventually i wouldn't be able to find many valid links at all using the same list.
What would be the best remedy for trying to post to say a 4k AA .edu list successfully and continuously? Can all we do is just mix in more non .edu urls to slow down the connections? I mean outside of lowering the connections in scrapebox and using more proxies, thanks.
Last edited:
Matt, I'm trying to get 20000 live links from an AA list in a short amount of time. I'm posting to 60000 currently to ensure this. If I had the system you mentioned you had from gigenet, how fast do you think i could get through a 60000 AA list? Could you tell me how many proxies and connections I should make also? thanks.
Sorry for digging up your old posts, but when I'm looking for answers, I'm looking for you.
For your gigenet dedicated 1Gbit/s are you doing something like this...
Fast Poster: 500 - 60 sec timeout
Would that be with 50 or 100 private proxies maybe? Thanks a million
- Jan 25, 2009
- 6,378
- 3,774
Update to .49, the entire bing scraping engine changed.
thanks loopline, i use scrape-formatter now
and for trackback excerpts
something like this right ?
{hello|hi} {sir|madam} how are u today?
My title
thank you very much
almost, you got it upside down. Title goes on top and excepts go on teh bottom.
My title
{hello|hi} {sir|madam} how are u today?
Title is NOT spinnable. Excerpt is.
Its your proxies. Proxy go pmed your so Ill assume he probably answered you questions, but if you would like some more info you can check out my vid here:
http://youtu.be/2QaLWgTXsRo
Don't get me wrong, when I am specifically trying to build an AA list, I don't just scrape a ton of urls and post, I have other "techniques" that yield much higher percentages. But they are hard earned and I don't just go sharing them. I was just saying if your just scraping and posting, thats what your gonna get.
Well it depends, if you are blasting the same domains or with same IPs, same emails, akismet could be banning you. The servers could be banning you, network congestion or a million other things.
The short answer is no, its not normal. Meaning the sites aren't dying that quick. Something your doing is causing the success rate to drop. Unless you are talking about trackbacks, then thats different.
you "could" run 1 proxy across 3 instances just fine, but it boils down to how many connections you have set in each instance and the max total simultaneous connections that your proxy provider allows you to have. So you want to check with your proxy provider and adjust your connections to there. Number of proxies when posting is largely irrelevant, generally its only when scraping that you need a lot of proxies.
Yes, either slowing the connections or mixing in random domains. But sites are of course going to die or close comments etc.... over time. You can always repost the failed as well. Making sure you are changing up proxies whenever your provider allows it and changing up emails could help too.
Thats subjective. The server could handle 1000-2000 simultaneous connections, but the proxies you are using probably could not. So the proxies are the weak link, and you wouldnt' need a server near that big to post to 60K lists. A vps would work. But really you should use trackbacks if its speed your after, I can do about 1K successful links per minute at 100 connections on trackbacks, with a good list. Thats found. IT will process about 2K-3K a minute. WAY faster then comments. But Id say it would take an 2-3 hours maybe on 100 connections to do a 60K list, but then, if its a "good" list, you should be able to post to 25K or 30K and have 20K found.
If you had 500 private proxies from 5 different providers (to maximize your max simultaneous connections) and you put it on 500 connections you would prob blow thru 60K in 30 mins.
no worries on old posts.
No, for the gignet server I use like 100-200 connections with 60 sec timeouts when posting. Per instance, times lots of instances, but it depends again on your max simultaneous connections from each proxy provider you have. I use multiple providers.
Its not so much the number of proxies. You could have 3 proxies and each have a 100 simultaneous connection max and run 300 connections fine. Or have 100 proxies and have a 10 simultaneous connections max and only be able to run10 connections on your 100 proxies. In fact there was a provider, who in my opinion was super sub par, here on bhw that I bought 70 proxies from. But turns out they had max simultaneous connections set to... you guessed it...10. So I couldn't run more then 10 connections or else the proxies would deny my connections resulting in significantly reduced success rates. Most providers offer 100 per server. What that means? Well it means different things to different providers. There are no rules to follow, each provider can do as they please so you need to ask them what the limit is, and then expect to go 10%-20% below the limit on connections, in order to hit max efficiency.
Thanks again Matt, more thought provoking info, really appreciate it.
Do you use a vpn when posting? I would imagine that could cause
a bottleneck for traffic.
I'm thinking harvesting takes up considerably more resources than
just posting is that right?
Also, how many connections can you make all together from the gigenet
server you have? Assuming we have good proxies allowing say 100 connections
per proxy, can you talk more about the benefits of running multiple
instances of scrapebox (100-200 connections each) as opposed to running
fewer instances with more proxies? Do you run more instances to handle
more projects at a time?
Also, I'm a little confused about this...
"If you had 500 private proxies from 5 different providers (to maximize your max simultaneous connections) and you put it on 500 connections you would prob blow thru 60K in 30 mins."
This equates to only 1 connection per proxy, should I not be trying to
get about 80 connections per proxy if the proxy can handle 100 connections?
Thanks again for all your advice!
Do you use a vpn when posting? I would imagine that could cause
a bottleneck for traffic.
I'm thinking harvesting takes up considerably more resources than
just posting is that right?
Also, how many connections can you make all together from the gigenet
server you have? Assuming we have good proxies allowing say 100 connections
per proxy, can you talk more about the benefits of running multiple
instances of scrapebox (100-200 connections each) as opposed to running
fewer instances with more proxies? Do you run more instances to handle
more projects at a time?
Also, I'm a little confused about this...
"If you had 500 private proxies from 5 different providers (to maximize your max simultaneous connections) and you put it on 500 connections you would prob blow thru 60K in 30 mins."
This equates to only 1 connection per proxy, should I not be trying to
get about 80 connections per proxy if the proxy can handle 100 connections?
Thanks again for all your advice!
Last edited:
Matt, about the trackbacks. I was doing a little research on them,
any truth to the idea that there is an increased risk of getting an
ip ban?
Also, should the connection settings be changed to something lower
than one would use while using fast poster? thanks.
any truth to the idea that there is an increased risk of getting an
ip ban?
Also, should the connection settings be changed to something lower
than one would use while using fast poster? thanks.
- Jan 25, 2009
- 6,378
- 3,774
No I do Not own/work for scrapebox. Sweetfunny along with someone else is partners in Scrapebox. Sweetfunny stated a long time ago they don't reply to this thread much because they put all their time into support and development of the program. I mean they sell a easily $300 program for $57 so to even give support in the first place is huge bonus. I actually came about scrapebox in a difficult time in my life. I wound up making a lot of money off of it, and always got awesome free support and a bunch of the features in scrapebox are there simply because I requested them. So I am pretty loyal to scrapebox and am happy to post here a lot and help out. It saves the developer time and I then they can focus on development and other things.
I don't personally typically use a VPN when posting. I have tested HMA in the past and it works and all, but I have private proxies and those are faster. A VPN may or may not slow things down. The upside to a vpn is that you don't need proxies, as long as the vpn provider is cool with that. The down side of course, is that you are subject to the limitations of the vpns internet connection and their dns speeds.
As for harvesting resources, I would say generally the opposite. Assuming by resources you mean bandwidth, processor, RAM, etc... then harvesting would take the least. Largely because you connecting to companies whos business is providing resources and they are masters are doing so with using the least overhead in need for bandwidth, processor, etc.. I mean look at googles pages, no flash, bearly any images, no clutter, etc... so something like fast poster or the link extractor or something that is loading user generated pages full of gaudy flash and various other things, maybe 50K comments on a blog engine page etc... A blog engine page might be 10MB+ to load while a 100 results page for google would be in the Kbs.
I try to keep the gigenet server at a max of 1000-2000 connections. The physical machine isn't so much the limits as its top notch. At that point your dealing with windows messaging and windows is simply Not good at dealwith massive scale connections larger then that. An "ideal" setup for windows is probably more in the 1000 connections range, but I haven't really had issues running 10 instances of scrapebox at 200 connections each totaling out 2000 simultaneous connections. I have solidly pushed 300-400Mbit of bandwidth for extended periods of time.
The truth of the matter is that a server such as we are talking about is highly capable. I used to spend $1500 a month just on servers and proxies. However I have cut that back to under $1000 monthly at this point. Simply by working smarter not harder. I have made great strides to laser toning my skills a making footprints and scraping smarter. In turn at building custom filters in my external applications to filter lists on my server. Then when I post I am not posting to near as much as I used to be. I still work with large volumes of urls, but used to I might tear thru post to 26 million urls to make an AA list. No with better scraping, server side filtering and efficiency it might do the same list with only a few million urls. (yes I make big lists, like Im siting on about 400K AA at the moment and still going).
To that end, if you are up for the learning, its just worth your time to make sure your efficient at what your doing. I do still use multiple instance. I have noticed windows "seems" to not like more then 10 instances of scrapebox running per desktop. I don't fully know why, and I don't completely care, but if I need to run say 20 instances, Ill just create another user/desktop on the server. Watching the resources and crashes it seems to work out better this way - For what thats worth anyway.
What I actually do is pin all my instances to the desktop and number them 1-10. Then I load open office Calc (excel equiv but free) on the server and list out all the instances and keep a running tab of what they are doing. I "typically" am routine. Ill have say instances 1,3,5 doing commenting, 2,4,6 doing trackbacks, 7 doing other things like pr checking etc.. 8,9 and 10 for more "whatever I need at the moment" etc... I don't hold exactly to that of course, but you get the point. I just keep it organized so I am as efficient as possible.
Now that I rambled about that, Im not completely sure I answered your question, did I? About benefits I mean. Perhaps you meant from a connection standpoint. Windows seems to like to deal with about max of 200 connections per instance of scrapebox. Setting it higher tends to reduce success rates, so I usually keep my connections at 200 or less per instance and divide what I Am doing among instances if I need to do more connections now.
~~~
on proxies, most providers don't limit it to 100 connections "per proxy" they limit it to 100 connections per the group of proxies they give you. So if they give you 10 proxies, its generally limited to 100 connections spread between any of those 10 proxies. They don't really care if you put all 100 at 1 proxy and ignore the other 9, its just about maintaining integrity for them. Most proxy providers are about efficiency, so they may have a vps running with a full block of 254 IPs and all 10 of your proxies might come from that same vps, while of course two dozen other users 10 proxies also share the vps with you. Think that thru. They are private proxies but if you have 24 people each with 10 proxies from teh same vps and that vps is running a 100mbit connection and all 24 people are trying to push data thru those proxies at once. your getting less then 10mbit per user, and say your on a 1Gbit line hammering on posting with those proxies, your 1gbit line is bottlenecked down to 10mbit because thats the max the proxy is going to give you.
This boils down to, at least in the proxy world, YOU GET WHAT YOU PAY FOR. So that $30 for 10 private proxies might seem pricy vs that $10 somewhere else, but that $10 guy is cutting his expenses by running on a vps 100mbit line and that $30 provider is probably using a dedicated server on a 100-1000mbit line. Too many variables to go into, but you get the point, you need to understand what your providers limitations are exactly to get the best use out of it.
Although if you go fast posting, you can tell. Crank the connections to like 300 and hammer away for 2 mins. Then look at all the error codes. You will see something thats dominate. 403, 407, 404 etc... Something will consume like 80-90% of the error codes. Then turn the connections down to like 50 and do the same list for like 2 mins. Then look at the error code. You should see that error code drastically reduced to only a few percent if not at all. Then you have the error code (s) that your proxy provider gives when your connections are being denied by overloading the proxies. 403 and 407 are common. Then just crank up the connections little by little until you see this error code start to dominate again, and there you have what your proxies can handle.
IP ban from what? I have posted to millions of trackbacks and not gotten an ip ban. Can you be more specific?
Well caps on trackbacks are 100 connections, but I can easily post at 20 connections and go quicker then a comment run at say 80 connections. So I try to run it at 50-100 connections whenever I can, as Im impatient lol, but its not "needed" to go slower. If functions efficiently at its max of 100 connections, so long as your server/proxies can hack it.
I'm slapping my forehead and my jaw is dropping in complete
amazement from your replies. You are truly a master, thank
you so much. I will take some time to digest everything you
wrote, just know that your effort won't go to waste on me, I
take all you say very seriously, thanks again!
amazement from your replies. You are truly a master, thank
you so much. I will take some time to digest everything you
wrote, just know that your effort won't go to waste on me, I
take all you say very seriously, thanks again!
veheme
Elite Member
- Jan 18, 2012
- 2,877
- 1,040
Loopline, I am buying scrapebox blasts left and right from other providers despite having Scrapebox on my computers... honestly, I don't know how to use it. I just use its addons and proxy checker. I'm looking to learn, could you point me to a direction? I could buy blog lists, that won't be a problem. What I'm needing help are the VERY VERY BASIC things such as:
format of the .txt file for names, emails, sites etc.
I can't find a tutorial because most of them are advanced already. I could buy this for a few bucks, sure, but since I have a team and computers that are on stand-by, why not utilize these? Thanks.
format of the .txt file for names, emails, sites etc.
I can't find a tutorial because most of them are advanced already. I could buy this for a few bucks, sure, but since I have a team and computers that are on stand-by, why not utilize these? Thanks.
- Status