That wasn't exactly the answer to my question. Mine was why it showed different duplicate results (2000 compared to 200) when using different harvester connections.
That is because of the fact that some sites have both their "www.site.com" and "site.com" pages indexed. For G, they are different, for SB they are same.
Another thing, I would say don't stop scraping till you reach a certain number of URLs. You set a time limit. Like scrape with 10 connections for 30 minutes today. Then with 25 connections, 30 minutes tomorrow. And then compare the results.
Ah, thank you for the suggestion.
My problem is that the harvester can't handle over 1 million URLs, so if I scrape one SE first and get 6-700k urls. Then i scrape another SE and get say, 4-500k urls. If I then want to merge those two lists, which would add up to 1.2 million urls, to remove all the duplicate urls. The limit sets in.
My "process":
Scrape keywords
Remove duplicate domains
Replace beginning of all links with site:
Put domains in keyword-list
Harvest links from one SE at a time, due to the limit.
Save the links to a separate list after every scrape.
Then what I would like to do is merge those lists and remove all duplicate links.
Does that clear it up?
I tried quoting without name and just the portion I wanted to quote, still didn't work.
I also found what was causing the "filter" to react. But I can't write it, yet.
I heard that this was $47, did it go up to $57 now?
Now why do you have to go and make things simple? lol
Sweetfunny:
The new "Install all Updated Addons" button install ALL the updates, rather than the ones that are installed.
How about something that will update ONLY those ones that update the installed ones.
Will be in the next update.
You quoted me but forgot to answer my question![]()
Forgive the newbie question but are there similar services like senuke that provide the proxies for you instead of you getting them .
Perhaps I misunderstood your question, but I think hijacking the sales thread.
If your asking if scrapebox will scrape proxies for you then yes. If your asking about stuff outside of scrapebox, this is the wrong place for the question.
Hello,
I have a bad experience with this guy from Scapebox and i want to know everybody about it.
I buy Scrapebox, i test it 2 days and after that i realize that this program is not good for me and I request a refund to this guy. He told me that i'm not refunded and will disable my license too.
In this moment i don't have any license and my money was taken....
i open a case at paypal but they suggest me to talk with seller.
![]()
Hello,
I have a bad experience with this guy from Scapebox and i want to know everybody about it.
I buy Scrapebox, i test it 2 days and after that i realize that this program is not good for me and I request a refund to this guy. He told me that i'm not refunded and will disable my license too.
In this moment i don't have any license and my money was taken....
i open a case at paypal but they suggest me to talk with seller.
![]()
How come the Whois Scraper add on does not scrape all whois emails? As an example, I ran it with a list of 17,000 domains but it only returned emails for 2,000 of them. I know that every domain has a whois admin email address. Is this rotating through different whois checkpoints and some of them are banning scrapebox from retrieving data?
How come the Whois Scraper add on does not scrape all whois emails? As an example, I ran it with a list of 17,000 domains but it only returned emails for 2,000 of them. I know that every domain has a whois admin email address. Is this rotating through different whois checkpoints and some of them are banning scrapebox from retrieving data?
For the last 5 days I've been waiting for the activation but nothing seems to happen. I tried submitting my details 2 times, and I'm sure I did everything right. Any idea what could be the reason for that?
For the last 5 days I've been waiting for the activation but nothing seems to happen. I tried submitting my details 2 times, and I'm sure I did everything right. Any idea what could be the reason for that?
For the last 5 days I've been waiting for the activation but nothing seems to happen. I tried submitting my details 2 times, and I'm sure I did everything right. Any idea what could be the reason for that?
Bought myself another SB license today (you don't even want to know how many that is).
I've read that SB's offices were flooded...does that mean my SB license isn't going to be activated until they're back at 100%?
I'm not trying to be unsympathetic, I feel awful that the SB team has had to face a loss due to a flood, I'm just curious is all.