thanks loopline, top tips here
was wondering how people get a complete keyword list scraped without the export uncompleted keyword function in the automator
just takes some creative thinking i see
curious... if url list is taken outside of sb, why not split the keyword list?
You could, you just have to touch it more times. Like if you split a large keyword list into 4 pieces then you have to run it 4 times and then do import and compares on each list to remove urls that you had in previous lists. Or just merge all the results together and then remove dupes.
So you have to "Touch" and take time to interact with scrapebox all that many more times, vs just loading in one big keywords list, manipulating the urls after harvest and then spiting the end list. I like to set and forget it.
Like I had a non urgent project so I loaded in a massive keyword list and some private proxies and set connecitons to 1, just because I wasn't in a hurry. That was a few days ago, its got 19 million urls harvested and counting. I haven't touched it since. Its like all the gadgets you see sold on infomercials. Add water and dirt and set and forget it and come back to a gourmet meal in 6 hours it slices, it dices it chops, it spins, it even does your laundry on the side! HAHA I dunno. Thats just how I think, less touch from me the better.
~~~~~~~~~~~
As for your first Q, I just don't care about completed keyword lists. Meaning If I load in 500K keywords and use private proxies, my speed and success are consistent. Private proxies are key to this, set connections at 10%-20% of your proxies, so you have 100 proxies set connections to 10-20. That adds enough of a delay that they never get banned.
So if I load in 500K and 1000 keywords total don't complete, I don't care, cause I got 499K keywords and that more then enough for me to deal with. High efficiency comes from the private proxies though and whats left I just don't care about cause the whole concept is about mass and when I scrape 120 million urls, I don't care about the 300K that I missed. ect...
Thats the way I see it. If I only had 100 kewyords well that would be different, but Id anticipate that with private proxies that I would get a 99-100% success rate on scraping those 100 keywords anyway.
So for me its about changing the picture. I try to look at what some people say , such as "how do you get a keyword list scraped efficiently without exporting uncompleted keywords" and say 1.) Do I need to be effecient with it?
2.) Why are so many failing in the first place, is it my proxies? Is it my settings?
That way I arrive at the point where it is efficient and I might only be missing a few keywords and then the need for the keyword export is mute. But thats not the driving factor for me. For me the driving factor is, that by arriving at the point where I don't need to export keywords and then reimport and scrape again, I have increased my effeciency and I don't need to touch scrapebox as often and it doesn't take as long to run.
At the end of the day many have said it but most recently I read it in Shoemoneys new book.
"Time is all each and every one of us has. How we use our time is what differentiates us all in the end." ~Jeremy Schoemaker
Great read by the way, highly crass, but Id recommend "The Shoemoney Story" by Jeremy Schoemaker to anyone in IM "if they are mature enough to read past some of the crassness and ignore the "ideals" that you may not agree with. The life skills and business skills are the golden nuggets and its a fun read, as he says so often in the book, he blurrs the lines, his book blurrs the lines between "business/self help" and "a story book".
Anyway.. Dunno how I got off on the book but the point was the quote. I don't seek to make the tool work for how I want to use it, I seek to use my time better and to do that I try and change the picture of what I think the problem is that is keeping me from using the tool more effeciently. - Another Great book for that is "Thinker Toys"
I forget who said it but they said something to the effect of
"The only two things that influence how you shape your life and who you become are the books you read and the people you meet". Hence all the book mentions. You sound like a person who is the type of person who helps themselves. Some people don't care to be helped they want you to do it for them or hold their hand, you seem like your going somehwere so I dropped the book mentions.
Ok, enough about books in the software thread, lol Cheers!
.. this is my opinion about that
