Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
guillameLK
Registered Member
- Oct 31, 2013
- 87
- 1
Hello,
I want to use automator when harvesting a large list of keywords. For example when I want to scrape 100k keywords, due to the proxies, I need to wait for the job to finish and then hit "start harvesting" button again.
In this case, the keywords scraped with success are deleted from the keywords section and the rest of them + the keywords with 0 results remain in the keywords section so I can harvest them again by hitting "start harvesting" every 30-45 minutes.
I tried to automate this but didn't fond a way. In automator if I add "loop" the process starts again with the initial keywords I put in the "harvest urls" command from automator. I tried to add a delay and then add a new "harvest urls" command with 0 keywords and all defaults. Didn't worked. Basically I want to put the initial lsit of keywords and after the process is finished scrapebox to start again the harvesting with the remaining keywords.
Hope I was clear about this and I'm sure automator can do that but didn't figured out yet how exactly.
Thank you
I want to use automator when harvesting a large list of keywords. For example when I want to scrape 100k keywords, due to the proxies, I need to wait for the job to finish and then hit "start harvesting" button again.
In this case, the keywords scraped with success are deleted from the keywords section and the rest of them + the keywords with 0 results remain in the keywords section so I can harvest them again by hitting "start harvesting" every 30-45 minutes.
I tried to automate this but didn't fond a way. In automator if I add "loop" the process starts again with the initial keywords I put in the "harvest urls" command from automator. I tried to add a delay and then add a new "harvest urls" command with 0 keywords and all defaults. Didn't worked. Basically I want to put the initial lsit of keywords and after the process is finished scrapebox to start again the harvesting with the remaining keywords.
Hope I was clear about this and I'm sure automator can do that but didn't figured out yet how exactly.
Thank you
fb3003
Elite Member
- Aug 14, 2015
- 5,035
- 3,500
interested to know which search engines you guys select for your harvesting efforts. Selecting too many slows the process down. It seems Bing gives the best result using public proxies. MyWebSearch also provides ok results.
has anyone relies on a single search engine for their harvesting efforts? if so, which one?
has anyone relies on a single search engine for their harvesting efforts? if so, which one?
fb3003
Elite Member
- Aug 14, 2015
- 5,035
- 3,500
i highly suggest to learn to use scrapebox to get your hand on few high TF expired web 2.0. tumblr, over-blog, wikidot, strikingly, etc.
dont use scrapebox to build backlinks to your money site or tier 1. it would just increase CF and decrease TF, which is not good
Interesting info. So does Scrapebox allow filtering its results by TF?
fb3003
Elite Member
- Aug 14, 2015
- 5,035
- 3,500
if you have majestic account, then you can use a plugin in scrapebox to view majestic TF
koolkake
Regular Member
- Jul 2, 2014
- 250
- 237
lol scrapebox "limited". TF is a MajesticSEO metric. Why on earth would you think you'd get Majestic API too? And $50 a month for Majestic metrics- that's cheap. They must of lowered the price. Yawnn.
Anyways,
I have Scrapebox with all premium plugins. Trying to find the best way to scrape FAX numbers. Anyone have any ideas?
- Jan 25, 2009
- 6,378
- 3,774
Majestic only allows a few free checks, so no tool is going to give you unlimited checks, its not possible. So if you want to call scrapebox limited in this way, sure its limited. ITs also pretty limited in that it can't print money, give you free bit coin and make you lunch, so I guess its pretty limited and you should not buy it.
Also every other tool out there is pretty limited, if you want majestic, because you will have to buy it. So I guess the whole worlds programs are limited, just don't buy anything. Thats askin to what your saying.
I think scrapebox is probably the most versatile internet marketing tool in existence.
Yeah $50 a month for majestic is dirt cheap, where do I signup? lol
Phone number scraper? You could page scan all the pages with the page scanner first. I think I answered this in another thread though.
~~~~~~~~~~~~~~
Sorry to burst your bubble of ignorance guys, but there are actually lots of tools out there that integrate the Majestic API already, without having to shell out $600/year.
For hardcore SEO'ers, I'm sure the Majestic API is really useful, but for those of us who simply dabble a bit into SEO, no thanks.
- Jan 25, 2009
- 6,378
- 3,774
Scrapebox doesn't require the API account, any majestic account type will work. But if its not a paid account of some level then its not going to give you very many lookups before it gets blocked for the day.
Which tools out there give you unlimited majestic lookups and only have a $67 or lower 1 time lifetime cost and have anything close to scrapebox by comparison?
Or Id even settle for a list of the tools that have a 1 time payment of low dollars and provide lifetime unlimited lookups?
I actually posted an example of exactly just that on this thread yesterday, (it's actually free), but I don't think I'm allowed to promote another service on this thread (fair enough), so looks like the mods removed it. You were online at the time, so hopefully you caught it, in which case, point proven.
- Jan 25, 2009
- 6,378
- 3,774
No I did not catch it. Perhaps you can pm me? Your saying a service taht is free that gives unlimited majestic lookups? Seems unreal, but if you can give me that Id definitely love to have it.
- Jan 25, 2009
- 6,378
- 3,774
Ok, so I am happy to share this info here, you are talking about a site that lists free expired domains. This is the site:
https://www.expireddomains.net
yes its free, but its completely comparing apples to oranges. You said there was a tool that allowed free unlimited majestic lookups, this doesn't do that at all. It just does 1 lookup for each domain it knows of and stores the data and you can sort by it.
But that is of no use for the metrics checker plugin or the expired domain finder plugin. @fb3003 said
"TF expired web 2.0. tumblr, over-blog, wikidot, strikingly, etc."
So he is talking about finding your own with scrapebox. The ones on that site are highly picked over. You can use scrapebox to find your own, with the backlinks you want from sites you want, and from your own niche etc... Then you can check the metrics of that.
You said then that
"This means without paying a minimum of around $50 per month, Scrapebox is pretty limited. I'll pass."
But thats not true, you could find 1 quality domain that is worth more then $50 or a few that are worth that much with scrapebox, ones that will never make it to the site your talking about.
You said:
"Sorry to burst your bubble of ignorance guys, but there are actually lots of tools out there that integrate the Majestic API already, without having to shell out $600/year."
But we are talking about doing our own lookups, finding domains not on lists on free sites that are highly looked at. Thats not a tool like scrapebox is, its a site thats a list. Are there sites that are lists of limited data that include majestic metrics, yes. Are there Tools that allow you to input your own urls, do lookups of majestic for free in mass bulk? I say no, but again if you can provide an actual tool thats not just a limited data set thats really a glorified list, then please provide.
Else your missing the point on the mass value scrapebox can provide. At the end of the day you get what you pay for.
We want to find our own, in our own niches, and get info for our own urls. No tool will do that for free, because majestic charges, and if there is a tool please share it. But know that the scrapebox userbase will in short order cost that tool so much money in lookups that it will go out of business.
At any rate Im not trying to turn this into a flame thread, Im just trying to say your comparing apples to oranges and that doesn't do anyone any good.
I wish you luck though, if you can find what you want on that free site, more power to you. For the rest of us we are going to stick with our tools and do what we know works.
This is actually a very good answer, thanks.
I have no issue with informed, educated answers that add value and aid members.
The problem I had was with your first reply to me, which was loaded with unhelpful sarcasm. So as soon as you mentioned (in your first reply), "Also every other tool out there is pretty limited, if you want majestic, because you will have to buy it. So I guess the whole worlds programs are limited, just don't buy anything." - then I had to point out the error of this statement - I've just proved to you that there is an online tool which already incorporates majestic, for free. As for comparing "apples to oranges", yep I agree, but you sarcy statement above actually said, "every". Couldn't let you get away with that so fast.
But to sum up, thanks for your latest explanation, and I agree with what you say.
- Jan 25, 2009
- 6,378
- 3,774
scrapebox uses the info: operator. Its working spot on for me, can you give some example urls/domains?
Glad you agree. The difference is semantics I guess, i would not call the site you sent a tool, its a list of data. You can't go there and input sites and have it crawl them to find domains or load in your own urls to check - thats what a tool does.
All you can do is go thru a list of prepopulated data that they have and search it. Its a glorified excel document IMHO, not a tool. So I would still say that there is no tool out there that lets you give free majestic lookups unlimited without paying, at least not as defined within the context of the user inputting the data like scrapebox and manipulating data that is custom.
However I agree, there are data sets out there that are free that (inside the scope of that pre-existing data set) include majestic metrics.
Anyway i hope that you find the tool or data set or whatever it is that you are looking for at a price you are happy with - and that you then use that to make some money.
- Status