Permanently Closed Marketplace Sales Thread

Status
Not open for further replies.
when I use any harvester (custom or detailed), I see that the keyword is automatically set to Exact keyword. If my keyword is money and footprint is "powered by wordpress" , i see that it becomes "powered by wordpress" + "money"

But I want it to be like this :-

"powered by wordpress" + money
Or
"powered by wordpress" money

how can i do that in version 2?
 
I dont get results anything like yours, i get 74 unique keywords. With yours the only keywords that are duplicates are the ones you entered yourself there's no scraped duplicate keywords. It looks like you are clicking abort, the keyword counters are on 1/3 and for Google and 2/3 for Yahoo and Bing and the other 3/3. So just let it finish so it can remove dupes.

HI Man what are you talking about, keywords i entered myself ??? how is it possible to add keywords to results in V2.0 The only way the results will show in V2.0 is when the scraper stop. Yes some are red but i have no controll over that --- surely you know that in V2 results will ONLY disply ones the scrape is comple.

I made another screencase for you this time from start to finish of the project - https://dl.dropboxusercontent.com/u/13369868/Scrapebox2.mp4 the video qiality is a bit crap, so let me know if you cant see it and i will make a new video.


IT DOES NOT AUTOMATICALLY REMOVE THE DUPPLICATES !!!!!
 
For SB 2.0

Where is the addon of "Learning Mode Poster"?

This is now the main Fast Poster in ScrapeBox v2, and it uses the platform files in \Configuration\Platforms\

when I use any harvester (custom or detailed), I see that the keyword is automatically set to Exact keyword. If my keyword is money and footprint is "powered by wordpress" , i see that it becomes "powered by wordpress" + "money"

But I want it to be like this :-

"powered by wordpress" + money
Or
"powered by wordpress" money

how can i do that in version 2?

You can put this whole query directly in to the keywords field in ScrapeBox, without putting anything in to the footprints field. There's a minor bug with this when using the footprints field which is fixed in the next version.

HI Man what are you talking about, keywords i entered myself ??? how is it possible to add keywords to results in V2.0 The only way the results will show in V2.0 is when the scraper stop. Yes some are red but i have no controll over that --- surely you know that in V2 results will ONLY disply ones the scrape is comple.

I made another screencase for you this time from start to finish of the project - https://dl.dropboxusercontent.com/u/13369868/Scrapebox2.mp4 the video qiality is a bit crap, so let me know if you cant see it and i will make a new video.


IT DOES NOT AUTOMATICALLY REMOVE THE DUPPLICATES !!!!!

Much better, your last video didn't show how this was happening. It's a timing bug i couldn't replicate, but it's fixed in the next beta version.
 
in V2 any way to just scrape news for the last 24 hours ?

Loved this feature in V1

edit: i think i found it . For anyone else looking its an available engine in the harvester. Still struggling for news tho
Screen Shot 2015-02-16 at 6.45.34 AM.png
 
Last edited:
in V2 any way to just scrape news for the last 24 hours ?

Loved this feature in V1

edit: i think i found it . For anyone else looking its an available engine in the harvester. Still struggling for news tho
View attachment 60797

That's the great thing about the Custom Harvester, it's completely trainable to do almost anything. :)

For 24 Google news you can just duplicate the regular Google engine and add &tbm=nws&tbs=qdr:d to the end of the URL and it will give you Google News during the last 24 hours. But i've just trained a custom engine for you, download:

http://www.scrapebox.com/random/news.zip

Unzip it and in ScrapeBox go to Settings >> Harvester Engines Configuration >> Import and select the google-news.dat i made and it will create a new engine for Google news within the last 24hr.
 
That's the great thing about the Custom Harvester, it's completely trainable to do almost anything. :)

For 24 Google news you can just duplicate the regular Google engine and add &tbm=nws&tbs=qdr:d to the end of the URL and it will give you Google News during the last 24 hours. But i've just trained a custom engine for you, download:

http://www.scrapebox.com/random/news.zip

Unzip it and in ScrapeBox go to Settings >> Harvester Engines Configuration >> Import and select the google-news.dat i made and it will create a new engine for Google news within the last 24hr.

WOW!!!! AWESOME TY!!

I do have one more question, im trying to scrape sites with the facebook social plugin. when i do a regular search for "facebook social plugin" + keyword i get a bunch of results but then with SB i get nothing? what am i screwing up?
 
Please add the option "Randomize Keywords" to the Automator plugin. It most certainly belongs there.

I really don't want to rush you guys, but please try to add it as soon as you can. I've spent weeks in perfecting my setup and now when I wanted to automate it with automator I'm not able to because of this simple option missing.

Thanks!
 
WOW!!!! AWESOME TY!!

I do have one more question, im trying to scrape sites with the facebook social plugin. when i do a regular search for "facebook social plugin" + keyword i get a bunch of results but then with SB i get nothing? what am i screwing up?

It works for me just fine. Can you give a screenshot? If you use the detailed harvester does it give you any errors?
 
Please add the option "Randomize Keywords" to the Automator plugin. It most certainly belongs there.

I really don't want to rush you guys, but please try to add it as soon as you can. I've spent weeks in perfecting my setup and now when I wanted to automate it with automator I'm not able to because of this simple option missing.

Thanks!

We added "Randomize keyword list" to Automator and it will be available with the next update of Automator and ScrapeBox.
 
Hey - I have a small feature request if possible (for v2). I'd like to trim the harvested URLs based on regex. Let me know
 
Hey - I have a small feature request if possible (for v2). I'd like to trim the harvested URLs based on regex. Let me know

Not sure if they will add this or not, but you could simply build your regex statement outside of the automator in an external program and then call that from the automator and it would get the job done.
 
Immagine.png

Hi, why have this result with this custom footprint: inurl:details.php ??

thanks
 
I need to suggest another feature for the automator which I think needs to be addressed.

When using the automator for harvesting and adding a loop, the harvester will save each session in the same file. While this is not an issue, since scrapebox appends the urls to the same file and does not overwrite it, it makes the file very large in size with time and it's not practical.

What I suggest is add some kind of numbering for each session when the automator is used.

Example: I have 2 harvesting commands (lets call them engines 1 and engines 2) in a loop into one automator job. Each of them scrapes for different engines and it saves the urls in respective files: engines1.txt and engines2.txt. Scrapebox will append the newly scraped urls to those files after each session is finished. However with time, those two files become very large and a hard to maintain.

If Scrapebox will add a counter to each session and save each finished harvesting session in the same folder as:

engines1_1.txt, engines2_1.txt ;
engines1_2.txt, engines2_2.txt ;
engines1_3.txt, engines2_3.txt ...and so on...

It will be much easier.

And if the automator job is stopped and then started again, and the files engines1_1,1_2 and 1_3 exist in the folder, scrapebox should continue the counter from where it left and not overwrite the existing files. Example: engines1_4, engines1_5... etc..
 
I need to suggest another feature for the automator which I think needs to be addressed.

When using the automator for harvesting and adding a loop, the harvester will save each session in the same file. While this is not an issue, since scrapebox appends the urls to the same file and does not overwrite it, it makes the file very large in size with time and it's not practical.

What I suggest is add some kind of numbering for each session when the automator is used.

Example: I have 2 harvesting commands (lets call them engines 1 and engines 2) in a loop into one automator job. Each of them scrapes for different engines and it saves the urls in respective files: engines1.txt and engines2.txt. Scrapebox will append the newly scraped urls to those files after each session is finished. However with time, those two files become very large and a hard to maintain.

If Scrapebox will add a counter to each session and save each finished harvesting session in the same folder as:

engines1_1.txt, engines2_1.txt ;
engines1_2.txt, engines2_2.txt ;
engines1_3.txt, engines2_3.txt ...and so on...

It will be much easier.

And if the automator job is stopped and then started again, and the files engines1_1,1_2 and 1_3 exist in the folder, scrapebox should continue the counter from where it left and not overwrite the existing files. Example: engines1_4, engines1_5... etc..

I totally agree - the same thing - numbering instead of overwriting would also be useful for all addons that we want to run on daily basis.
 
Is it possible to contract SweetFunny to do my scraping for me? I'd prefer someone who can use Scrapebox to it's full capability, not myself delaying things with the learning curve :P
 
Can we add some more statistics and numbers for domain and URL checking?

I think maybe a domain age, whois, alexa rank, DA, etc might be helpful.
 
View attachment 60877

Hi, why have this result with this custom footprint: inurl:details.php ??

thanks

Your IPs are either banned in general or banned for advanced operators. So you need new/different proxies or to wait until they are unbanned.

I need to suggest another feature for the automator which I think needs to be addressed.

When using the automator for harvesting and adding a loop, the harvester will save each session in the same file. While this is not an issue, since scrapebox appends the urls to the same file and does not overwrite it, it makes the file very large in size with time and it's not practical.

What I suggest is add some kind of numbering for each session when the automator is used.

Example: I have 2 harvesting commands (lets call them engines 1 and engines 2) in a loop into one automator job. Each of them scrapes for different engines and it saves the urls in respective files: engines1.txt and engines2.txt. Scrapebox will append the newly scraped urls to those files after each session is finished. However with time, those two files become very large and a hard to maintain.

If Scrapebox will add a counter to each session and save each finished harvesting session in the same folder as:

engines1_1.txt, engines2_1.txt ;
engines1_2.txt, engines2_2.txt ;
engines1_3.txt, engines2_3.txt ...and so on...

It will be much easier.

And if the automator job is stopped and then started again, and the files engines1_1,1_2 and 1_3 exist in the folder, scrapebox should continue the counter from where it left and not overwrite the existing files. Example: engines1_4, engines1_5... etc..

You can do this with a batch file, and just call it from the automator. Support actually made it and gave it to me.

set destination=C:\test
set Location=C:\test\proxies.txt
set Filename=proxies
set a=1

:loop
if exist %destination%\%filename%_%a%.txt set /a a+=1 && goto :loop
copy %location% %destination%\%filename%_%a%.txt

What it will do when run is create a copy of the file proxies.txt and rename it to proxies_1.txt and next time it's run it will create proxies_2.txt and so on. So you can call it from the Execute external app step, also this you can use for any feature that exports a file not just for proxies/harvesting.


Does it make sense?

http://scrapeboxfaq.com/how-to-increment-files-that-are-saved-by-the-automator



I totally agree - the same thing - numbering instead of overwriting would also be useful for all addons that we want to run on daily basis.

Above ^^

Is it possible to contract SweetFunny to do my scraping for me? I'd prefer someone who can use Scrapebox to it's full capability, not myself delaying things with the learning curve :P

Thats unlikely. They are busier then I am and I wouldn't do it. No offense, but its just not something I would want to get into. But you could probably find someone on fiverr to do it.

Can we add some more statistics and numbers for domain and URL checking?

I think maybe a domain age, whois, alexa rank, DA, etc might be helpful.

You can get alexa rank from the alexa addon and you can get Domain Authority from the page authority addon. You can get whois data from the whois addon.
 
Last edited:
Status
Not open for further replies.
Back
Top