Permanently Closed Marketplace Sales Thread

[seodeal]

is it possible to extract links from Facebook using scrapebox

 

[Sweetfunny]

is it possible to extract links from Facebook using scrapebox

I believe your email also came in to support at the same time this post was made and was answered there, but to answer it again here... The next version of ScrapeBox allows you to increase the harvester threads this high in the GUI. But if you shut ScrapeBox down, in the Configuration folder is scrapebox.ini which you can open in Notepad.

You can see under the [Harvester] section there's the number of Connections= which you can change.

Edit: I see you changed your post to something completely different making this reply redundant.

 

[Daffy10]

Hi, please can you tell me how can I do for scrape all url on google with a specific keyword search? because I think that I wrong.


Thanks

 

[adamex1970]

You can do this with a batch file, and just call it from the automator. Support actually made it and gave it to me.

set destination=C:\test
set Location=C:\test\proxies.txt
set Filename=proxies
set a=1

:loop
if exist %destination%\%filename%_%a%.txt set /a a+=1 && goto :loop
copy %location% %destination%\%filename%_%a%.txt

What it will do when run is create a copy of the file proxies.txt and rename it to proxies_1.txt and next time it's run it will create proxies_2.txt and so on. So you can call it from the Execute external app step, also this you can use for any feature that exports a file not just for proxies/harvesting.


Does it make sense?

http://scrapeboxfaq.com/how-to-increment-files-that-are-saved-by-the-automator

Yes - but it's a very complicated way and can cause many files being overwritten - let's say we have folders when we store harvested files, extracted links - when we close scrapebox and run those bat file again it starts counting from 1 - am I right?

It would be much easier if there was an option in automator to save file adding a number - checking if there is not such one in the whole directory. Or/And another solution - the save/export file option would be able just to append insted of recreating file - it's lacking now and when we want to have everyting in one place it would be much easier to maintain.

 

[spiritfly]

Yes - but it's a very complicated way and can cause many files being overwritten - let's say we have folders when we store harvested files, extracted links - when we close scrapebox and run those bat file again it starts counting from 1 - am I right?

It would be much easier if there was an option in automator to save file adding a number - checking if there is not such one in the whole directory. Or/And another solution - the save/export file option would be able just to append insted of recreating file - it's lacking now and when we want to have everyting in one place it would be much easier to maintain.

I think that code won't overwrite the files. It checks if there are existing files in the format filename_1.txt it goes to check for filename_2.txt.. and so on until it gets to the unused number and it will continue from there.

While it seems like a solution, I myself too think it's not an elegant one. I can't think of what can go wrong with it now, but I'm sure something messy can come up, like stopping the automator job manually after the bat was executed and before the harvest has started and stuff like that... Anything can happen as long as it's not integrated into scrapebox.

EDIT: Actually when I look at the code better now, this won't work like this. The file proxies.txt should not be just copied, but renamed to proxies_1.txt. The harvester does not overwrite proxies.txt with each finished harvesting session, but it append the urls to the existing ones inside proxies.txt. So what needs to be done is to rename the file after the session has finished for the code to work properly.

Come on guys, this can't be that hard to do it's a simple feature and will do an amazing job if implemented. Definitely belongs into the automator to make it perfect for harvesting.

 

[loopline]

Hi, please can you tell me how can I do for scrape all url on google with a specific keyword search? because I think that I wrong.


Thanks

Just enter your keyword in the keyword box and scrape. I don't understand the question, can you be more specific?

If there is more then 1000 results then you need to add other keywords or letters or numbers on to the end of your keyword. This forces google to return different sets of results from its database. Then just remove duplicate urls when you are done.

Yes - but it's a very complicated way and can cause many files being overwritten - let's say we have folders when we store harvested files, extracted links - when we close scrapebox and run those bat file again it starts counting from 1 - am I right?

It would be much easier if there was an option in automator to save file adding a number - checking if there is not such one in the whole directory. Or/And another solution - the save/export file option would be able just to append insted of recreating file - it's lacking now and when we want to have everyting in one place it would be much easier to maintain.

I guess it can look complicated, but batch files are quite simple, probably the simplest of the simple. I can tell you from someone who has tried to run an IM business for years without knowing how to code a full language (Ive known batch files I guess since I messed around in DOS in grade school 20 years ago) but once you learn its exponentially simpler. Ive learned python and 1 single script I wrote earlier this year will save me 60 hours of work this year. Thats over a week of work, even if you work 60 hour weeks. A machine does it for me while I sleep and while I play with my kids and while I do anything else.

Learning to write a batch file is akin to learning what the acronym SEO stands for, if you want to succeed in IM, IMHO.

The reason I say that is the flexibility that it gives you is like nothing else. Apply a little extra effort, which may be no more then googling for existing code and hacking at it (which is what I do for batch files because just about everything you can think of is already made, so why reinvent the wheel). At the end of the day it takes a little work, but you could do all kinds of things. Like harvest and then have your file incremented and then call another automator job to process taht file while your first job loops or archive it off in dropbox or I don't even know. The sky is the limit.

Invest 30 mins a day for 2 weeks on learning batch files and you will have a basic skill you can use for the rest of your life to do work for you. It took me months to learn python, and Im still learning. Im a quick study at most things, but coding doesn't come easy for me, in fact its one of the hardest things I have ever had to learn frankly. Its no easy for me and it takes a serious amount of work. I have little time for it as well, which makes it worse. However I can say that just this year I have written scripts that will save me more time just in 2015 then it took me to learn python. Plus Ill make more money. Seriously Ill work less and make more when its said and done. And I will know a language, and I can use that to scale for the rest of my life. My 2 cents.

I think that code won't overwrite the files. It checks if there are existing files in the format filename_1.txt it goes to check for filename_2.txt.. and so on until it gets to the unused number and it will continue from there.

While it seems like a solution, I myself too think it's not an elegant one. I can't think of what can go wrong with it now, but I'm sure something messy can come up, like stopping the automator job manually after the bat was executed and before the harvest has started and stuff like that... Anything can happen as long as it's not integrated into scrapebox.

EDIT: Actually when I look at the code better now, this won't work like this. The file proxies.txt should not be just copied, but renamed to proxies_1.txt. The harvester does not overwrite proxies.txt with each finished harvesting session, but it append the urls to the existing ones inside proxies.txt. So what needs to be done is to rename the file after the session has finished for the code to work properly.

Come on guys, this can't be that hard to do it's a simple feature and will do an amazing job if implemented. Definitely belongs into the automator to make it perfect for harvesting.

If you use the export urls from harvester function, it overwrites. Also you can just add a line like this

del /q %location%

Make that the last line and it will delete the original file after it has copied it to the new file name with a number.

Alternatively there is probably a a rename command, I think its REN

Edit: Yes its REN
https://technet.microsoft.com/en-us/library/bb490987.aspx

so you could rename the original file, thus it would be the same as copy and deleting it.

Im not saying that as a license holder that you don't have the right to request that SB build in a function that will do all this for you. What I am saying is that if you think in terms of "how can I solve this" instead of "why can't THEY solve this" then you change your attitude from being locked down to being creative and thats when things start to happen. Often you take the first step and that lights a spark and then you wind up doing not only what you set out to do, but doing something greater and you would have never go there if you just worked inside the box rather then outside the box (no pun intended).

Yes I probably sound like Im preaching what my motivational audio books say, Zig Ziglar was great. But its true, I know it, because its happened to me and it keep happening. I learned python for 1 reason, so I could automate 1 thing that I couldn't do and now I have discoved all kinds of things along the way and I have scripts running on several servers. With each new script I save a little more time and my products get a little better. My user experience on my websites, with my products, the quality of my products, how many links I can build in a given time, how well I can rank a site, it all gets better, while I spend less time. Its a total win win.

Plus frankly I love completing a script and watching it run. I finished 1 yesterday and it would have taken me literally 20-30 mins 1 time per week to do it. Not a lot of time, but then I also have to remember to do it. The crazy thing is it took python less then 1 second to do all the work. It took me less then 2 hours to figure out how to script it. In 1 months time Ill break even, after that Ill save 2 hours per month, and I don't have to remember to do it. Do that times 5 and Im saving 10 hours a month or 120 hours per year. If you want to work "only" 40 hours a week as the standard full time US job is, then that would be working 3 weeks less and getting the same pay in 1 year. In other words its like giving myself 3 weeks of vacation because my computers do the work, and I get paid the same.

Its insane to think about it, how much time I have lost over the years. Actually thats how Scrapebox started in the first place. They were doing manual SEO tasks and they wrote it to help themselves, then sold it to a few friends to justify the time to add extra features etc.. and then it blew up and here we are.

Anyway, my 2 cents. Do with it what you will.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Edit: Another thing I did was I have a automator script that runs in a loop. I built a python script that when launched will start up Scrapebox and start that automator job and then monitor it. If Scrapebox crashes it will restart Scrapebox (and by way of how it works the files that would have caused the crash are changed out for new ones so it won't crash again for the same reason) and restart the automator job and then also give me a running report with a timestamp of each crash and restart as well as a count of how many times its crashed.

I work with a lot of urls that could be sketchy or problematic and on occasion the content on one of those urls crashes Scrapebox and thus this solution makes it entirely hands off. That way when I go on vacation for 3 weeks I can rest assured that everything will stay running.

(not that I would ever go on vacation for 3 weeks, I don't ever take even 1 day off, but hey at least my automator scripts are always running.)

 

[spiritfly]

I completely understand what you're saying @loopline, interesting to hear some inside info about how you do things. After all it's not just about learning SEO tricks and methods, but some philosophy and personal experiences from successful folks which are highly appreciated and always welcomed to read.

Indeed, to perfect my setup(which I still strive to do) I've created a few vbscripts myself, simple ones, but they do the job and save time as you say. For example I have one for saving public proxies from urls to a txt file(so I can serve it to scrapebox) every few hours, another one for getting a few random keywords from my big lists before every harvesting session..

I also appreciate the code you shared about adding numbering to the files and it's again a simple idea that I would not have thought of. I've already implemented it by changing it to rename the file. Seems to be working with a few simple tests, will see in the long run. Here is how I changed it:

====================================================

set destination=C:\harvested
set Location=C:\harvested\urls.txt
set Filename=urls
set a=1

:loop
if exist %destination%\%filename%_%a%.txt set /a a+=1 && goto :loop
ren %location% %filename%_%a%.txt

====================================================

This will rename the file urls.txt to urls_1.txt. I've inserted this batch file to be executed after each exported url list. I think renaming it will be much more efficient resources-wise and it will be much better than copying and deleting the file, so I went with this solution.

I really appreciate what scrapebox is and does and please don't take us for lazy just because we are requesting new features. I always tend to request only features that I believe will benefit all or at least the majority of users and thus will make scrapebox better. I do know that we don't have exclusive rights to request features as we please, after all scrapebox is dirt cheap for what it does. So I completely accept a rejection of any feature I request. My job is to try and give a suggestion, the developers job is to decide whether to include it or not.

Even though I solved it with that batch script, I still feel like this feature will make things much more solid if inside scrapebox, but I bet the developers have tasks with much higher priority than this right now so I completely accept that and I won't be pushy about it next time.

Thanks again for sharing that batch file!

 

[HelloInsomnia]

Is the alive checker stable/give accurate results above 200 threads?

Not too shabby, Scrapebox 2.0 harvesting at over a million urls per minute.
Video will follow soon. ​

​

Even though I know the result I really want to see this video, any chance you're still going to post it?

 

[Sweetfunny]

I really appreciate what scrapebox is and does and please don't take us for lazy just because we are requesting new features. I always tend to request only features that I believe will benefit all or at least the majority of users and thus will make scrapebox better. I do know that we don't have exclusive rights to request features as we please, after all scrapebox is dirt cheap for what it does. So I completely accept a rejection of any feature I request. My job is to try and give a suggestion, the developers job is to decide whether to include it or not.

Even though I solved it with that batch script, I still feel like this feature will make things much more solid if inside scrapebox, but I bet the developers have tasks with much higher priority than this right now so I completely accept that and I won't be pushy about it next time.

This has been added to the next version of Automator on the Harvest URL's step there's an option to Overwrite, Add Timestamp and Add Number to the exported file.

Mass URL Shortener v2.0 Released

This has now been redone and added to ScrapeBox v2 and features:

There's now 9 default sources.
The ability to add new sources yourself with a basic training system.
Selectable sources.
Resizable GUI.
Export short urls to txt and xlsx
Proxy support

Is the alive checker stable/give accurate results above 200 threads?

Edit: Sorry i overlooked this one. Yes the code is capable but it all depends on the speed of your internet, if you wind the connections up too high you start to run the risk of timeouts because there's not enough bandwidth available to load so many URL's within the timeout period.

You could get a test list you know is 100% alive, and run it a few times and jack up the connections a bit each time to see when you start to get errors, then you know where the limit is.

If the URL's are all from the same website, this changes things again. If that server has a rate limiting firewall even 10 simultaneous request to the one server may block you and in turn produce false results in the alive checker.

 

[HelloInsomnia]

Since V2 has the ability to check platform popularity it would be really nice if we could export the urls based on platform much like the blog analyzer. Or even have an export all to folder and each would be saved under the appropriate text file.

 

[softtouch2009]

Since V2 has the ability to check platform popularity it would be really nice if we could export the urls based on platform much like the blog analyzer. Or even have an export all to folder and each would be saved under the appropriate text file.

The next beta release will have a feature to export the urls based on the platform.

 

[maddawgmackem]

It works for me just fine. Can you give a screenshot? If you use the detailed harvester does it give you any errors?

All i get is it sticking on first keyword if i use cloud proxy, if i use my own it just gets stuck at the first 10, (iam using 10 proxy)


Thankyou

 

[adamex1970]

I constantly get scrapebox crash during custom harvester - I am not sure what cause that (maybe some of the keywords). How can I track that - before posting or after it happen - some logfile showing during which keyword (group of keywords) it happened?

 

[godspeed007]

Hey OP can you change PR to TF in SB? PR is no more a reliable metric.

 

[seodeal]

can scrapebox add a new paid or free addon/plugin for footprint building just like fpfactory. com .i asked this question before and sweetfunny told that it may be possible when version 2 is released. now as version 2 is beta released, you guys can make a addon like this

 

[seodeal]

I believe your email also came in to support at the same time this post was made and was answered there, but to answer it again here... The next version of ScrapeBox allows you to increase the harvester threads this high in the GUI. But if you shut ScrapeBox down, in the Configuration folder is scrapebox.ini which you can open in Notepad.

You can see under the [Harvester] section there?s the number of Connections= which you can change.

Edit: I see you changed your post to something completely different making this reply redundant.

I changed the post to something different because the support solved the problem. now this is the question i want to ask. plz answer it. tnx

 

[zx123]

Please add the "extract only d0follow links" option to the link extract plugin

 

[Kelowna]

Does anyone have a phone number for the scrapebox people? I ordered 24 hours ago, sent several emails, but no reply or activation code.

What is the best way of getting a hold of them?

 

[TeKn1qu3z]

Scrapebox 2.0 is not taking in my MOZ Api key. I cannot use the add-ons.

I have a MOZ Pro subscription and still can't get it to work..

 

[loopline]

I completely understand what you're saying @loopline, interesting to hear some inside info about how you do things. After all it's not just about learning SEO tricks and methods, but some philosophy and personal experiences from successful folks which are highly appreciated and always welcomed to read.

Indeed, to perfect my setup(which I still strive to do) I've created a few vbscripts myself, simple ones, but they do the job and save time as you say. For example I have one for saving public proxies from urls to a txt file(so I can serve it to scrapebox) every few hours, another one for getting a few random keywords from my big lists before every harvesting session..

I also appreciate the code you shared about adding numbering to the files and it's again a simple idea that I would not have thought of. I've already implemented it by changing it to rename the file. Seems to be working with a few simple tests, will see in the long run. Here is how I changed it:

====================================================

set destination=C:\harvested
set Location=C:\harvested\urls.txt
set Filename=urls
set a=1

:loop
if exist %destination%\%filename%_%a%.txt set /a a+=1 && goto :loop
ren %location% %filename%_%a%.txt

====================================================

This will rename the file urls.txt to urls_1.txt. I've inserted this batch file to be executed after each exported url list. I think renaming it will be much more efficient resources-wise and it will be much better than copying and deleting the file, so I went with this solution.

I really appreciate what scrapebox is and does and please don't take us for lazy just because we are requesting new features. I always tend to request only features that I believe will benefit all or at least the majority of users and thus will make scrapebox better. I do know that we don't have exclusive rights to request features as we please, after all scrapebox is dirt cheap for what it does. So I completely accept a rejection of any feature I request. My job is to try and give a suggestion, the developers job is to decide whether to include it or not.

Even though I solved it with that batch script, I still feel like this feature will make things much more solid if inside scrapebox, but I bet the developers have tasks with much higher priority than this right now so I completely accept that and I won't be pushy about it next time.

Thanks again for sharing that batch file!

Yes thats a good idea about grabbing keywords from big files before a harvest, I am going to build that shortly myself. I wasn't trying to backlash at you, just to be clear. As you noted, others sharing useful "real world" tactics that aren't just SEO necessarily is important. I myself have actually learned a lot from others and I also desire to try and share when its useful. So that was my only intent.

Honestly I have avoided learning to code a language, I knew I could, but I know how I learn and the learning curve, for me, would be painful and steep. But basically someone showed me that I could do 1 basic thing that I just had no idea was possible. That 1 thing was so powerful for me that I HAD to learn to code, it was no longer a choice, and so I did. So I guess part of what I was trying to say was just that sometimes I don't know what I don't know, but when someone else showed me it opened my eyes and I just try to do the same for others, if possible.

You seem already on top of things and you are right, its neither you nor I that get to decide if a feature should be built, its SweetFunny and Softtouch that get to decide. I have certainly requested many features over the years. Several of which have been built, and some of which turned out not to be viable for them to build. For me though, I would always ask and then if they didn't build it I would build it myself if it was that useful to me specifically.

But looks like they thought it was a viable idea and added it.

Is the alive checker stable/give accurate results above 200 threads?

​

Even though I know the result I really want to see this video, any chance you're still going to post it?

Yes for sure. I was actually editing it last night ( I recorded a lot of footage, I tend to be long winded and I need to keep it more to the point, lol) but I got side tracked. Anyway, its on the todo, hopefully for tomorrow.

All i get is it sticking on first keyword if i use cloud proxy, if i use my own it just gets stuck at the first 10, (iam using 10 proxy)
View attachment 60964

Thankyou

It looks like you built your own engine. You would need to paste the engine details, you can just export that 1 engine.

Try a sample harvest with no proxy, does it work?

Assuming your engine is setup correctly, then it sounds like its just a proxy issue. The cloud proxies get heavily used no doubt and your proxies may be getting banned. (assuming you don't have some 3rd party software interfering of course, so you can set as allowed in all security software and try shutting down any unneeded programs)

I constantly get scrapebox crash during custom harvester - I am not sure what cause that (maybe some of the keywords). How can I track that - before posting or after it happen - some logfile showing during which keyword (group of keywords) it happened?

In your main Scrapebox folder there should be a bug report.txt file. Send that to support

scrapeboxhelp (at] gmail (dot} com

Does anyone have a phone number for the scrapebox people? I ordered 24 hours ago, sent several emails, but no reply or activation code.

What is the best way of getting a hold of them?

There is no phone number or live support, there is also no activation code. You simply download Scrapebox, run it, click activate, then enter your

Name (Im sure you know this)
Your Email (This is the primary email in your paypal account, or the email you entered at checkout if you payed with a credit card)
Paypal transaction or receipt ID (It will come in an email receipt from paypal and if you have a paypal account you can login and see it as well).

Thats it. Send in the right info and they will have you up and running in 12 hours or less. Also check your spam filter, as they always respond in 24 hours or less.

You can whitelist
@scrapebox.com

as well.

Download here:
http://www.scrapebox.com/payment-received

Scrapebox 2.0 is not taking in my MOZ Api key. I cannot use the add-ons.

I have a MOZ Pro subscription and still can't get it to work..

Does it give an error message or does it just crash or does it say you didn't enter it or?