Internet-Marketer
Power Member
- Jul 9, 2013
- 633
- 130
WOW! Scrapebox just turn almost 9 years and 2 months old. Happy to see that! Btw I am SB user too almost 7 years.
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
- Jan 25, 2009
- 6,378
- 3,774
Yeah, its been a long time for sure, time flies though! Hope we are posting about it another 9 years from now!
You purchase scrapebox and then you get to choose to make your purchase a mac OR a windows license. Once you choose its locked to that OS indefinitely.
If you want to use it on mac and windows you need 2 licenses. You can use each license only 1 OS. You do still get a transfer each month to transfer it to a new machine, but only a machine of the OS that your license is for.
If they require recaptcha, then its not going to work.
Scrapebox has lots of footprints built in, and I have a video, which I will put below, on how to make your own footprints. But I don't sell my footprints.
Last edited:
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
You can use the Dupe Remove addon to break down the list in smaller sizes. Ideal bellow 1 mill lines.
- Jan 25, 2009
- 6,378
- 3,774
Do you have auto remove duplicates turned on? Because if you have a mass of duplicates this could happen.
Else if there is some formatting issue it could cause this.
Otherwise it should import them all or crash if you run out of memory or something.
AS mindmaster noted above, try splitting them into smaller chunks, does it then import?
Also in that same addon is a dupe remover, you can do that first, as its probably a good idea to remove duplicate urls (unless you want duplicates for some reason).
qlithe
Supreme Member
- Feb 14, 2012
- 1,252
- 288
Yeah I just tried the dupe remover, but there seems to be no duplicates since the new file is the same size.
So you're telling me I should be able to import it? There are 10589980 lines exactly.
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
No.
There are limitations to how many lines you can import.
Break the list down to smaller lists. Go with maximum 1 million lines per list that you want to import.
qlithe
Supreme Member
- Feb 14, 2012
- 1,252
- 288
Just tried that and tried to import 1 mil lines. But the amount that got imported is exactly the same as when I tried with the 10mil file (ca 100k lines)
Not sure what could be wrong with the file?
I got the links from the "Grab links by crawling a site"
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
There might be something wrong with your file.
Those new files with 1 millions files, can you open them in notepad or notepad++?
Those new files with 1 millions files, can you open them in notepad or notepad++?
qlithe
Supreme Member
- Feb 14, 2012
- 1,252
- 288
Yes.
I just realized that there are a lot of duplicates. But when I ran it through the dup remover tool, the new file was the exact same.
I have done nothing to the file. It comes directly from the "Grab links by crawling a site".
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
Clean your list.
I recommend you start with the small lists. It is faster this way.
Then if it remains below 1 mill, you can merge those lists and import.
Simple.
qlithe
Supreme Member
- Feb 14, 2012
- 1,252
- 288
Clean your list.
I recommend you start with the small lists. It is faster this way.
Then if it remains below 1 mill, you can merge those lists and import.
Simple.
I split it into 10 files 1mil each, but when I import them only a smaller amount show up.
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
Mate. Take each one of those smaller files and process them through the Dupe Remover. Clean them. Remove duplicate urls and whatever else you want to clean.
- Jan 25, 2009
- 6,378
- 3,774
Windows has a limitation around 120 million lines that it can support in a grid view. Technically, if you have scrapebox 64bit and you have enough memory to handle it, then you can work with a file up to the windows limitation of 120 million lines.
that said, there are more realistic limitations and if file size is too big and you try and import it, scrapebox will give you an error saying its too big. I have many times, even recently imported and worked with more then 10 million lines in the urls harvester grid.
But given that it cuts off at 100K and the dupe remove behavior, its likely there is some formatting in your file that is causing scrapebox to think that the file ends at 100K so its not looking at the rest of the lines.
So that could be some data that was scraped from a site or that came from something else altering the file.
So import the file into scrapebox, take note of the exact line count. Lets say it imports 109,332 urls.
Open your file in notepad++
Go to line 109,332 and the lines before and after that and have a look, is there funky stuff? Maybe just delete 10 lines before and after that line and save and try again.
I think so, Ill find out.
- Jul 13, 2008
- 2,219
- 5,431
Once the end of the proxy list is reached, it will reload the server proxies.
kveldulv
Regular Member
- Aug 19, 2009
- 223
- 91
Something else to check might be your file encodings.
Scrapebox has a converter, but you can do it faster with powershell.
Scrapebox has a converter, but you can do it faster with powershell.
Code:
convert all .txt files to ascii encoding, writes new files.
Get-ChildItem *.txt | % { Get-Content $_ | Out-File -Encoding Ascii "$($_.basename)-ascii.txt" }
strannik-ps
Registered Member
- May 26, 2018
- 65
- 19
Hello,
there is a serious bug in Scrapebox, in all Addons when scanning URL at the end of the analysis, the assets of threads remain, the stop button does not stop the process from the program as well.
It is necessary to correct this error is lost a lot of time for analysis.
there is a serious bug in Scrapebox, in all Addons when scanning URL at the end of the analysis, the assets of threads remain, the stop button does not stop the process from the program as well.
It is necessary to correct this error is lost a lot of time for analysis.
- Status