[Question] Footprints + Keyword Merger, Scrapebox Alternative?

[Studyhard123]

Hey guys, I'm attempting to merge 1.5 Million keywords with roughly 2,000 footprints, but there is no way scrapebox can handle this on my VPS.

Does anyone know any program that can merge these 2,000 footprints with every keyword without eating up all RAM? I'm going to set this to scrape for months to come.

Splitting the files and merging will eat up a lot of time.

Thanks.

 

[Studyhard123]

Can anyone suggest something please?

 

[crazyflx]

Try this: http://www.blackhatworld.com/blackh...apebox-large-numbers-footprints-keywords.html

 

[Studyhard123]

Try this: http://www.blackhatworld.com/blackh...apebox-large-numbers-footprints-keywords.html

Just curious, why are there so many trojans?

https://www.virustotal.com/en/file/...7c0588b93ad83b60b1c0d645/analysis/1386452667/

 

[crazyflx]

Just curious, why are there so many trojans?

https://www.virustotal.com/en/file/...7c0588b93ad83b60b1c0d645/analysis/1386452667/

Well, you can see the file hasn't changed since I uploaded that way back when, and then VT only reported it as having one. Not sure why it shows as 16 now...that's crazy.

In any case, it's a uBot and uBots are notorious for showing up as having trojans in VT for some reason.

Google: "ubot trojan" (without quotes of course) and you'll see what I mean.

 

[Studyhard123]

Well, you can see the file hasn't changed since I uploaded that way back when, and then VT only reported it as having one. Not sure why it shows as 16 now...that's crazy.

In any case, it's a uBot and uBots are notorious for showing up as having trojans in VT for some reason.

Google: "ubot trojan" (without quotes of course) and you'll see what I mean.

Alright I tried it and I got this error:

http://pastebin.com/WPYpSSc6

 

[Nightly]

My suggestion Is break your KW's Into smaller parts.

http://sourceforge.net/projects/simpletextsplit/

That will split whatever list you have Into as many parts as you want. I have had to merge huge KW lists with footprints In the past, and that tool helped me out a ton.

Especially when harvesting considering SB can only harvest 1 million URL's. No point In running giant lists If the URL's wont be saved past a million.

If your box can't handle the merge, upgrade. Or use a little spare time to split the list with software above (which takes 10 seconds) and merge the KW's.

There Is the above software which a user posted, but I have not used It so I can't comment. Also yes, Ubot Is notorious for false positives. Really any piece of software Is If enough people bind their malware to the original. If you're still worried, https://malwr.com/analysis/MDE2MmU1ZmM4YjBkNDQwZjhkNThiYWZkZjIwNjkyNjg/

I don't see anything wrong with It

 

[Studyhard123]

My suggestion Is break your KW's Into smaller parts.

http://sourceforge.net/projects/simpletextsplit/

That will split whatever list you have Into as many parts as you want. I have had to merge huge KW lists with footprints In the past, and that tool helped me out a ton.

Especially when harvesting considering SB can only harvest 1 million URL's. No point In running giant lists If the URL's wont be saved past a million.

If your box can't handle the merge, upgrade. Or use a little spare time to split the list with software above (which takes 10 seconds) and merge the KW's.

There Is the above software which a user posted, but I have not used It so I can't comment. Also yes, Ubot Is notorious for false positives. Really any piece of software Is If enough people bind their malware to the original. If you're still worried, https://malwr.com/analysis/MDE2MmU1ZmM4YjBkNDQwZjhkNThiYWZkZjIwNjkyNjg/

I don't see anything wrong with It

I've run it on my VPS and it worked. But crazyflx's program doesn't do anything once I press start.

Also, splitting up the files manually would take days on end. There would be a total of 2,000,000,000 keywords combined with footprints.

 

[hnmfvnxe]

Why trying to make such a huge list. No way you will be able to scrape something that huge. As others said try with smaller list.

 

[Studyhard123]

Why trying to make such a huge list. No way you will be able to scrape something that huge. As others said try with smaller list.

It's a list for the next few months and even a year. I'll be giving it out to the public because of how big it is. I really don't want to do it manually as it will take me days on end.