blackhatzen has created the first in what will hopefully become a line of blackhat tools for Mac users. I've uploaded a demo of our first tool, which is aptly titled Simple Email Scraper. The full version will be on sale in BST at some point later in the week.

This demo version doesn't allow you to adjust the query speed and won't allow you to copy directly from the email list. The full version will not be handicapped this way.

Download blackhatzen's Simple Email Scraper demo

Have fun and let me know if you have any major issues.

__________________

This is very much appreciated! Downloaded and tried out the demo and it worked like a charm. And was actually amazingly fast imo, liked the GUI as well. Good job guys!

I guess full version will include function to search multiple domains at once. Ability to save as CSV or similar, and will be able to remove duplicates (didn't check if this is working in the demo?).

Some general info about my computer, if anyone else run into trouble, to help out with the coding:
OS X 10.4.11
HW: Macbook A1181 (no upgrades)
Boot ROM-version: MB21.00A5.B07
SMC-version: 1.13f3

Looking forward to the full version, and more BH software for us OS X/Mac users.

Great. I'd love to see more tools that operate on OS X.

On a second note, you only seem to be able to scan 10 pages and after that google will stop your queries.

Thanks for the insight. This just started happening. Enough people have downloaded and started using the demo that the SEs must have caught on to the footprint. We're going to be updating the software soon to work around this.

__________________

After some requests and bug reports yesterday, we've updated the demo. As you can see from the screenshot, we are now allowing you to search multiple email domains and keywords at the same time by separating them with commas. We've also worked on making it much more stable.

Click Here to Download the Demo

Feel free to either post here or PM me with any feature requests, bug reports, etc.

__________________

Downloaded the new Demo and its good to see that you really listen to the feedback that you are given, appreciate that. Unfortunately the Google issue still persists and thus makes it more or less impossible to really try out the features.

We're working on a completely randomized footprint along with a few other things to make the SE issue go away. Also, I'm interested to know how large the queries you are running are? I just pulled close to 5,000 emails in under 10 minutes without any errors.

More updates will definitely be coming soon and thank you so much for your feedback. CSV and XML exports are on their way.

__________________

Answering to your quesition on the board in private.. but due to the wine I posted it in public :P

When I try with 10 pages, the first search works fine. With 100 pages it pretty much stops after 10. I can see that google is giving me a captcha and thats where it halts. I am located in XXXX and it seems like it chooses google site according to your IP-address as the messages I have in the TEMP-file is in XXXX. Wont bother to start trying from other IP-addresses (read other countries) at the moment because it seems strange to me that lets say google.jp or google.com should have other search rules/criterias. Counting it a bit roughly I havent been able to download more then about 200 addresses.

Okay cool. Maybe a proxy rotator is the answer then. Thank you so much for your insight. I don't mind it being public so long as I can read it

__________________

A proxy rotator would be very good, as long as it fetches working proxies automaticly.

Hey everybody, we've uploaded a new demo of Simple Email Scraper for OS X here. We've added some more functionality, including randomizing our search pattern so that the footprint is not as easy to catch. The full version now offers full CSV export support. We've included the top 10 email services in the search by default.

If anyone has any questions or comments, please let me know.

Remember that this is certainly still a work-in-progress and that we plan on making some major updates in the near future. Any feedback is greatly appreciated.

__________________

Nice to see the feature updates. I am currently trying out the new version and so far so good. Will let you know if I run into any problems.

kurotenshi,
I really appreciate all of the feedback you've been providing. It's helped us out a ton.

Thank you.

__________________

After playing around with the new version for a couple of days I would say its good to go.
No crashes and everything is working fine. So if you are looking for a neat little email scraper for OSX, go ahead and buy this one.

Good job and good luck oldenstylehats.

To anybody who is interested, this application is now for sale at a discounted rate for BHW members. Click here for the sales thread and reviews.

__________________

I've posted a tutorial outlining one way to effectively use this program at our website.

__________________

After a few of you asked, I've posted a tutorial outlining how to import addresses from this program into PHPlist here.

__________________

Um... Just joined. And as a Mac user, thought what the hell and took the plunge and shed $25.

But before that... I downloaded the demo. Bloody hell. Can I just say freaky? I plugged in my main keywords and the TOP result to pop up was my own e-mail address.

Bugger.

Hot damn.

Freaking hell.

I didn't even know it was on the net - it was my private GMail one.

Nice going guys! Your shiznits work. Credit on that front.

And e-mails were getting spat out thick and fast up till about 5 mins ago when the program just froze entirely. :S Not sure what's up there- have left it a while and no change and no new mails.

- David/HowNowBlackHat

Okay - it ran great for about an hour and then no more e-mails started showing up. So I tried to close the program and it stopped responding so I forced quitted.

Then now whenever I open it back up I can't get any e-mails showing in the box at all after I kick a search off.

What Time Delay settings were you running it at?

__________________

5 Seconds time delay - since then tried messing about with 'em all.

Even 30 second option. Only I'll wait half an hour and nothing will show now.

And please note I'm not getting a Google CAPTCHA message - I just tested.

Though perhaps building in proxy support would be a good idea on a future version? I'm new to scraping (you guys really got me interested though) and I'm excited about the possibilities, hence my... uh... "eagerness" to start. :P

That is truly bizarre. You aren't by chance running it through a VPN, are you? When we were testing we had errors with some but not all VPNs. I don't think anyone has been hipped to the footprint. We just ran a pretty sizable test and had very good results.

Let me know via PM or email if you continue to have issues and we'll figure something out.

Edit: Also, try giving the queries a break for a few hours and see what happens.

__________________

Okay - I'll try again tomorrow. And no, definitely not a VPN.

Must be an issue with my config/setup/ISP or something. I'll drop you a PM if things don't improve.

It was running great up and the lil' blue bar got about 25% of the way through with about a thousand emails harvested and then it just... well. It just stopped.

I'll give it some beauty sleep though. Thanks for the prompt responses!

No problem. We aim to please. When you test tomorrow, try switching around your keyword order and plurality too. Let me know how it goes.

__________________

Thanks mate! I've dropped you a PM with a few comments. Hope that's cool with you guys.

Off to bed - will post improvements if they materialize tomorrow.

Why not try to get it running with Tor that would certainly get rid of the ip tracking and footprint problem from googl

Yeah, we're working on a back-end proxy rotator, but maybe a Tor implementation would be more effective. I'll definitely look into it. Thanks.

The footprint itself is pretty well randomized and I doubt G will be easily able to normalize without someone looking manually. From what HowNowBlackHat told me via PM, it may be his ISP filtering certain kinds of automated processes. He said he'd had issues in the past. We'll see. We're testing the waters of the Mac software world right now and definitely learning a lot as we're going on. We know the market is small, but we're definitely looking for more people to test and play.

__________________

Right - I've successfully ran the program three time... Funnily enough, getting to about 1.5k in the list before it stops dead and then won't work again for another 5 or 6 hours.

In other words - I can run it at this rate successfully four times a day before it stops. Hmph. Hope that made sense. If no-one else is having this then I'm left to presume that it MUST be my ISP - Virgin/NTLworld.

Um okay it's working today - and again. The same problem. Works and always gets to roughly the same amount of mails before stopping. And then won't rework for 4-6 hours. I'm almost certain it's an ISP thing.

Will find out if I can find a WiFi network to bunnyhop onto just for tonight and test.

Perhaps another feature suggestion... Make it possible for us to have multiple instances of SES running at once? Like multiple windows, each building individual lists for individual niches. So I could (once ISP is changed) kick it off before I go sleep and wake up to a few hundred thousand e-mails.

Now that'd be cool.

Oh... and a quick Q, I've done some testing and there seems to be no difference in having it set to "No time delay" as opposed to 5, 15 or even 30. What's the point of the feature? To throttle network traffic/supposedly make it harder to detect automated activity?

- David

We've talked about allowing the option to run multiple campaigns at once, but haven't coded anything yet.

Also, the time delay is more of a suggestion than a set rule. Setting the time delay to 30 increases the statistical likelihood that a delay of 30 seconds will occur, but it is randomized so as not to set off any flags.

__________________

Roger that - thanks for clearing things up.

And at least I know multiple campaigns is at least being discussed then, along with proxy rotators.

Gee-whiz. If Adobe only gave this kind of support for their software. It's not as if they're lacking in manpower or anything. :P Keep it up guys!

Heya all... Long time no post.

Anyhoo, just thought I'd let you know that I'm still having cutout issues, even when using different ISPs. Tried wired ethernet connections and wireless. Just can't understand why the hell it's happening, if no-one else is having the issue.

Any ideas guys?

You'll find the google blockage is purely ip-related. Just like how SEO Elite when misconfigured without a proxy will get you a daddy smack from google queries.

I have a mac sitting around my office, if you want me to test anything for you, just give me a shout (or pm which would get my attention).

Cheers

Hey Blackhatzen dudes,

How's the TOR rotator going? I'm desperate for anything which (quite simply) will let me scrape for lengthy periods of time without the whole process grinding to a hault. Reason being, I'd love to kick off the program and come back a few hours later to find a few hundred thousand e-mails waiting. From what I've seen (10k in 10 mins) this should be more than possible, if only the whole thing didn't stop.

Keep up the great work!

- David

Long time bump. This hasn't been working in 6 months... Any plans to fix it?