Peisithanatos
Registered Member
- Mar 9, 2013
- 59
- 23
It is working fine, thank you fatboy. The only question is to change IP to avoid Google blocks.
[GET] Free content for any niche. (get it before it's gone)
- Thread starter prab1996
- Start date
teh_johnny
Junior Member
- Mar 15, 2011
- 105
- 18
Yea google captcha showed up for me only after about 70 articles 
BreaknBrix
Power Member
- Mar 25, 2014
- 778
- 4,523
Really?! Check out my itrader and see for yourself how badass I am dude
I wasn't talking about you dude. And I'm not talking about royalcoder either. He went to sleep and by the time he woke up it was too late. I'm talking about 3 lazy, self proclaimed "programmers" I contacted from the bot section after royalcoder went to bed, then I manually downloaded 646 articles, I was going back and forth with you and you did not seem to be confident at all in what you were doing. Cause you said:
Then you said:
It seems that Google blocked my IP for too many requests lol. Guess I was too fast for Google
I will continue to work with this to see if I can manage to automate it as much as I can.
Admittedly, you said that AFTER I told you I didn't need your help anymore. But the real reason I didn't need your help is I suspected you would just waste time (which in the end you did because you told me you could do something that you clearly couldn't).
edit: @fatboy - Nevermind. I just figured it out and deleted my response. I don't know why the bot works this way but it takes about 10 minutes just to start doing anything. I tried it again but this time I accidentally forgot to close the program (got a phone call), came back 10 minutes later and noticed it had started scraping articles. So the mystery answer to my question seems to be "press start then ignore the program for 10-15 minutes until it starts running". Sry for complaining it's just seems like a bug or something.
Last edited:
It's quite simple look up gopher protocol http://en.wikipedia.org/wiki/Gopher_(protocol)Thanks for the share man. Content has ALWAYS been my major limiting factor and I wish we could get a more comprehensive collaboration going on this. Although it might be smarter to do in private like the VIP section.
AFAIK, there are thousands, if not hundreds of thousands of databases with free books, articles, and all sorts of shit that is not published on Google.
Like here's 1 example - http://www.monmouthcountylib.org/index.php/research/alpha-content-example
It's a local online library. But I had to register in person and show my ID to get a passcode to access the database. These are suppose to be "public" databases but they're really not because they force you to show ID before you can access the databases. Same thing with many college databases. You can't access them unless you're a student.
1 thing I've always wanted to do is start something called "The Content Project". And start it over in the VIP section.
My plan is pretty simple.
1) Get 100 volunteers to start.
2) At least 25 of those volunteers I want to be college students.
3) Anyone who's graduated college (or not gone at all) would register at their local libraries online database and get passcodes.
4) Anyone in school would share their username and passcode to access college databases.
5) Then basically, anyone who volunteers 1 database would get access to all 100 databases (or more).
To avoid too many people from using the content, if you do not submit at least 1 database and passcode then you can't access any.
I've even thought about paying a developer, then using proxies and a massive harddrive to download all the content from all these databases then pool it into 1 massive private database.
And like I said, nobody could access the database unless they help build it. If their passcode expires it would be associated to their username and they'd lose access to ALL 100+ databases.
Now obviously, this wouldn't benefit everyone on the forum. And it shouldn't. It would only benefit those who actually get off their ass, go to their library and get a passcode. And imagine what benefit this would provide to BH marketers. Imagine having passcodes for 100 databases FULL of content that isn't published on google. IMAGINE what type of benefit that could provide for the few who participate. And IMAGINE if we could pool all that data into 1 database?
Shit would be crazy. You wouldn't have to write an article again for the rest of your life.
-BB
J-S-T
Supreme Member
- Jul 27, 2013
- 1,296
- 656
The Bot is Working absolutely fine With the Cached link of the articles.
Here is what i did to get 100 articles in my Niche.
First Make google show 100 results on a single page... Go to Search settings to do so.
Install this Chrome Extention to Scrape Similar Links
HTML:
https://chrome.google.com/webstore/detail/scraper/mbigbapnjcgaffohmbkdlecaccepngjd?hl=enNow Search> site:voices.yahoo.com "Your keyword here"
This will Give you 100 Results on the search page. Just Right Click on the the first result, you should see "Scrape Similar" Click on it. Thats it You have got all 100 links Which will be saved on Google Docs. you can delete the sheet later on.
Now These are Original article link so just add This
HTML:
http://webcache.googleusercontent.com/search?q=cache:Bot Link
Last edited:
divok
Senior Member
- Jul 21, 2010
- 1,071
- 656
when you have all cached urls , you don't need the bot . Any http downloader will do the job . Check my earlier post .
BreaknBrix
Power Member
- Mar 25, 2014
- 778
- 4,523
Yep. Furthermore, you don't even need the cached urls in the first place.
There is an addon by firefox that works much better. You set results to 100, set the addon to filter "cache", click 1 button and it downloads them all super fast. You do need a proxy switcher. But I was averaging 250-300 articles per proxy and was able to scrape 17,500 articles using less than 70 g proxies. But if you need to scrape like 100,000+ articles you need a better system.
Like retractions system is pure fucking genius. He was using imacros to automate everything, a series of VPN's and a SHITLOAD of proxies. But he was able to scrape a few thousands articles, upload them and get them to me in less than like 3 minutes. And I know he scraped more than 60,000 of his own (he probably downloaded the entire database by now).
-BB
ps. since retraction isn't posting anymore the addon is called "download them all".
Last edited:
J-S-T
Supreme Member
- Jul 27, 2013
- 1,296
- 656
Sure Any other tool can do the job once we have cached urls.
Seriously Mate, But We don't Know which is that "An addon" by firefox.
I managed to manually copy a few quality articles that hopefully will be unique once YV is deindexed by Google. Imo it's pointless to go crazy and copy thousands of articles. For one, most of the articles on YV are total crap. For two, some of the articles I checked have already been published on all kinds of spammy blogs and other automated website. Snippets of most of the articles have been published on multiple different sites as well.
For sure but google bans yo a$$ faster, that was my problem bnb
kvmcable
Supreme Member
- Dec 28, 2010
- 1,354
- 2,823
I just read through this entire thread and when I hit this post I was like "what an arrogant twat". Sorry but you got a shitload to learn mate. You flamed a respected and generous BHW member while leeching a method like a know-it-all from someone much smarter than yourself. Then you have to come on here and tell everyone the leeched method works great but you can't share it with your, "I got some candy and screw you guys", look at me post.
I voted against your promotion to JrVIP because you were such a new member. Others argued you were mature and a nice guy. Well this one post confirmed just what I suspected. How dare you flame Fatboy while having no skills of your own.
Before anyone says this post is sour grapes because BnB won't share his candy; imagine my scraper with over 5 thousand google passed proxies ability to harvest this crap if I wanted it. I certainly don't need any methods from BnB but he sincerely chapped my ass putting down a well respected BHW member that has contributed so much to BHW over the years. BnB learn some respect mate. BTW, you can edit and even remove your posts as a JrVIP.
Last edited:
fatboy
Elite Member
- Aug 13, 2008
- 1,615
- 3,262
Because its Ubot, and its not as good as it used to be - the 10 minutes was probably due to Ubot forcing people running it for the first time to download some files from their servers, the same servers that have been down twice in the last week or so.
However, takes someone with balls to come back and apologise - accepted with thanks.
Thanks for taking the time to say it works with a decent explanation to help people out
Wget in a bash script is all you really need, bit a lot of people won't go down to that for whatever reasons - the plugins and bots are just for convenience.
Mate, thank you for that, appreciated the nice words
blackmint
Senior Member
- Jun 8, 2013
- 931
- 437
Get uncategorised 22,000 Yahoo Voice articles from the below thread.
http://www.blackhatworld.com/blackh...ahoo-voice-over-22-000-articles-download.html
http://www.blackhatworld.com/blackh...ahoo-voice-over-22-000-articles-download.html
ranjim
Regular Member
- Apr 5, 2012
- 399
- 47
BreaknBrix
Power Member
- Mar 25, 2014
- 778
- 4,523
Great. You are entitled to your opinion. And I am entitled to not GAF about you or your opinion. You have 0 clue who I am, how much work I do, how much experience I really have or what type of person I actually am. And I'll tell you what, I don't know much about you, but when YOU start judging a person over **1** measily post .... it makes you look just as bad as you think I do. When YOU judge someone on their post count of all things, it makes YOU look like a pretentious, condescending, hyper sensitive "arrogant twat". I have every right in the world to complain about a bot if it's not working properly. And I was NOT the only 1 who complained so get a grip dude.
Furthermore, I already shared my method. Which allows people to scrape for articles THEY WANT. That way everyone isn't stealing and using the same articles from the same list (which is stupid, does that offend you too?). And it also allows you to download more than a couple hundred articles. If you read my last post, and the edit date, and the "ps", I dropped the tool in black font long before you came in to this thread. I even told people how to use it (before I revealed it) by telling them to set the filter to cache. I told them to use a proxy switcher. There were 3 separate pieces to the puzzle and I dropped them all in multiple posts so only smart, discrete minded people would find the pieces and put them together. You obviously did not put the pieces together and I'm not surprised why.
Last thing. I was not "leeching" anything from retraction. I had a good idea of what to look for and how everything needed to be executed. In fact, I can post my search history to prove I was searching for the same exact type of addon's retraction was looking for. But while I was busy checking chrome and testing their addons, he managed to figure out a few hours faster that another browser had a much better tool. The point is, I would have 100% figured out the details regardless of whether or not he gave me a bullet pointed list of what to do. The reason I was so happy wasn't because he found a method, but because he found the method while there were still lots of articles left. His timing was perfect. So if he wasn't around, I'd just have a few thousand less articles right now.
"No skills"? I've been making a >>full time income<< in IM for the last 3 years. I've broke $200 days on Clickbank and $1000 / days with my lead gen sites. I've had my ups and downs but for the most part I manage to pull in a healthy 6 figure income every. single. year. I think that qualifies me as having some "skills" LOL. I'm also a well respected member on WF and go under the name "RedShifted". Since posts & thanks mean so much to you, go check there. Check my thanks here. Ask any long standing member on WF how much "skills" I have or how much of an "arrogant twat" I really am. Because 90% of them will say, "he might be from NJ, and he might be a bit rough around the edges, but for the most part he's a stand up guy".
And lets be real for a minute. I didn't specifically "flame" fat boy. If you actually READ what I wrote I used the word "programmers". Which is the plural version of the word "programmer". That comment wasn't solely directed at fatboy. It was the result of multiple wannabe programmers making promises, breaking them, and I vented all that well justified anger in a slightly misdirected manner. Big freakn deal. I also flamed his bot more than him. And I *retracted* my response afterwards.
LOL. Before yesterday, I had NO IDEA who "fatboy" was. If he has a good reputation, awesome for him. If he's contributed to this forum for "years", even better. I've done the same shit on WF. A LOT of people contribute to forums dude. And personally, I can't stand when members are singled out for all the good they do. Because when everyone is busy adoring and admiring 1 person, hundreds of good members are being ignored & overlooked. Even when I was nominated in bluematters thread I was extremely embarrassed. The FIRST THING I did was reject my nomination by saying "I am not eligible to win but thank you". I did NOT beg for nominations like others did. I didn't ask for nominations. I left that thread and never came back till I realized I won. And I don't say this to brag, but out of all the people who won that competition... I'm the only 1 who's actually trying to "pay it back" to BM by promoting his service. Is that what "arrogant twats" do?
I want it to be clear, I do not respect someone just because they've been here for years or have a high post count. Because there are people on here with lots of posts and thanks who use their reputations to troll and abuse newbies. So I respect people based on my own perceived value of what they share. And I might have high standards but that's fine with me.
Finally, if fatboy really had the "skills" you speak of, shouldn't he have known there were addons that already do what his bot does? Isn't that the type of shit that "skilled" programmers are suppose to know? Don't you find it ironic that the person who ultimately found the best method wasn't even a "programmer" at all? Cause as highly as you seem to think of him, even AFTER I apologized, you don't seem to think highly enough that he can handle his own criticism. To the point where you have to have his arguements for him! LOL. I thought this whole charade ended when I updated my post with "edit: nevermind, the bot works I'm sorry, yada yada". Too bad there was no articles in any of my niches. So to me, the bot is still completely useless. I'm allowed to say that. And if you don't like it, then you really need to grow thicker skin. I'm trying to keep fatboy out of this now but if you want more than an apology you're out of your mind.
-BB
Last edited:
ranjim
Regular Member
- Apr 5, 2012
- 399
- 47
By August 15, mate.