I am Bot Creator, Send Your Reasonable Ideas for tools
- Thread starter botrockets
- Start date
-
- Tags
- bot bot developer
- Status
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
Tool 11: Twitter Followers Scraper
http://botrockets.com/Apps/TwitterFollowersScraper/TwitterFollowersScraper.htm
http://botrockets.com/Apps/TwitterFollowersScraper/TwitterFollowersScraper.htm
I was hoping for a image/content scraper for social sites that require a login. I was hoping for user names, profile picture and matching profiles so I could build a database in areas that I could sort for other purposes like marketing.
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
Thats possible but wouldn't be free
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
I am thinking about it... If time permits I will make one.
ricardo78
Registered Member
- Jun 25, 2014
- 95
- 16
same problem here on Win7Pro SP1 (and on my VM XP too), the latest upload stays a second longer then quits too. Please help!
ps. is there a debug setting, so I could provide some output dump?
Last edited:
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
I think I have updated the program.. pls go thru some old posts.
How much would something like that cost?
ricardo78
Registered Member
- Jun 25, 2014
- 95
- 16
Yes I checked the latest version, that is why I said LATEST in my previous post. (1.0.0.1)
Sorry I don't want to give you the attitude, but I'm a developer too, and I wish you'd make this bot work at all.
Thank you!
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
Oh Ok, I will test again.. Thanks for the report.
artmosfire
Newbie
- Oct 29, 2013
- 11
- 2
From the results of your bot on this one , what can I use for something ?
sorry for my bad english
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
To Follow them.
OriginalMotive
Newbie
- Mar 26, 2014
- 10
- 3
Hey botrockets,
Downloading manually from G KW Planner is repetitive, tedious, boring, and I'm pretty positive that the more experienced people here have found multiple ways around it.
So: create a bot to upload lists of KWs/download CSVs from G's Keyword Planner! It seems simple enough. I tried doing it in python, but I'm using v. 3.4, don't wanna go back, and I think v. 2.7 is the last one that mechanize works on (the only module I've found that can -- supposedly -- work through invisible/hidden HTML). But you know JS! This should be relatively easy for you.
Downloading manually from G KW Planner is repetitive, tedious, boring, and I'm pretty positive that the more experienced people here have found multiple ways around it.
So: create a bot to upload lists of KWs/download CSVs from G's Keyword Planner! It seems simple enough. I tried doing it in python, but I'm using v. 3.4, don't wanna go back, and I think v. 2.7 is the last one that mechanize works on (the only module I've found that can -- supposedly -- work through invisible/hidden HTML). But you know JS! This should be relatively easy for you.
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
Last edited:
ricardo78
Registered Member
- Jun 25, 2014
- 95
- 16
Hi Botrockets, thanks for the bugfix, the scraper runs now.
However to make it useful, there a few essential features missing:
Essential:
- scrape the big image behind thumbnails, not just the thumbnail
- sometimes there is another page with the image behind the thumbnail, reach photo that too
Basic automation:
- scrape paginated sites
- scrape images further down the "load more" button of google images
Full automation:
- crawl the whole site for images, starting from given page
Thank you for your effort!
However to make it useful, there a few essential features missing:
Essential:
- scrape the big image behind thumbnails, not just the thumbnail
- sometimes there is another page with the image behind the thumbnail, reach photo that too
Basic automation:
- scrape paginated sites
- scrape images further down the "load more" button of google images
Full automation:
- crawl the whole site for images, starting from given page
Thank you for your effort!
botrockets
Regular Member
- Mar 16, 2013
- 389
- 647
Yes I understand this, I know limitations. It doesn't use browser, just get links from plain html without javascript.
I think things you asked is doable but I don't have enough motivation for free product like this now.
- Status