scraping bot

Does anyone here have experience scraping android app data? The app communicates with remote servers via HTTP, HTTPS and perhaps it uses Thrift protocol (I'm not sure). What methods do you normally use? P.S: If anyone interested I will pm the app name. I didn't post this in Hire the freelancer...

Hi mates, I wanted to share the 100% free tool that i created and allow you to create infinite mailboxes from their API. Just with one GET call you get the content of the mailbox and you can parse any link. For example is helpful to register in many sites to scrap the content automatically...

I build website from 2 months ago and everything work good, but suddenly i find number of visitors is decrease in google analytics. After some search i find many websites open with same content of my website just change all url from mysite.xxx/xxxx to newsite.xxx/xxxx and they have strange...

I've built a scraping script in PHP to gather information from a particular website. I have tested the script thoroughly with downloaded HTML files from the target website, so the xpath queries are correct. Yesterday I tried the script for the first time locally but targetting the actual website...

Hey fellow BH'ers! I have a question and would love your help! I created a simple Node JS bot that searches exactly what I need from Google and can scrape the information I'm looking for (publically available YouTube, Twitter accounts, etc). Now that I have the bot set up - what do I need to do...

Hey fellow BH'ers! I have a question and would love your help! I created a simple Node JS bot that searches exactly what I need from Google and can scrape the information I'm looking for. Now that I have the bot set up - what do I need to do from here? I'm new to search engines. Given there...

Looking for a top level coder that has experience with movie streaming sites and specifically the cloning of them. Ideally we want a top level programmer that in addition the above has has extensive knowledge with Google drives and can create a bot to automate the process

I want to scrape all 550k emails from freemailnews.com cached pages. (They blocked their site when i tried when it was live) Ive tried SB but it doesn't work to grab all the links or emails. Outside of making my own rig, does anyone know a way? If you do it and share, I'll be eternally...

I've been trying a list of footprints I found here and all I get are links that mention other footprints? Here's a sample: site:com "powered by expressionengine" "post a comment" site:edu "powered by expressionengine" "post a comment" site:org "powered by expressionengine" "post a comment"...

The scraper software needs to be reliable and perhaps with the use of proxies to access certain websites every 30 seconds and will not be blocked. Please contact me if you have experience with this, I'd rather not use a tool but a bespoke solution but am open to suggestions.

Hello there, I want to improve my rank of domain by scraping service fastly.You guys,which company can provide the type of service. leave your Skype or Website. Thank you very much.

Seeking a freelancer to copy/download ads (300 including text, pictures and contact details) or scrape them if possible from an escort board and then re-submit them to another site. Please PM

Hello, I want to know if there is a tool/bot/app to download the bio of users (including the website of the users) ? thanks

Hello all I have been on BHW as a spectator for years but this is my first post. Here is my journey. I have landed 2 jobs on craigslist one the old fashion way reading posts and cherry picking the jobs I was interested in and sending my resume with a canned "Hello my name is "#instagram" and...

Hey there, General idea: Have an ebay to amazon scraper that finds Amazon items and pulls ASIN #s into a text file. Everything started out fine, i ran the bot at about 200 items and it pulls a bunch of ASIN's... but once I bumped the scraper up to 1k items it came up with an error and now will...

Hey everyone. I think I am finally starting to understand the grasp scraping for the most part. I'm still very much a beginner but I am curious about if there was a software that could perform this specific task. Is there a way to make it search two keywords: Example: "edm" & "snapchat" and...

What's the fastest way to scrape a lot of pages? 1.PHP? 2.PHYTHON? 3.PERL Etc.........

I need 50k leads or the entire content for a specific website (to be discussed in pm). Leads must have Name/Address/Contact Number/Website

http://www.mediafire.com/?d0p8cpq6ia7dwds https://www.virustotal.com/en/file/6906d88ac3f590dddb268dfb962030bb3f6cca3f446e0387adf397c258decb56/analysis/1378407421/ Tested on Windows 8... Let Me Know if You Have Any Problems or Feature Requests... SHA256...

Hi all (first post here - can't figure out which section to post in.. so here goes anyway). Just wondering if anyone has knows how to tell if the new Google Plus Local business pages have been Owner Verified?? As far as I can tell all the pages that I know I have verified for customers no...