Free scraper for website

• Given a twitter username, scrape every tweet that doesn't have an image, pulling the username, tweet content (preserving newlines and everything), # of RTs, # of favorites, tweet url,
• Given a hashtag, scrape a specified # of tweets from the top section of Twitter search, pulling username, tweet content (preserving newlines and everything), # of RTs, # of favorites, and tweet url

assb said:

Hello BHW members

I would like give some free scraper. I builded much at the past. One of my downloader you can download from here bhw.:

Code:

https://www.blackhatworld.com/seo/get-free-instagram-bulk-downloader.975375/

(Use second link from the thread)

So i would like practice, so i have a deal.

You just drop here a site url, and the datas what you want scrape, and i will build for you a scraper and i will give you (and of course to the community here) for free.

I am using .NET, and C#

at first please don't dream a big. So be fair, and don't start a page, where we should use rotating proxie servers and chaptcha and logins.

So, i am waiting the challenges!

Regards

Click to expand...

lalgsw said:

I have 2 ideas:

• Given a twitter username, scrape every tweet that doesn't have an image, pulling the username, tweet content (preserving newlines and everything), # of RTs, # of favorites, tweet url,
• Given a hashtag, scrape a specified # of tweets from the top section of Twitter search, pulling username, tweet content (preserving newlines and everything), # of RTs, # of favorites, and tweet url

Export both into CSV format.


Thanks for doing this Great idea!

Click to expand...

assb said:

Hmmm. I like this idea. Ok, i will make this.

Click to expand...

• pull the content from featured snippet
  
• pull the words in BOLD
• pull content from "People also ask" box
  
• pull related searches from the bottom of the page

look_nohat said:

Can you create a Google serp scrapper?

• pull the content from featured snippet
  
• pull the words in BOLD
• pull content from "People also ask" box
  
• pull related searches from the bottom of the page

CSV format as output is great.

If you can do that, you'll be my hero

Click to expand...

assb said:

Hail. I need a little bit more details. What is the input? Keywords?

Click to expand...

Spoiler: details to scrap

Spoiler: scraped output