need help in scraping site

vijayshetty

BANNED
Joined
Dec 3, 2019
Messages
57
Reaction score
4
home page dont have any links bedhundlahari dotcom
internal pages have lot of content in non english hxxp://bedhundlahari.com/literature-read?story-oasis


i could npt found sitemap or robots

how to scrape this site
 
home page dont have any links bedhundlahari dotcom
internal pages have lot of content in non english hxxp://bedhundlahari.com/literature-read?story-oasis


i could npt found sitemap or robots

how to scrape this site
What exactly do you want to Scrape from this site? Email addresses?
 
Try searching in google: site:bedhundlahari.com
jadsn gave you the start...
When you google that you shall find countless of pages with a link directly to the stories = Sitemap

Now to get those pages scraped:
#1 : You can create a small loop using tiny task and scrape all the pages into where you want it.
#2 : Use the power of manual labor on fiver for a small fee.
#3 : If you have beer money to spend and want it done in a day pm me

Cheers,
 
jadsn gave you the start...
When you google that you shall find countless of pages with a link directly to the stories = Sitemap

Now to get those pages scraped:
#1 : You can create a small loop using tiny task and scrape all the pages into where you want it.
#2 : Use the power of manual labor on fiver for a small fee.
#3 : If you have beer money to spend and want it done in a day pm me

Cheers,
I did that before putting thread,even robots txt and mentioned same in post
 
Back
Top