My Journey To Scrape 50 000 Products from website and Add it to my WP

Yupwork

Supreme Member
Jr. VIP
Joined
Jan 1, 2019
Messages
1,285
Reaction score
862
Since I joined this beautiful community This is my first journey, and I want to share it with you guys. in this journey I should scrape product and why not website data, filter it, organize it, and add it to my website which add more value to my website.

But what special in this journey is I have DEADLINE " I HAVE TO GET THINGS DONE AT 25/06" Yes it's makes me nerves and more stress, because I'm working on other project, so I need to manage carefully my time. but it's been a 1 year when I fall in love with stress and all the thanks go to this Lady on his show on TED


To start I already defined my targeting website to scrape data from.
Now when I'm creating this journey I let my Digitalocean droplet upload windows 10 to run bot scraper on it.
I already created this bot but use it on other things but it's ready now to use, I tested many times.
Next I will
  1. setup bot and download all requests on the RDP
  2. scrape all product front page and export only URLs
  3. target those URLs to export the product page.
  4. Organize data and upload it on my WP
  5. Check all product on my website to make sure all things looks good.
There future steps about how to protect my website from DMCA, but I'm focus now on content
I hope I didn't forget any step and if I did i will make an update. sooooooooo NOW WISH ME GOOD LUCK.
 
Not much clear on your journey. Best of luck mate
 
Only interested to see how you'd protect your website from DMCA when re-uploading scraped content.
 
Back
Top