- Jan 1, 2019
- 1,285
- 862
Since I joined this beautiful community This is my first journey, and I want to share it with you guys. in this journey I should scrape product and why not website data, filter it, organize it, and add it to my website which add more value to my website.
But what special in this journey is I have DEADLINE " I HAVE TO GET THINGS DONE AT 25/06" Yes it's makes me nerves and more stress, because I'm working on other project, so I need to manage carefully my time. but it's been a 1 year when I fall in love with stress and all the thanks go to this Lady on his show on TED
To start I already defined my targeting website to scrape data from.
Now when I'm creating this journey I let my Digitalocean droplet upload windows 10 to run bot scraper on it.
I already created this bot but use it on other things but it's ready now to use, I tested many times.
Next I will
I hope I didn't forget any step and if I did i will make an update. sooooooooo NOW WISH ME GOOD LUCK.
But what special in this journey is I have DEADLINE " I HAVE TO GET THINGS DONE AT 25/06" Yes it's makes me nerves and more stress, because I'm working on other project, so I need to manage carefully my time. but it's been a 1 year when I fall in love with stress and all the thanks go to this Lady on his show on TED
To start I already defined my targeting website to scrape data from.
Now when I'm creating this journey I let my Digitalocean droplet upload windows 10 to run bot scraper on it.
I already created this bot but use it on other things but it's ready now to use, I tested many times.
Next I will
- setup bot and download all requests on the RDP
- scrape all product front page and export only URLs
- target those URLs to export the product page.
- Organize data and upload it on my WP
- Check all product on my website to make sure all things looks good.
I hope I didn't forget any step and if I did i will make an update. sooooooooo NOW WISH ME GOOD LUCK.