What I need is a bot that can grab all of the details of a product on a website, like naturalhempoil.com, and put it into WordPress. I need to add about 200 products from about 8 different websites.
For each website that I add products from, I need to add a different referral code at the end of the URL. I highlight the referral code in the video.
And for the tags: they should pretty much just be a copy of the title, but with miscellaneous words removed, like "&", "the", "-", "/", and "per".
Here's the link to the video:
https://www.dropbox.com/s/z5iocs8xqojkgpm/Adding%20a%20Product%20to%20WordPress.mp4?dl=0
The main point of the site is to display the products in a better manner than on their own sites, with fixed titles and descriptions. And to allow visitors to "Compare" the products side by side: 2+ products in a vertical format showing custom categories like CBD content, THC content, etc.
When visitors click on a product, they are sent back to the original product page with my referral code attached.
I was recently talking to a couple guys I met here on BHW about hiring them for this bot that I need, but I've yet to hear back from any of them in about a week or so. I need to get the ball rolling on this and don't have time to mess around. One guy that I was talking to said that he was already creating almost the same bot for himself. I liked his approach the best. Below I'll paste the details of how he described the bot. I'm looking for someone who can do what is described (or better):
For each website that I add products from, I need to add a different referral code at the end of the URL. I highlight the referral code in the video.
And for the tags: they should pretty much just be a copy of the title, but with miscellaneous words removed, like "&", "the", "-", "/", and "per".
Here's the link to the video:
https://www.dropbox.com/s/z5iocs8xqojkgpm/Adding%20a%20Product%20to%20WordPress.mp4?dl=0
The main point of the site is to display the products in a better manner than on their own sites, with fixed titles and descriptions. And to allow visitors to "Compare" the products side by side: 2+ products in a vertical format showing custom categories like CBD content, THC content, etc.
When visitors click on a product, they are sent back to the original product page with my referral code attached.
I was recently talking to a couple guys I met here on BHW about hiring them for this bot that I need, but I've yet to hear back from any of them in about a week or so. I need to get the ball rolling on this and don't have time to mess around. One guy that I was talking to said that he was already creating almost the same bot for himself. I liked his approach the best. Below I'll paste the details of how he described the bot. I'm looking for someone who can do what is described (or better):
- Get the data in a structured format (I prefer an SQL database)
- Create an indexed array with each index containing a single products detail
- Loop over each array and use built in functions from WordPress and WooCommerce (wp_insert_post, update_post_meta, etc.)
A product page is relatively straight forward but you get into more advanced stuff -- integrating with themes, plug-ins, gets more complicated. post_meta's, term_taxonomies, term_relationships..
My method is to look at the code, do a bit of reverse engineering to see how their is a relation, and how is interacts with both the front end and back-end.
The end it's just a script with a data to parse. So long as the required fields (or custom fields are not that hard either -- something to think about to increase functionality) are met, it's a literal emulation from doing it mouse move by click by mouse move.
If you want to keep on adding new products, just keep it in the original format. The script will know where to parse and where to put the information to in order for it to show up as a package with the right data (or rather meta_data) associated with it.
So is this a Review site? Are your data sources just simply external links?
If so, than this would be easier than I am used to, actually.
What I do is I have a script run once a day that downloads a particular product pages HTML source from whatever external source I'm working with.
Load this into a DOM parser.
Use XPath Queries to extract the information I want.
Insert (or Update if it already exists) this information into my database.
Then simply use the newly updated information from the database to either insert a new product, or update an existing one.
As for images, I wrote a script to download the images from the data source to my web server, use an extension called Imagmagick to automatically edit them slightly (resize, rename, add a border, etc), and then use the WordPress and WooCommerce API's and built-in functions to upload the images to the Media Gallery and attach it to a post.
Custom Attributes I've accounted for, also automatically added (well, my own custom attributes that I created-- obviously yours are going to be slightly different-- but it's the same systematic procedure either way.
Same with Product Variations, I have and can programatically add them into WordPress from an external source... It's all just slight variations, and knowing how the WordPress core operates.
- Create an indexed array with each index containing a single products detail
- Loop over each array and use built in functions from WordPress and WooCommerce (wp_insert_post, update_post_meta, etc.)
A product page is relatively straight forward but you get into more advanced stuff -- integrating with themes, plug-ins, gets more complicated. post_meta's, term_taxonomies, term_relationships..
My method is to look at the code, do a bit of reverse engineering to see how their is a relation, and how is interacts with both the front end and back-end.
The end it's just a script with a data to parse. So long as the required fields (or custom fields are not that hard either -- something to think about to increase functionality) are met, it's a literal emulation from doing it mouse move by click by mouse move.
If you want to keep on adding new products, just keep it in the original format. The script will know where to parse and where to put the information to in order for it to show up as a package with the right data (or rather meta_data) associated with it.
So is this a Review site? Are your data sources just simply external links?
If so, than this would be easier than I am used to, actually.
What I do is I have a script run once a day that downloads a particular product pages HTML source from whatever external source I'm working with.
Load this into a DOM parser.
Use XPath Queries to extract the information I want.
Insert (or Update if it already exists) this information into my database.
Then simply use the newly updated information from the database to either insert a new product, or update an existing one.
As for images, I wrote a script to download the images from the data source to my web server, use an extension called Imagmagick to automatically edit them slightly (resize, rename, add a border, etc), and then use the WordPress and WooCommerce API's and built-in functions to upload the images to the Media Gallery and attach it to a post.
Custom Attributes I've accounted for, also automatically added (well, my own custom attributes that I created-- obviously yours are going to be slightly different-- but it's the same systematic procedure either way.
Same with Product Variations, I have and can programatically add them into WordPress from an external source... It's all just slight variations, and knowing how the WordPress core operates.
Last edited:
