How does pinterest algo know!?

TheGamer said:

Hi

I haven't done much on Pinterest but I was researching it a bit yesterday and noticed something that I couldn't explain. So say for example I search for a black summer dress using Pinterest search feature, it brings up lots of results. Interestingly for a few searches, the first results coming up had NO descriptions, hashtags or basically anything I could visibly see that were indicative to Pinterest that these images are of black summer dresses. So what's really happening here? Being a software (mainly web) developer in my previous career I think it could be a far fetched for their crawler to go through each link and see what keywords are on individual websites. Some of the results were also incorrect so basically not everything would be black but surpisingly vast majority were correct. So how does Pinterest decide what the content is about when it displays it when there is no description or tags being used, is it browsing the target website or using the image data or something else? Thank you!

Click to expand...

KevinRB said:

The reason is because they utilize both meta-description and visual image search within their algorithms so not only can they assess what's in an image by the image text but also by the physical attributes contained within the image.

Here is an interesting article about it:
https://medium.com/@Pinterest_Engin...-to-visually-search-on-pinterest-67c8284b3684

Click to expand...

TheGamer said:

That article is awesome...Just a few months by a team of just 4 engineers! Do you think they have something similar for videos too?

Click to expand...

TheGamer said:

Hi

I haven't done much on Pinterest but I was researching it a bit yesterday and noticed something that I couldn't explain. So say for example I search for a black summer dress using Pinterest search feature, it brings up lots of results. Interestingly for a few searches, the first results coming up had NO descriptions, hashtags or basically anything I could visibly see that were indicative to Pinterest that these images are of black summer dresses. So what's really happening here? Being a software (mainly web) developer in my previous career I think it could be a far fetched for their crawler to go through each link and see what keywords are on individual websites. Some of the results were also incorrect so basically not everything would be black but surpisingly vast majority were correct. So how does Pinterest decide what the content is about when it displays it when there is no description or tags being used, is it browsing the target website or using the image data or something else? Thank you!

Click to expand...