How to bulk upload profiles/urls and avoid low content pages

notgeorge · Aug 25, 2021

I have a job board I am building with some people, and to begin gaining traction we bulk uploaded current employers we work with for them to later verify their profiles (about 50,000 so far). We have tried some simple GPT-3 description generation, for the company descriptions, with a few variations but with 50,000+ employers we are getting penalized with low content pages and soft 404s on certain profiles.

I am looking for strategies or work-arounds to do bulk profile/url uploads and avoid being penalized for low content, duplicate content, soft 404s, etc.

It may be helpful to add that these employers are in the same industry, and their differences are names, websites, and phone numbers. We have looked at beefing up internal linking but are open to any suggestions.

Thank you - notgeorge

alexono1 · Aug 25, 2021

Can you get a company description for each company somewhere else and then spin or (re)translate the descriptions untill it's unique?

notgeorge · Aug 25, 2021

alexono1 said:
Can you get a company description for each company somewhere else and then spin or (re)translate the descriptions untill it's unique?

This is what we've done thus far. A bunch of pre-generated company descriptions with the "unique" part being the adjectives used lol. We could try much more unique descriptions too, but still 50,000+ need to be unique aside from the company names

alexono1 · Aug 25, 2021

Sometimes I see company info sites using specific fields from the CoC and then making a kind of story for each company...
Maybe you can scrape or buy some data?
Like: The company X was found in 2001 and has 3 employees and is a company in category xyz. You could use spintax for this too...

Still a bit thin content... But could be a small part of the text...
You might get away with it if your site has some authority...
Further you could add some niche spcific data and spin that, like: Companies in niche xyz have an average revenue of xxxxxxx.
The city of x has 500 companies in niche xyz...
etc etc...
I think the more data about every specific value you have, the more extended info you can create... and the longer your company text may become...
Does this makes any sense?

doepjohn · Aug 25, 2021

Try removing other content from the pages if there is any.

If google is basing it on percentage of duplicate content, less of the same content you have on the page the better.

So if you have a sidebar etc with the same content on every page, see if you can take things like that out, just keeping the header and footer.

Also, if the profiles need to be verified anyways, why not just noindex/block the un-verified ones from being crawled at least temporarily until you can get more content for them?

You can also add fields like "View similar profiles" that show a snippet of profiles that get grabbed based on some criterias. Similar to what alexono1 said, "More employees in the ___ area", "List of employees in ____ field" etc.

Will create more auto-generated content per page that should be fairly unique based on how you pull the profiles.

Overall, for a directory type site I don't think duplicate content on pages like that is a big issue.

notgeorge · Aug 26, 2021

alexono1 said:
Sometimes I see company info sites using specific fields from the CoC and then making a kind of story for each company...
Maybe you can scrape or buy some data?
Like: The company X was found in 2001 and has 3 employees and is a company in category xyz. You could use spintax for this too...
Still a bit thin content... But could be a small part of the text...
You might get away with it if your site has some authority...
Further you could add some niche spcific data and spin that, like: Companies in niche xyz have an average revenue of xxxxxxx.
The city of x has 500 companies in niche xyz...
etc etc...
I think the more data about every specific value you have, the more extended info you can create... and the longer your company text may become...
Does this makes any sense?

Yea this makes sense. I will have to see what data we have on these companies and then we can probably do something along these lines. Plus, with adding some beef to the internal linking I think that may just be enough. Hoping to be a resource for these companies too so could probably do well with this route. Thank you

notgeorge · Aug 26, 2021

doepjohn said:
Try removing other content from the pages if there is any.

If google is basing it on percentage of duplicate content, less of the same content you have on the page the better.

So if you have a sidebar etc with the same content on every page, see if you can take things like that out, just keeping the header and footer.

Also, if the profiles need to be verified anyways, why not just noindex/block the un-verified ones from being crawled at least temporarily until you can get more content for them?

You can also add fields like "View similar profiles" that show a snippet of profiles that get grabbed based on some criterias. Similar to what alexono1 said, "More employees in the ___ area", "List of employees in ____ field" etc.

Will create more auto-generated content per page that should be fairly unique based on how you pull the profiles.

Overall, for a directory type site I don't think duplicate content on pages like that is a big issue.

Thanks man, this is some good advice and I am thinking adding more customized snippets of profiles and recommendations, plus beefing up the content customization should do it.

If that doesn't work, I am going to try the noindexing route.

Thanks for the advice and insight.

How to bulk upload profiles/urls and avoid low content pages

notgeorge

Newbie

alexono1

Regular Member

notgeorge

Newbie

alexono1

Regular Member

doepjohn

Regular Member

notgeorge

Newbie

notgeorge

Newbie

Main Menu

Marketplace

Making Money

BlackHat World