Text Analysis and algorithm for Text Analysis

[Michaelchong]

If I have 200 passages about "how to swim", and I want to "analyze" them. By saying analyze, I mean, later on, if I input "how to swim", it can throw me back all the key information about "how to swim", based on the texts that I feed.
Is there any tool or say method to achieve what I want?

 

[necuratu]

Mmmm
I guess you can use some python libraries like : txtai, spacy, ner and wikipedia to get some graphics on the text you are training in it .
now it's important for you to decide what kind of data and rating you want to get back.
I guess this library could help in your case.
https://towardsdatascience.com/questgen-an-open-source-nlp-library-for-question-generation-algorithms-1e18067fcdc6?gi=2d15c4da7bf4I'm doing kinda the same thing on a blog using this library

 

[shekhar1205]

I think all ai content writers are like this. They have been fed with billions of written data on various topics and they have been trained to extract the relevant data based on user inputs. Try any one of them in action.

 

[Michaelchong]

I think all ai content writers are like this. They have been fed with billions of written data on various topics and they have been trained to extract the relevant data based on user inputs. Try any one of them in action.

It's true, the problem of these AI writing is they are used for many different topics, making the machine messy, I mean, you don't get what you want. So if there is one working on only one type of topic, then probably that would be very accurate and helpful, just I can't find one

 

[Michaelchong]

Mmmm
I guess you can use some python libraries like : txtai, spacy, ner and wikipedia to get some graphics on the text you are training in it .
now it's important for you to decide what kind of data and rating you want to get back.
I guess this library could help in your case.
https://towardsdatascience.com/ques...ation-algorithms-1e18067fcdc6?gi=2d15c4da7bf4I'm doing kinda the same thing on a blog using this library

Thank u so much, checking it now...

 

[V]

It's true, the problem of these AI writing is they are used for many different topics, making the machine messy, I mean, you don't get what you want. So if there is one working on only one type of topic, then probably that would be very accurate and helpful, just I can't find one

That's where fine-tuning comes into the picture. Learn how to fine-tune a model using your dataset.