Survey on Text Transformation using Bi-LSTM in Natural Language Processing with Text Data
Main Article Content
Abstract
Communication using text can be understood by human beings as language plays a vital role in their life. Computers need to understand such human readable languages in order to explore documents in a wider manner. For such cases, machine learning algorithms as well as natural language processing algorithms can be used. Computers understand the human readable language and convert them as machine readable form. Replication of data stands as a most challenging problem in document exploration as the document may contain many repetitive words. The system makes use of classifier named LSTM to remove the words appearing frequently in the entire document. Firstly the text is transformed using NLP techniques followed by feature extraction and finally Bi-LSTM is used to classify the text data. LSTM mainly focus on reduction of repetitive words from the entire document and also maintains the integrity of the document. Bi-Lstm is an effective method to connect two different independent RNN together that helps to follow the sequence of statement front and back path every now and then.Multi directional ways of running the code will help in future prediction by saving the sentence for future purpose also.When the independent hidden states are joined it will be preserved for future and also past search. Although the word count is reduced, content of the word document is maintained in the LSTM method which stands as a major advantage. The experimental results showcase the efficacy of the system.
Downloads
Metrics
Article Details
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.