GuiltySpark's picture
Update README.md
65c5cd9
---
title: Amikus_text_summarizer
emoji: 🔥
colorFrom: red
colorTo: gray
sdk: gradio
sdk_version: 2.9.1
app_file: app.py
pinned: false
---
Check out the configuration reference at https://huggingface.co/docs/hub/spaces#reference
Readme
For this application I have created three features:
1.sumarizer
2.keyword extraction
3. paraphraze text
1.Sumarizer:
for this I have used transformers library, sumarization pipeline ,to sumarize the text (see sumarize fuction)
the parameters are max_length = 200, min_lenth = 30
2. key_word extraction: this feature extracts 20 keyword from the text each of length of 3 or less tha 3 words,
see the same sumarize function
the lib I have used for this is yake and its function KeywordExtractor
3.paraphraze text:
for this i have used PEGASUS from transformers library.I used senstence-splitter to split the text into a list of sentences.
Then paraphrazed each of the sentences and then compiled them back into a paragraph.
I am using a pre trained model = 'tuner007/pegasus_paraphrase' for this.
The selection of example texts was based on my own areas of fascination like robotics, ancient history and astronomy.