File size: 1,161 Bytes
ce801b3
 
 
 
 
 
 
 
 
 
 
 
2e9d8f9
 
 
65c5cd9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
title: Amikus_text_summarizer
emoji: 🔥
colorFrom: red
colorTo: gray
sdk: gradio
sdk_version: 2.9.1
app_file: app.py
pinned: false
---

Check out the configuration reference at https://huggingface.co/docs/hub/spaces#reference



Readme 

For this application I have created three features:
1.sumarizer
2.keyword extraction
3. paraphraze text 

1.Sumarizer:
for this I have used transformers library, sumarization pipeline ,to sumarize the text (see sumarize fuction)
the parameters are max_length = 200, min_lenth = 30
2. key_word extraction: this feature extracts 20 keyword from the text each of length of 3 or less tha 3 words,
see the same sumarize function
the lib I have used for this is yake and its function KeywordExtractor
3.paraphraze text:
for this i have used PEGASUS from transformers library.I used senstence-splitter to split the text into a list of sentences.
Then paraphrazed each of the sentences and then compiled them back into a paragraph.
I am using a pre trained model = 'tuner007/pegasus_paraphrase' for this.

The selection of example texts was based on my own areas of fascination like robotics, ancient history and astronomy.