File size: 621 Bytes
7abd611
 
 
b3104d2
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
---
license: gpl-3.0
---

In this card, we provide a text preprocessing tool named "Pyplexity". This tool is available as a Python package through PyPi to preprocess text for different downstream tasks:

```bash
pip install pyplexity
```

You can also check the documentation [here](https://github.com/citiususc/pyplexity). We have also created a web [demo](https://tec.citius.usc.es/pyplexity/).

Please cite our research:

Fernández-Pichel, M., Prada-Corral, M., Losada, D. E., Pichel, J. C., & Gamallo, P. (2023). An unsupervised perplexity-based method for boilerplate removal. Natural Language Engineering, 1-18.