A high pounds in tf–idf is reached by a high time period frequency (inside the supplied document) in addition to a very low document frequency on the term in the whole collection of documents; the weights that's why usually filter out widespread terms. To use this perform with Dataset.map the same caveats apply as with Dataset.from_generator,