reppy

Last released Sep 16, 2019

Replacement robots.txt Parser

url

Last released Dec 19, 2017

URL Parsing

dragnet

Last released Apr 16, 2019

Extract the main article content (and optionally comments) from a web page

shovel

Last released Mar 29, 2018

Not Rake, but Shovel

s3po

Last released Dec 26, 2017

An uploading daemon for S3

simhash-py

Last released Mar 22, 2017

Near-Duplicate Detection with Simhash

qless-util

Last released Jan 13, 2017

Qless utilities

qless-py

Last released Jan 13, 2017

Redis-based Queue Management

gzippy

Last released Dec 15, 2016

Gzip file utility.

asis

Last released Jul 22, 2016

Lightweight As-Is Server