AutoReviewer

Scientists often do the same bad stuff. Automate giving feedback during peer review for Python packages.

Goals:

1. Given a GitHub repository, automate finding common issues such as
   • No setup.py/setup.cfg/pyproject.toml
   • No zenodo archive linked from the README
   • Non-standard code layout (src/ or bust)
   • Files contain hard-coded file paths
   • No documentation (search README for link to readthedocs)
   • Package name doesn't match github repository name
   • No reproducible installation instructions (i.e., does the README contain pip)
   • Uses conda for installation
   • Code does not have consistent style (i.e., there's no configuration for black)
   • pyroma doesn't pass 10/10
   • missing LICENSE file
   • missing CITATION.cff file
2. Automate sending issues to the repository instructing how to do these things
   • Use deterministic titles for all issues to avoid duplicates / make idempotent
   • Create and edit "epic" issue that links others

Example Reviews:

• https://github.com/fanavarro/lexical-analysis-obo-foundry/issues/4
• https://github.com/krishnanlab/PecanPy/issues/12
• https://github.com/huihui1126/drugSim-pathway/issues/14

Want to collaborate? What do you expect out of Python packages? Let me know in the comments. I envision this being sort of modular so people can contribute their own checks.

Desired interface:

Run on the command line with:

$ autoreviewer https://github.com/rs-costa/sbml2hyb

J. Chem. Inf. Analysis

There's a submodule autoreviewer.jcheminf that has utilities for scraping the paper list from the Journal of Cheminformatics, getting their ePub files, extracting GitHub references from the availability statements, running autoreview on each, then making the following summary with python -m autoreviewer.jcheminf.

🚀 Installation

The most recent release can be installed from PyPI with:

$ pip install autoreviewer

The most recent code and data can be installed directly from GitHub with:

$ pip install git+https://github.com/cthoyt/autoreviewer.git

You'll also need to make sure pandoc is installed. The best way to do this is brew install pandoc on macOS.

👐 Contributing

Contributions, whether filing an issue, making a pull request, or forking, are appreciated. See CONTRIBUTING.md for more information on getting involved.

👋 Attribution

⚖️ License

The code in this package is licensed under the MIT License.

🍪 Cookiecutter

This package was created with @audreyfeldroy's cookiecutter package using @cthoyt's cookiecutter-snekpack template.

🛠️ For Developers

$ git clone git+https://github.com/cthoyt/autoreviewer.git
$ cd autoreviewer
$ pip install -e .

$ tox

$ git clone git+https://github.com/cthoyt/autoreviewer.git
$ cd autoreviewer
$ tox -e docs
$ open docs/build/html/index.html

$ tox -e finish