Some helpers to help writing correction bots, use by hackinscience.org.
Project description
Correction Helper
Project
This is just a set of tools to help writing correction bots in Python for Python.
It is used for hackinscience, but could be used elsewhere.
Security considerations
Running student code is probably really unsafe, unless you trust your students not to drop you a backdoor.
This projet does not help with security in any ways, maybe take a
look at firejail if you have
trust issues (Yes you can use correction-helper inside firejail).
Usage
To install it, run: pip install correction-helper.
In your checking code, you can use it like this:
The student_code decorator
This decorator is aimed to catch most problems that could happen in student code, use it simply as:
with student_code():
their_function()
Here is a more complete example:
from correction_helper import fail, student_code
with student_code():
# Here, if the import fail, if the student prints, or try to exit,
# it will be reported with a nice message in Markdown, and your process
# will exit with code 1.
from solution import missing_card
def check_deck(deck, expected):
with student_code(print_expect=expected):
# Here, if the function raises, if the student prints, or try to exit,
# it will be reported too, and exit with code 1 too.
# If the student prints what is expected to be returned
# (the `print_expect` parameter), we told that, too.
missing = missing_card(deck)
if missing != expected:
fail(f"""With the following deck (missing card is `{expected}`):
{code(deck, "text")}
You're returning:
{code(missing, "text")}
""")
Allowed parameters for student_code, and their default values
exception_prefix="Got an exception:"
Printed right before the exception, if any.
friendly=False
To use, or not friendly-traceback instead of bare Python exceptions.
print_allowed=False
To allow the use to print to stdout / stderr, you can read what they printed using the value of the context manager:
with student_code(print_allowed=True) as run:
their_function()
assert run.stderr == ""
assert run.stdout == "42"
print_prefix="Your code printed something (it should **not**):"
Message to display when they printed and print_allowed was False.
print_expect=None
String that you bet they'll print instead of return.
print_expect_message
Default value:
Your code printed what I expected it to return so maybe just replace your
returnstatement.
This is the message displayed when you won you bet with
print_expect, they printed instead of returning.
Good practices
Try first if the student code works, if it works, it works. Only if the code does not work, try to understand why.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file correction-helper-2021.4.10.tar.gz.
File metadata
- Download URL: correction-helper-2021.4.10.tar.gz
- Upload date:
- Size: 6.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.9.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 502659eabadd2bba763942ebc05e754cf17a6b6a2452e8755c11b3e0dd46663d |
|
| MD5 | c2132271a400512389f14890ffe9f50b |
|
| BLAKE2b-256 | 046f19339d0b27808b65ce399b8dcb30d31944dae8a1483f8487f4721fc29460 |
File details
Details for the file correction_helper-2021.4.10-py3-none-any.whl.
File metadata
- Download URL: correction_helper-2021.4.10-py3-none-any.whl
- Upload date:
- Size: 6.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.9.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4ad4b25a869fe4d3e7a7787423ca10576e021c2b59c2ab898c75f9ad53d54076 |
|
| MD5 | 1d44c840c8d5094c77a63e4231082bae |
|
| BLAKE2b-256 | a964332ae1bfe85cba16467e905a3bb6af15e996f375763e0fd42074bde79bd3 |
