Some helpers to help writing correction bots, use by hackinscience.org.
Project description
Correction Helper
Project
This is just a set of tools to help writing correction bots in Python for Python.
It is used for hackinscience, but could be used elsewhere.
Security considerations
Running student code is probably really unsafe, unless you trust your students not to drop you a backdoor.
This projet does not help with security in any ways, maybe take a
look at firejail if you have
trust issues (Yes you can use correction-helper
inside firejail
).
Usage
To install it, run: pip install correction-helper
.
In your checking code, you can use it like this:
The student_code
decorator
This decorator is aimed to catch most problems that could happen in student code, use it simply as:
with student_code():
their_function()
Find a more complete example in the examples/
directory.
Allowed parameters for student_code
, and their default values
exception_prefix="I got an exception:"
Printed right before the exception, if any.
It's allowed to give a list of strings, in which case they'll be
separated by "\n\n"
, useful to render markdown paragraphs.
print_prefix="Your code printed:"
Message to display before the student prints (in case print_allowed
is False
or None
).
It's allowed to give a list of strings, in which case they'll be
separated by "\n\n"
, useful to render markdown paragraphs.
too_slow_message="Your program looks too slow, looks like an infinite loop."
Message to display in case the code runs slower than the given timeout
(defaults to 1s).
It's allowed to give a list of strings, in which case they'll be
separated by "\n\n"
, useful to render markdown paragraphs.
prefix=()
A prefix for print_prefix
, exception_prefix
, and
too_slow_message=
, usefull to deduplicate strings, like:
with student_code(
prefix="While calling blahblah('bar')",
print_prefix="it printed:",
exception_prefix="it raised:",
too_slow_message="it took more than 1s, had to kill it.",
):
blahblah('bar')
friendly=False
To use, or not friendly-traceback instead of bare Python exceptions.
print_allowed=True
To allow or deny the student to print to stdout and stderr.
True
: Prints are allowed (and displayed).None
: Prints are allowed (but not displayed).False
: Prints are disallowed (and displayed).
In all cases you can read what they printed using the value of the context manager:
with student_code(print_allowed=None) as run:
their_function()
assert run.stderr == ""
assert run.stdout == "42"
Good practices
Write the student checking code a you would write unit test for your own code.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file correction-helper-2022.2.tar.gz
.
File metadata
- Download URL: correction-helper-2022.2.tar.gz
- Upload date:
- Size: 6.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.6.0 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7157c4df6b61082b1996cb2f136c6db176d38536dc573d27752d1c7623550715 |
|
MD5 | 446320c4eb7f29e5a1cddead88e2bebc |
|
BLAKE2b-256 | 4eca718076b277ab71895b82af2661b8c85f442f86d16fa7be139d91cb8903ee |
File details
Details for the file correction_helper-2022.2-py3-none-any.whl
.
File metadata
- Download URL: correction_helper-2022.2-py3-none-any.whl
- Upload date:
- Size: 7.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.6.0 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d76625c34cc45547cc98bd42a8e71fd8674af81641817c5874d6220159fe5ad6 |
|
MD5 | b85ecc883d6e98fef0f31a238db3dedb |
|
BLAKE2b-256 | d4fea06d0dc6d44dee834d341be1e31997dfa11613244c3a15aeeed2e374855a |