Fake implementation of redis API for testing purposes.
Project description
fakeredis: A fake version of a redis-py
fakeredis is a pure-Python implementation of the redis-py python client that simulates talking to a redis server. This was created for a single purpose: to write unittests. Setting up redis is not hard, but many times you want to write unittests that do not talk to an external server (such as redis). This module now allows tests to simply use this module as a reasonable substitute for redis.
Although fakeredis is pure Python, you will need lupa if you want to run Lua scripts (this includes features like redis.lock.Lock, which are implemented in Lua). If you install fakeredis with pip install fakeredis[lua] it will be automatically installed.
Alternatives
Consider using birdisle or redislite instead of fakeredis. They embed the redis codebase into Python, so they implement the full redis command set and behave far more similarly to a real redis implementation.
How to Use
The intent is for fakeredis to act as though you’re talking to a real redis server. It does this by storing state internally. For example:
>>> import fakeredis
>>> r = fakeredis.FakeStrictRedis()
>>> r.set('foo', 'bar')
True
>>> r.get('foo')
'bar'
>>> r.lpush('bar', 1)
1
>>> r.lpush('bar', 2)
2
>>> r.lrange('bar', 0, -1)
[2, 1]The state is stored in an instance of FakeServer. If one is not provided at construction, a new instance is automatically created for you, but you can explicitly create one to share state:
>>> import fakeredis
>>> server = fakeredis.FakeServer()
>>> r1 = fakeredis.FakeStrictRedis(server=server)
>>> r1.set('foo', 'bar')
True
>>> r2 = fakeredis.FakeStrictRedis(server=server)
>>> r2.get('foo')
'bar'
>>> r2.set('bar', 'baz')
True
>>> r1.get('bar')
'baz'
>>> r2.get('bar')
'baz'It is also possible to mock connection errors so you can effectively test your error handling. Simply set the connected attribute of the server to False after initialization.
>>> import fakeredis
>>> server = fakeredis.FakeServer()
>>> server.connected = False
>>> r = fakeredis.FakeStrictRedis(server=server)
>>> r.set('foo', 'bar')
ConnectionError: FakeRedis is emulating a connection error.
>>> server.connected = True
>>> r.set('foo', 'bar')
TrueFakeredis implements the same interface as redis-py, the popular redis client for python, and models the responses of redis 6.0 (although most new feature in 6.0 are not supported).
Support for aioredis
You can also use fakeredis to mock out aioredis. This is a much newer addition (added in 1.4.0) with less testing, so your mileage may vary. For example:
>>> import fakeredis.aioredis
>>> r = await fakeredis.aioredis.create_redis_pool()
>>> await r.set('foo', 'bar')
True
>>> await r.get('foo')
b'bar'You can pass a FakeServer as the first argument to create_redis or create_redis_pool to share state (you can even share state with a fakeredis.FakeRedis). It should even be safe to do this state sharing between threads (as long as each connection/pool is only used in one thread).
It is highly recommended that you only use the aioredis support with Python 3.5.3 or higher. Earlier versions will not work correctly with non-default event loops.
Porting to fakeredis 1.0
Version 1.0 is an almost total rewrite, intended to support redis-py 3.x and improve the Lua scripting emulation. It has a few backwards incompatibilities that may require changes to your code:
By default, each FakeRedis or FakeStrictRedis instance contains its own state. This is equivalent to the singleton=False option to previous versions of fakeredis. This change was made to improve isolation between tests. If you need to share state between instances, create a FakeServer, as described above.
FakeRedis is now a subclass of Redis, and similarly FakeStrictRedis is a subclass of StrictRedis. Code that uses isinstance may behave differently.
The connected attribute is now a property of FakeServer, rather than FakeRedis or FakeStrictRedis. You can still pass the property to the constructor of the latter (provided no server is provided).
Unimplemented Commands
All of the redis commands are implemented in fakeredis with these exceptions:
server
acl load
acl save
acl list
acl users
acl getuser
acl setuser
acl deluser
acl cat
acl genpass
acl whoami
acl log
acl help
bgrewriteaof
command
command count
command getkeys
command info
config get
config rewrite
config set
config resetstat
debug object
debug segfault
info
lolwut
memory doctor
memory help
memory malloc-stats
memory purge
memory stats
memory usage
module list
module load
module unload
monitor
role
shutdown
slaveof
replicaof
slowlog
sync
psync
latency doctor
latency graph
latency history
latency latest
latency reset
latency help
connection
auth
client caching
client id
client kill
client list
client getname
client getredir
client pause
client reply
client setname
client tracking
client unblock
hello
quit
string
bitfield
bitop
bitpos
stralgo
sorted_set
bzpopmin
bzpopmax
zpopmax
zpopmin
cluster
cluster addslots
cluster bumpepoch
cluster count-failure-reports
cluster countkeysinslot
cluster delslots
cluster failover
cluster flushslots
cluster forget
cluster getkeysinslot
cluster info
cluster keyslot
cluster meet
cluster myid
cluster nodes
cluster replicate
cluster reset
cluster saveconfig
cluster set-config-epoch
cluster setslot
cluster slaves
cluster replicas
cluster slots
readonly
readwrite
generic
migrate
object
touch
wait
geo
geoadd
geohash
geopos
geodist
georadius
georadiusbymember
list
lpos
pubsub
pubsub
scripting
script debug
script kill
stream
xinfo
xadd
xtrim
xdel
xrange
xrevrange
xlen
xread
xgroup
xreadgroup
xack
xclaim
xpending
Other limitations
Apart from unimplemented commands, there are a number of cases where fakeredis won’t give identical results to real redis. The following are differences that are unlikely to ever be fixed; there are also differences that are fixable (such as commands that do not support all features) which should be filed as bugs in Github.
Hyperloglogs are implemented using sets underneath. This means that the type command will return the wrong answer, you can’t use get to retrieve the encoded value, and counts will be slightly different (they will in fact be exact).
When a command has multiple error conditions, such as operating on a key of the wrong type and an integer argument is not well-formed, the choice of error to return may not match redis.
The incrbyfloat and hincrbyfloat commands in redis use the C long double type, which typically has more precision than Python’s float type.
Redis makes guarantees about the order in which clients blocked on blocking commands are woken up. Fakeredis does not honour these guarantees.
Where redis contains bugs, fakeredis generally does not try to provide exact bug-compatibility. It’s not practical for fakeredis to try to match the set of bugs in your specific version of redis.
There are a number of cases where the behaviour of redis is undefined, such as the order of elements returned by set and hash commands. Fakeredis will generally not produce the same results, and in Python versions before 3.6 may produce different results each time the process is re-run.
SCAN/ZSCAN/HSCAN/SSCAN will not necessarily iterate all items if items are deleted or renamed during iteration. They also won’t necessarily iterate in the same chunk sizes or the same order as redis.
DUMP/RESTORE will not return or expect data in the RDB format. Instead the pickle module is used to mimic an opaque and non-standard format. WARNING: Do not use RESTORE with untrusted data, as a malicious pickle can execute arbitrary code.
Contributing
Contributions are welcome. Please see the contributing guide for more details. The maintainer generally has very little time to work on fakeredis, so the best way to get a bug fixed is to contribute a pull request.
If you’d like to help out, you can start with any of the issues labeled with HelpWanted.
Running the Tests
To ensure parity with the real redis, there are a set of integration tests that mirror the unittests. For every unittest that is written, the same test is run against a real redis instance using a real redis-py client instance. In order to run these tests you must have a redis server running on localhost, port 6379 (the default settings). WARNING: the tests will completely wipe your database!
First install the requirements file:
pip install -r requirements.txt
To run all the tests:
pytest
If you only want to run tests against fake redis, without a real redis:
pytest -m fake
Because this module is attempting to provide the same interface as redis-py, the python bindings to redis, a reasonable way to test this to to take each unittest and run it against a real redis server. fakeredis and the real redis server should give the same result. To run tests against a real redis instance instead:
pytest -m real
If redis is not running and you try to run tests against a real redis server, these tests will have a result of ‘s’ for skipped.
There are some tests that test redis blocking operations that are somewhat slow. If you want to skip these tests during day to day development, they have all been tagged as ‘slow’ so you can skip them by running:
pytest -m "not slow"
Revision history
1.5.1
#298 Fix a deadlock caused by garbage collection
1.5.0
Fix clearing of watches when a transaction is aborted.
Support Python 3.9 and drop support for Python 3.5.
Update handling of EXEC failures to match redis 6.0.6+.
#293 Align FakeConnection constructor signature to base class
Skip hypothesis tests on 32-bit Redis servers.
1.4.5
1.4.4
1.4.3
1.4.2
1.4.1
#268 Support redis-py 3.5 (no code changes, just setup.py)
1.4.0
Add support for aioredis.
Fix interaction of no-op SREM with WATCH.
1.3.1
Make errors from Lua behave more like real redis
1.3.0
#266 Implement redis.log in Lua
1.2.1
#262 Cannot repr redis object without host attribute
Fix a bug in the hypothesis test framework that occasionally caused a failure
1.2.0
Drop support for Python 2.7.
Test with Python 3.8 and Pypy3.
Refactor Hypothesis-based tests to support the latest version of Hypothesis.
Fix a number of bugs in the Hypothesis tests that were causing spurious test failures or hangs.
Fix some obscure corner cases
If a WATCHed key is MOVEd, don’t invalidate the transaction.
Some cases of passing a key of the wrong type to SINTER/SINTERSTORE were not reporting a WRONGTYPE error.
ZUNIONSTORE/ZINTERSTORE could generate different scores from real redis in corner cases (mostly involving infinities).
Speed up the implementation of BINCOUNT.
1.1.1
Support redis-py 3.4.
1.1.0
#257 Add other inputs for redis connection
1.0.5
1.0.4
1.0.3
#235 Support for redis==3.2
1.0.2
#235 Depend on redis<3.2
1.0.1
Fix crash when a connection closes without unsubscribing and there is a subsequent PUBLISH
1.0
Version 1.0 is a major rewrite. It works at the redis protocol level, rather than at the redis-py level. This allows for many improvements and bug fixes.
#225 Support redis-py 3.0
#65 Support execute_command method
#206 Drop Python 2.6 support
#141 Support strings in integer arguments
#218 Watches checks commands rather than final value
#220 Better support for calling into redis from Lua
#158 Better timestamp handling
Support for register_script function.
Fixes for race conditions caused by keys expiring mid-command
Disallow certain commands in scripts
Fix handling of blocking commands inside transactions
Fix handling of PING inside pubsub connections
It also has new unit tests based on hypothesis, which has identified many corner cases that are now handled correctly.
1.0rc1
Compared to 1.0b1:
#231 Fix setup.py, fakeredis is directory/package now
Fix some corner case handling of +0 vs -0
Fix pubsub get_message with a timeout
Disallow certain commands in scripts
Fix handling of blocking commands inside transactions
Fix handling of PING inside pubsub connections
Make hypothesis tests skip if redis is not running
Minor optimisations to zset
1.0b1
Version 1.0 is a major rewrite. It works at the redis protocol level, rather than at the redis-py level. This allows for many improvements and bug fixes.
#225 Support redis-py 3.0
#65 Support execute_command method
#206 Drop Python 2.6 support
#141 Support strings in integer arguments
#218 Watches checks commands rather than final value
#220 Better support for calling into redis from Lua
#158 Better timestamp handling
Support for register_script function.
Fixes for race conditions caused by keys expiring mid-command
It also has new unit tests based on hypothesis, which has identified many corner cases that are now handled correctly.
0.16.0
#224 Add __delitem__
Restrict to redis<3
0.15.0
0.14.0
This release greatly improves support for threads: the bulk of commands are now thread-safe, lock has been rewritten to more closely match redis-py, and pubsub now supports run_in_thread:
0.13.1
0.13.0.1
Fix a typo in the Trove classifiers
0.13.0
0.12.0
0.11.0
0.10.3
This is a minor bug-fix release.
#189 Add ‘System’ to the list of libc equivalents
0.10.2
This is a bug-fix release.
#181 Upgrade twine & other packaging dependencies
#106 randomkey method is not implemented, but is not in the list of unimplemented commands
#170 Prefer readthedocs.io instead of readthedocs.org for doc links
#180 zadd with no member-score pairs should fail
#145 expire / _expire: accept ‘long’ also as time
#182 Pattern matching does not match redis behaviour
#135 Scan includes expired keys
#185 flushall() doesn’t clean everything
#186 Fix psubscribe with handlers
Run CI on PyPy
Fix coverage measurement
0.10.1
This release merges the fakenewsredis fork back into fakeredis. The version number is chosen to be larger than any fakenewsredis release, so version numbers between the forks are comparable. All the features listed under fakenewsredis version numbers below are thus included in fakeredis for the first time in this release.
Additionally, the following was added: - #169 Fix set-bit
fakenewsredis 0.10.0
fakenewsredis 0.9.5
This release makes a start on supporting Lua scripting: - #9 Add support for StrictRedis.eval for Lua scripts
fakenewsredis 0.9.4
This is a minor bugfix and optimization release: - #5 Update to match redis-py 2.10.6 - #7 Set with invalid expiry time should not set key - Avoid storing useless expiry times in hashes and sorted sets - Improve the performance of bulk zadd
fakenewsredis 0.9.3
This is a minor bugfix release: - #6 Fix iteration over pubsub list - #3 Preserve expiry time when mutating keys - Fixes to typos and broken links in documentation
fakenewsredis 0.9.2
This is the first release of fakenewsredis, based on fakeredis 0.9.0, with the following features and fixes:
fakeredis #78 Behaviour of transaction() does not match redis-py
fakeredis #79 Implement redis-py’s .lock()
fakeredis #90 HINCRBYFLOAT changes hash value type to float
fakeredis #101 Should raise an error when attempting to get a key holding a list)
fakeredis #146 Pubsub messages and channel names are forced to be ASCII strings on Python 2
fakeredis #163 getset does not to_bytes the value
fakeredis #165 linsert implementation is incomplete
fakeredis #128 Remove _ex_keys mapping
fakeredis #139 Fixed all flake8 errors and added flake8 to Travis CI
fakeredis #166 Add type checking
fakeredis #168 Use repr to encode floats in to_bytes
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file fakeredis-1.5.1.tar.gz.
File metadata
- Download URL: fakeredis-1.5.1.tar.gz
- Upload date:
- Size: 78.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.5.0.1 requests/2.25.1 setuptools/56.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7f85faf640a0da564d8342a7d62936b07f23f4a85f756118fbd35b55f64f281c |
|
| MD5 | f13cd9b2c184e82cd221f513a46a2332 |
|
| BLAKE2b-256 | 090cb72f7bb7b463cad8bc6f6329a119fd9452130da131470082cfdf7224c3c8 |
File details
Details for the file fakeredis-1.5.1-py3-none-any.whl.
File metadata
- Download URL: fakeredis-1.5.1-py3-none-any.whl
- Upload date:
- Size: 35.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.5.0.1 requests/2.25.1 setuptools/56.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | afeb843b031697b3faff0eef8eedadef110741486b37e2bfb95167617785040f |
|
| MD5 | 70ebf0f019c5ebd75e495a0a80348d16 |
|
| BLAKE2b-256 | 15ebf9ae4a8c3d394e1bb6de8002775f48f7c1d2d7ff509a15d0e1777a5cd738 |
