Package for calculating and visualising confidence intervals, e.g. for A/B test analysis.

These details have not been verified by PyPI

Project links

Project description

Spotify Confidence

Status Latest release Python Python

Python library for AB test analysis.

Why use Spotify Confidence?

Spotify Confidence provides convinience wrappers around statsmodel's various functions for computing p-values and confidence intervalls. With Spotify Confidence it's easy to compute several p-values and confidence bounds in one go, e.g. one for each country or for each date. Each function comes in two versions:

one that return a pandas dataframe,
one that returns a Chartify chart.

Spotify Confidence has support calculating p-values and confidence intervals using Z-statistics, Student's T-statistics (or more exactly Welch's T-test), as well as Chi-squared statistics.

There is also a Bayesian alternative in the BetaBinomial class.

Examples

import spotify_confidence as confidence
import pandas as pd

data = pd.DataFrame(
    {'variation_name': ['treatment1', 'control', 'treatment2', 'treatment3'],
     'success': [50, 40, 10, 20],
     'total': [100, 100, 50, 60]
    }
)

test = confidence.ZTest(
    data,
    numerator_column='success',
    numerator_sum_squares_column=None,
    denominator_column='total',
    categorical_group_columns='variation_name',
    correction_method='bonferroni')
    
test.summary()
test.difference(level_1='control', level_2='treatment1')
test.multiple_difference(level='control', level_as_reference=True)

test.summary_plot().show()
test.difference_plot(level_1='control', level_2='treatment1').show()
test.multiple_difference_plot(level='control', level_as_reference=True).show()

See jupyter notebooks in examples folder for more complete examples.

Installation

Spotify Confidence can be installed via pip:

pip install spotify-confidence

Find the latest release version here

Code of Conduct

This project adheres to the Open Code of Conduct By participating, you are expected to honor this code.

Project details

These details have not been verified by PyPI

Project links

Release history Release notifications | RSS feed

3.0.4

Sep 13, 2024

3.0.3

Oct 12, 2023

3.0.2

Aug 8, 2023

3.0.1

Apr 21, 2023

3.0.0

Apr 5, 2023

2.7.7

Jan 22, 2023

2.7.6

Nov 23, 2022

2.7.5

Nov 15, 2022

2.7.4

Aug 31, 2022

2.7.3

Aug 30, 2022

2.7.2

Aug 18, 2022

2.7.1

Aug 9, 2022

2.7.0

Jun 7, 2022

2.6.7

Apr 22, 2022

2.6.6

Mar 25, 2022

2.6.5

Mar 25, 2022

2.6.4

Mar 17, 2022

2.6.3

Mar 11, 2022

2.6.2

Feb 16, 2022

2.6.1

Jan 21, 2022

2.6.0

Dec 22, 2021

2.5.0

Dec 17, 2021

2.4.3

Dec 7, 2021

2.4.2

Nov 24, 2021

2.4.1

Nov 12, 2021

2.4.0

Nov 8, 2021

2.3.7

Oct 22, 2021

2.3.6

Oct 20, 2021

2.3.5

Oct 19, 2021

2.3.4

Oct 19, 2021

2.3.3

Oct 19, 2021

2.3.2

Oct 19, 2021

2.3.1

Oct 19, 2021

2.3.0

Oct 18, 2021

2.2.0

Oct 7, 2021

2.1.4

Sep 28, 2021

This version

2.1.3

Sep 28, 2021

2.1.2

Sep 2, 2021

2.1.1

Apr 21, 2021

2.1.0

Apr 21, 2021

2.0.2

Apr 14, 2021

2.0.1

Apr 5, 2021

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spotify-confidence-2.1.3.tar.gz (3.6 MB view details)

Uploaded Sep 28, 2021 Source

Built Distribution

spotify_confidence-2.1.3-py3-none-any.whl (61.8 kB view details)

Uploaded Sep 28, 2021 Python 3

File details

Details for the file spotify-confidence-2.1.3.tar.gz.

File metadata

Download URL: spotify-confidence-2.1.3.tar.gz
Upload date: Sep 28, 2021
Size: 3.6 MB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.6.9

File hashes

Hashes for spotify-confidence-2.1.3.tar.gz
Algorithm	Hash digest
SHA256	`6db59d0cdc27846e7dfd83f0a9090a51c84198765f48b94c4df44721fbf2ac6f`
MD5	`78a9a4645c24a817a901b77f51b912db`
BLAKE2b-256	`a4d88fef11d64c84f836d5879afd953332b92206a2b37f818fca68385a2dc3fa`

See more details on using hashes here.

File details

Details for the file spotify_confidence-2.1.3-py3-none-any.whl.

File metadata

Download URL: spotify_confidence-2.1.3-py3-none-any.whl
Upload date: Sep 28, 2021
Size: 61.8 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.6.9

File hashes

Hashes for spotify_confidence-2.1.3-py3-none-any.whl
Algorithm	Hash digest
SHA256	`d7cd08378d1633554f2e4f72628a323c6d274596e1d1b7e01282f6e959ab027b`
MD5	`86811d06d0de017a2ffaa3d31933576b`
BLAKE2b-256	`4246c357d19151c76111550b53b33b3759ad19d0dc8c86af170dcec0500b9289`