Implementation of the DataFrame Standard for pandas and Polars
Project description
DataFrame API Compat
Implementation of the DataFrame Standard for pandas and polars.
What's this?
Please read our blog post! https://data-apis.org/blog/dataframe_standard_rfc/.
Documentation
Please check https://data-apis.org/dataframe-api/draft/API_specification/index.html for the methods supported by the Consortium Dataframe Standard.
How to try this out
Here's an example of how you can try this out:
import polars as pl
df = pl.DataFrame({'a': [1,2,3]})
df_std = df.__dataframe_consortium_standard__()
The object df_std is a Standard-compliant DataFrame. Check the
API Specification
for the full list of methods supported on it.
Here's an example of a dataframe-agnostic function:
from typing import Any
def my_dataframe_agnostic_function(df_non_standard: Any) -> Any:
df = df_non_standard.__dataframe_consortium_standard__()
for column_name in df.column_names:
new_column = df.col(column_name)
new_column = (new_column - new_column.mean()) / new_column.std()
df = df.assign(new_column.rename(f'{column_name}_scaled'))
return df.dataframe
As long as you have this package installed, then either a pandas or Polars DataFrame should work with the code above, e.g.:
import pandas as pd
import polars as pl
df_pd = pd.DataFrame({'a': [1,2,3], 'b': [4,5,6]})
df_pl = pl.DataFrame({'a': [1,2,3], 'b': [4,5,6]})
my_dataframe_agnostic_function(df_pd)
my_dataframe_agnostic_function(df_pl)
Compliance with the Standard
The classes here also have an extra .persist method, which is not (yet) part of the Standard.
Installation
pip install dataframe-api-compat
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file dataframe_api_compat-0.1.29.tar.gz.
File metadata
- Download URL: dataframe_api_compat-0.1.29.tar.gz
- Upload date:
- Size: 38.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c0677270d6fce7628f1e53a58ba3c21e0ce0e7f07193200e5322c8186345cf8f |
|
| MD5 | f00159ab9897ac1753cf656e0a616b70 |
|
| BLAKE2b-256 | 6a9da623f9ba0947831e878f0064e9479ed34c72cb78f22f384a5ec4f10d7878 |
File details
Details for the file dataframe_api_compat-0.1.29-py3-none-any.whl.
File metadata
- Download URL: dataframe_api_compat-0.1.29-py3-none-any.whl
- Upload date:
- Size: 26.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1dcfeb6452cdf9d891d1ab47867c13d0e8de86b7cb2402219ac1b526d0244aad |
|
| MD5 | e32edd10f8042e5a9e1d2e87a40190af |
|
| BLAKE2b-256 | b982063c12b78f331f8bcf31fc26c4ecd1c7935114f7f9b3a9800c3a82e13f0e |
