Development of awkward 1.0, to replace scikit-hep/awkward-array in 2020.

These details have not been verified by PyPI

Project links

Project description

Awkward Array is a library for nested, variable-sized data, including arbitrary-length lists, records, mixed types, and missing data, using NumPy-like idioms.

Arrays are dynamically typed, but operations on them are compiled and fast. Their behavior coincides with NumPy when array dimensions are regular and generalizes when they're not.

How-to documentation
for data analysts

How-it-works tutorials
for developers

Python
API reference

C++
API reference

Motivating example

Given an array of objects with x, y fields and variable-length nested lists like

array = ak.Array([
    [{"x": 1.1, "y": [1]}, {"x": 2.2, "y": [1, 2]}, {"x": 3.3, "y": [1, 2, 3]}],
    [],
    [{"x": 4.4, "y": {1, 2, 3, 4]}, {"x": 5.5, "y": [1, 2, 3, 4, 5]}]
])

the following slices out the y values, drops the first element from each inner list, and runs NumPy's np.square function on everything that is left:

output = np.square(array["y", ..., 1:])

The result is

[
    [[], [4], [4, 9]],
    [],
    [[4, 9, 16], [4, 9, 16, 25]]
]

The equivalent using only Python is

output = []
for sublist in array:
    tmp1 = []
    for record in sublist:
        tmp2 = []
        for number in record["y"][1:]:
            tmp2.append(np.square(number))
        tmp1.append(tmp2)
    output.append(tmp1)

Not only is the expression using Awkward Arrays more concise, using idioms familiar from NumPy, but it's much faster and uses less memory.

For a similar problem 10 million times larger than the one above (on a single-threaded 2.2 GHz processor),

the Awkward Array one-liner takes 4.6 seconds to run and uses 2.1 GB of memory,
the equivalent using Python lists and dicts takes 138 seconds to run and uses 22 GB of memory.

Speed and memory factors in the double digits are common because we're replacing Python's dynamically typed, pointer-chasing virtual machine with type-specialized, precompiled routines on contiguous data. (In other words, for the same reasons as NumPy.) Even higher speedups are possible when Awkward Array is paired with Numba.

Our presentation at SciPy 2020 provides a good introduction, showing how to use these arrays in a real analysis.

Project details

These details have not been verified by PyPI

Project links

Release history Release notifications | RSS feed

1.0.0

Dec 5, 2020

1.0.0rc1 pre-release

Dec 1, 2020

0.4.5

Nov 24, 2020

0.4.4

Nov 17, 2020

0.4.3

Nov 5, 2020

0.4.2

Nov 4, 2020

0.4.1

Nov 3, 2020

0.4.0

Oct 29, 2020

0.3.1

Sep 21, 2020

0.3.0

Sep 21, 2020

0.2.38

Sep 18, 2020

0.2.37

Sep 12, 2020

0.2.36

Sep 8, 2020

0.2.35

Aug 26, 2020

0.2.34

Aug 25, 2020

0.2.33

Aug 22, 2020

0.2.32

Aug 19, 2020

0.2.31

Aug 15, 2020

0.2.30

Aug 11, 2020

0.2.29

Aug 10, 2020

0.2.28

Aug 7, 2020

0.2.27

Jul 23, 2020

This version

0.2.26

Jul 23, 2020

0.2.25

Jul 11, 2020

0.2.24

Jun 12, 2020

0.2.23

Jun 6, 2020

0.2.22

May 29, 2020

0.2.21

May 28, 2020

0.2.20

May 14, 2020

0.2.19

May 8, 2020

0.2.10

Apr 7, 2020

0.2.0

Mar 6, 2020

0.1.128

Feb 29, 2020

0.1.92

Jan 28, 2020

0.1.38

Dec 28, 2019

0.1.25

Nov 27, 2019

0.1.17

Oct 22, 2019

0.1.7

Sep 26, 2019

0.1.0

Aug 27, 2019

0.0.14

Aug 17, 2019

0.0.10

Aug 16, 2019

0.0.6

Aug 16, 2019

0.0.1

Aug 16, 2019

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

awkward1-0.2.26.tar.gz (634.1 kB view details)

Uploaded Jul 23, 2020 Source

Built Distributions

awkward1-0.2.26-cp39-cp39-manylinux2010_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.9 manylinux: glibc 2.12+ x86-64

awkward1-0.2.26-cp39-cp39-manylinux1_x86_64.whl (8.0 MB view details)

Uploaded Jul 23, 2020 CPython 3.9

awkward1-0.2.26-cp39-cp39-manylinux1_i686.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 3.9

awkward1-0.2.26-cp38-cp38-win_amd64.whl (11.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.8 Windows x86-64

awkward1-0.2.26-cp38-cp38-win32.whl (8.6 MB view details)

Uploaded Jul 23, 2020 CPython 3.8 Windows x86

awkward1-0.2.26-cp38-cp38-manylinux2010_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.8 manylinux: glibc 2.12+ x86-64

awkward1-0.2.26-cp38-cp38-manylinux1_x86_64.whl (8.0 MB view details)

Uploaded Jul 23, 2020 CPython 3.8

awkward1-0.2.26-cp38-cp38-manylinux1_i686.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 3.8

awkward1-0.2.26-cp38-cp38-macosx_10_9_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.8 macOS 10.9+ x86-64

awkward1-0.2.26-cp37-cp37m-win_amd64.whl (11.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.7m Windows x86-64

awkward1-0.2.26-cp37-cp37m-win32.whl (8.6 MB view details)

Uploaded Jul 23, 2020 CPython 3.7m Windows x86

awkward1-0.2.26-cp37-cp37m-manylinux2010_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.7m manylinux: glibc 2.12+ x86-64

awkward1-0.2.26-cp37-cp37m-manylinux1_x86_64.whl (8.0 MB view details)

Uploaded Jul 23, 2020 CPython 3.7m

awkward1-0.2.26-cp37-cp37m-manylinux1_i686.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 3.7m

awkward1-0.2.26-cp37-cp37m-macosx_10_9_x86_64.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 3.7m macOS 10.9+ x86-64

awkward1-0.2.26-cp36-cp36m-win_amd64.whl (11.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.6m Windows x86-64

awkward1-0.2.26-cp36-cp36m-win32.whl (8.6 MB view details)

Uploaded Jul 23, 2020 CPython 3.6m Windows x86

awkward1-0.2.26-cp36-cp36m-manylinux2010_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.6m manylinux: glibc 2.12+ x86-64

awkward1-0.2.26-cp36-cp36m-manylinux1_x86_64.whl (8.0 MB view details)

Uploaded Jul 23, 2020 CPython 3.6m

awkward1-0.2.26-cp36-cp36m-manylinux1_i686.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 3.6m

awkward1-0.2.26-cp36-cp36m-macosx_10_9_x86_64.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 3.6m macOS 10.9+ x86-64

awkward1-0.2.26-cp35-cp35m-win_amd64.whl (11.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.5m Windows x86-64

awkward1-0.2.26-cp35-cp35m-win32.whl (8.6 MB view details)

Uploaded Jul 23, 2020 CPython 3.5m Windows x86

awkward1-0.2.26-cp35-cp35m-manylinux2010_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 3.5m manylinux: glibc 2.12+ x86-64

awkward1-0.2.26-cp35-cp35m-manylinux1_x86_64.whl (8.0 MB view details)

Uploaded Jul 23, 2020 CPython 3.5m

awkward1-0.2.26-cp35-cp35m-manylinux1_i686.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 3.5m

awkward1-0.2.26-cp27-cp27mu-manylinux2010_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 2.7mu manylinux: glibc 2.12+ x86-64

awkward1-0.2.26-cp27-cp27mu-manylinux1_x86_64.whl (8.0 MB view details)

Uploaded Jul 23, 2020 CPython 2.7mu

awkward1-0.2.26-cp27-cp27mu-manylinux1_i686.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 2.7mu

awkward1-0.2.26-cp27-cp27m-win_amd64.whl (11.3 MB view details)

Uploaded Jul 23, 2020 CPython 2.7m Windows x86-64

awkward1-0.2.26-cp27-cp27m-win32.whl (8.6 MB view details)

Uploaded Jul 23, 2020 CPython 2.7m Windows x86

awkward1-0.2.26-cp27-cp27m-manylinux2010_x86_64.whl (8.3 MB view details)

Uploaded Jul 23, 2020 CPython 2.7m manylinux: glibc 2.12+ x86-64

awkward1-0.2.26-cp27-cp27m-manylinux1_x86_64.whl (8.0 MB view details)

Uploaded Jul 23, 2020 CPython 2.7m

awkward1-0.2.26-cp27-cp27m-manylinux1_i686.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 2.7m

awkward1-0.2.26-cp27-cp27m-macosx_10_9_x86_64.whl (8.2 MB view details)

Uploaded Jul 23, 2020 CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file awkward1-0.2.26.tar.gz.

File metadata

Download URL: awkward1-0.2.26.tar.gz
Upload date: Jul 23, 2020
Size: 634.1 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/3.7.8

File hashes

Hashes for awkward1-0.2.26.tar.gz
Algorithm	Hash digest
SHA256	`284afbdc37d628823d3aa549277744f548f713a4cca9aa3c006dfa8a4554df39`
MD5	`06d496d42511e771f3c9c6842f38a288`
BLAKE2b-256	`638b05375c884cb136361d987260d93b57651addaf504d0ac75f70e2a8179f30`

Algorithm	Hash digest
SHA256	`bbaf3dafde43abea4ee40af7efcded8c8aa8e83c0dd6d1f4b919a272d16f5413`
MD5	`ef45c34ab5bdb22fc09d0838da7e00ce`
BLAKE2b-256	`72cb7453f5f6c06901a52fb531a5f9b2f523352e76131623a7d0c1a98f07de63`

Algorithm	Hash digest
SHA256	`a21946930d0332e9350ca98511ad4ddf0cb19592e62171179d1e0d59c0a3033b`
MD5	`81266bca38d30429ee770d4f491cc05d`
BLAKE2b-256	`d57d83ec2854ea88ab079752792679427b479aa7ffd8847fd324d4e66d7ee98a`

Algorithm	Hash digest
SHA256	`55522766b4977841dd3d05626442feb9b8ccc8dc61c99083a69b70f4007d7477`
MD5	`c44d5645e8908174f7f2fa1adeb3c25e`
BLAKE2b-256	`60d117c9e917a27a9263d2f25f02ab54ddf01bac334e8b0e8647a53f27d223e2`

Algorithm	Hash digest
SHA256	`13b289e7e119508ec46be817d8f3f32c27c843d1afd26ea7cb5c1c6e8d339e6b`
MD5	`ceca106a821fff91799a8692b5907184`
BLAKE2b-256	`6b2f588ebf86ef93470591970be7608f9d1f3f9718bf89371a5be9d24d9fa501`

Algorithm	Hash digest
SHA256	`790e61b44488ebe61cce9d0e607bad50bd60759006ad7c5d141a965edc0530b5`
MD5	`88528e723b43b667edd044bbfc5c86e2`
BLAKE2b-256	`0e0e4f80db9cf2d4cb855928398ecec91d23db9e83c4148d201d7c2511519069`

Algorithm	Hash digest
SHA256	`3dee4f3fd23b5fa6ec6bb01cc3094b2d86c5c0a018be9f68dee38af789f808f3`
MD5	`e7c24e88109ed1dfd85a29bec7faf8cd`
BLAKE2b-256	`52582cf839a8842728e94ad8486a95f553c7cef18275e5d0ebc30099d4871d28`

Algorithm	Hash digest
SHA256	`575ee770bb5be903f9bd08babfe4c35c6af7c4223b41274c0ef238cb70a14689`
MD5	`8b102aa4f30b45d05db14bddf8216425`
BLAKE2b-256	`f0ad07cb76f24462cc663afcd2abe0f92ee65e4d9c1115a0370b48772b897f12`

Algorithm	Hash digest
SHA256	`adf0ff28c0d068e16f2862efcb92e2eb5028945cc4383eb7fe9ec0969ce48e59`
MD5	`d514a26c5ad33e5ec392f21ed1cd7adb`
BLAKE2b-256	`fa2b35e6db8144b38a3763ef767a5455a93a58f8583c64607d13c089c7d268d1`

Algorithm	Hash digest
SHA256	`c60af3dc55a11bb8e787920cd5967b29edf138e65f4acebfcf9eecea59d797e9`
MD5	`c88fd8c63924a484c2ba5e46e84f1ff5`
BLAKE2b-256	`54d3f69104d451be2c2308cb890f7b3e2166be5af599026f6e1aa157732c1171`

Algorithm	Hash digest
SHA256	`77e15fdce853b0c3819e51ce5c893c5d9380d0a179487613e8462384baa23a68`
MD5	`275ef8512b87efe69e8cc46c5445e8d3`
BLAKE2b-256	`cf07edce60589ed8399fad5964702e51b37dd041b5d6a4278523ff4d0eb3df6e`

Algorithm	Hash digest
SHA256	`a9299e904997c79b8d884994a9c4502b64eb65607c5a5640555b7ea5d3316cd6`
MD5	`7d1960b76074a6709a091ec3bcb0b5f8`
BLAKE2b-256	`3f8dddf9fa8f0321b2b7ed5233b49961ab96365a63818b714b3511b94e95c15b`

Algorithm	Hash digest
SHA256	`dcd33adaa4743ee8db7757b7edb079b2f8451bff7013429dc708b7c0e0e0b1c8`
MD5	`bb3ddb0f22bed15e03fd00b0f8db62f9`
BLAKE2b-256	`0b1399a587b0108c2deb362e220fc615dfb5ee3ae680e8aba843ba8382082be7`

Algorithm	Hash digest
SHA256	`20f153a0c8764d3690212170723253ba9c2bbd721f9b4bb4dd8f9c63194b1d2d`
MD5	`15b956de4b4f16b76a44804d9ad20862`
BLAKE2b-256	`a6f1aad7497ca0d4217c751cdd50bbe59a547e591e79526b46390854a4c9af9a`

Algorithm	Hash digest
SHA256	`e299402e37276626acc32b25118314f79c4d9ac9cfb656bf8c48f9657c687723`
MD5	`72c53176bef235a0a8275f65707b0a55`
BLAKE2b-256	`3b2168b465c7b4480e9747da8c66dfef49acc8b4afc1e7b5dea95668741cfe5b`

Algorithm	Hash digest
SHA256	`2993ecc086e5fb08a6a694fc8297481dc97d7fbc7d990a8e0f6dae779ed10162`
MD5	`d58c8976a81d8224caa808ec867d1893`
BLAKE2b-256	`3be72c34a6e855e9de68b9106d64cbd93094b974adff61f1293a8cd3f419001d`

Algorithm	Hash digest
SHA256	`7b1c0f3746de623523aa0a39fb8b8cc81748bbbbdc1fd8eede77b634a78cb48b`
MD5	`8dd1c48a112a879300369c3d1697675d`
BLAKE2b-256	`c3a08943d288e91152de6454313847be45c476916419bad827c5e4b9edbb3494`

Algorithm	Hash digest
SHA256	`1f32c46f66128fae48f626b8ed9c8dd273b5100abeeb677928658b86bea5192e`
MD5	`3268342331b16744cda9f678e68e9670`
BLAKE2b-256	`aee1630992f2e5b5c99515db3c7ea7fb6add5cf6a0c7565f3f59bc2e64d853c1`

Algorithm	Hash digest
SHA256	`bb0f2ee248284e2ed9e7cd8d379198534c3371920464cd0c0ff8de7cee43a37c`
MD5	`139fb2b9155b315d4cdc968c80cd88ae`
BLAKE2b-256	`e3f72f97cdbea3ef5cffb8a3bb1ce49fe92dff9c0da114b8fe1e418a7a4bc75e`

Algorithm	Hash digest
SHA256	`d9aa9a14b33e95fcdb2853165e5d472e97000bd14ea4e2b6c82afd5bb589a5c4`
MD5	`e7f1fde835d4683e9b99cf64e98d675f`
BLAKE2b-256	`7391aaba92d76022ad5bf7550825df69e6ee4b79128ae7073b6f2b15cbd3157a`

Algorithm	Hash digest
SHA256	`3dbbf479d4b768a6ccd3df6cf33bd9a35ae227d70db2fca3e2b88fb63e32d975`
MD5	`5d6ee74048e67bbf2a48b94c59655fa3`
BLAKE2b-256	`5a39ab7c73327efcc0e1cdf473a7352a42001f81b8ec4cbf94c84c4d8a7e5383`

awkward1 0.2.26

Navigation

Verified details

Maintainers

Unverified details

Project links

Meta

Classifiers

Project description

Motivating example

Project details

Verified details

Maintainers

Unverified details

Project links

Meta

Classifiers

Release history Release notifications | RSS feed

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

Algorithm	Hash digest
SHA256	`a33c81d4d085a1439b886df02569794d26b1a28bae823a244c82be624650c895`
MD5	`8a819e5d273b79fc5aaaee0abd865689`
BLAKE2b-256	`9e3e0257d335eac52f7e1dacb192528548e47eb9fe23fd6c3801561e2ed4cb09`

Algorithm	Hash digest
SHA256	`ff2b45d9f814ce4f1994925da4b9921f4262b79768732986198bc64ecd5bdc0d`
MD5	`e83c31d750f0cabb97eb063065b34d5d`
BLAKE2b-256	`b0ac13c2d07a072756fdc6db2900ce8ec9bf60ccf2478c941b6ba31693f718a7`

Algorithm	Hash digest
SHA256	`d6944bd2386e52cdbeff4c06af124c384d1a026307945ebd080d11a3aec67752`
MD5	`8e92e64b171eab2c7706deb4e24f6fe1`
BLAKE2b-256	`cb630d04d79daaa54e11f448277aeea227d5d19b823ba5bd3002a4b6b2c46124`

Algorithm	Hash digest
SHA256	`b1d2ca74b5faf6d089bf54cfa3738d3e42da1cabef54ceb363f1ed2736e797ff`
MD5	`577aec69970d83b0f4c86fe126ac1ce7`
BLAKE2b-256	`994fceefdd681f14b3ce3e6434e5b1efc950ee8cdf5062730e62a98f21104fc4`

Algorithm	Hash digest
SHA256	`d5fa5a3c58f6dc6dd68a015fc19e62f1b91aefcfb88ab09265f64cc1888fa520`
MD5	`6bd1e92e39c5d5f57106de944f9437a1`
BLAKE2b-256	`cb95f0cc2cff00b4c380749204e46a30a8f703840ea2ac67e39aae34cf165a91`

Algorithm	Hash digest
SHA256	`46acf72475b93508e738f8d7c69e6994999e40f528ed602f45ab0432bcbde17e`
MD5	`f547b2fdeadf34cfec9fc7d0f61dcacb`
BLAKE2b-256	`75ccfceda07c52fab2a041931ada678a517e7a9a924ab6da10dae15cd23410d5`

Algorithm	Hash digest
SHA256	`6ea816d88b11f0f1909d8cabf7a12ccb5a9c081f3ba0bea0d207ce2666396aad`
MD5	`ff385623299b0d68444ca5b277a53358`
BLAKE2b-256	`db5e7e6ee00b3154cf55905e0262a57972248f252f306c3b0b42f716e485d2a4`

Algorithm	Hash digest
SHA256	`dd09629645dce733782e859326342e7ecf85e16dc9e402a78e94c09f5f66be9e`
MD5	`e5e94616fa58fd3c7a965e7116dd4f41`
BLAKE2b-256	`52b0767940782a7ce52b8ff83d425c7e79abc95755cf04397773441a475747ab`

Algorithm	Hash digest
SHA256	`a0ed7a97c8b3f7045307a9464130e9949ae60f153126cc298316177594e2d172`
MD5	`cbd61e97655c6192ea01b5435f1b3ee1`
BLAKE2b-256	`03fa47acf6c750191f04fa252e4383a1ee6edbd9d640a3f44d7acca5bc5ffb95`

Algorithm	Hash digest
SHA256	`57d66c4bcaca5f86fd7746499802cf57a5af3f6539fc9d548138aa7897531a4d`
MD5	`ce2cbfd3cf024a657ad519c1c1a00c6f`
BLAKE2b-256	`1da550e7032af8414d3e7a93dc9c01fb7c5b958d8491eea27ffb171114825e41`