Skip to main content

Chia Network data ETL for Nebula Graph

Project description

nebula-chia

How To Use

ChaiBatchConvertor

Step 0, Installation

nebula-chia could be installed either via pip or from this git repo itself.

Install via pip

python3 -m pip install nebula-chia

Install from the github repo

git clone git@github.com:wey-gu/nebula-chia.git
cd nebula-chia
python3 setup.py install

Note:

Nebula-chia depends on chia-blockchain, the easiest way is to call it from the venv inside the Chia Network repo.

Step 1, Convert Chia as CSV files

ChiaBatchConvertor is used to convert Chia Block Chain data into CSV files, which could then be used for nebula-importer

$ python3 -m pip install nebula-chia
$ python

# block_record_limit = 0 means unlimited
# coin_record_limit = 0 means unlimited
from nebulachia.convertor import ChiaBatchConvertor
c = ChaiBatchConvertor(block_record_limit=0, coin_record_limit=0, write_batch_size=10000)
c.convert_block_record()
c.convert_coin_record()
exit()

$ ls -lth

-rw-r--r--   1 weyl  staff   173M May 19 13:01 coin_record.csv
-rw-r--r--   1 weyl  staff    77M May 19 12:59 block_record.csv
...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nebula-chia-0.2.tar.gz (3.8 kB view details)

Uploaded Source

Built Distribution

nebula_chia-0.2-py3-none-any.whl (7.8 kB view details)

Uploaded Python 3

File details

Details for the file nebula-chia-0.2.tar.gz.

File metadata

  • Download URL: nebula-chia-0.2.tar.gz
  • Upload date:
  • Size: 3.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4

File hashes

Hashes for nebula-chia-0.2.tar.gz
Algorithm Hash digest
SHA256 0957ed9e774901bf9435f31a4d1ddeefa407643637aebb652b677896be2b7317
MD5 3dea9926f87f7c917a6beac245aa5d5f
BLAKE2b-256 ded7dea3cd9a1650dee068655f554476ba67f2f6ddc348416db3d80bf41cac53

See more details on using hashes here.

File details

Details for the file nebula_chia-0.2-py3-none-any.whl.

File metadata

  • Download URL: nebula_chia-0.2-py3-none-any.whl
  • Upload date:
  • Size: 7.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4

File hashes

Hashes for nebula_chia-0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 59e6fa79e527dd7573626740851608262512b58c928bebadabac9bfd3312b013
MD5 4ee809251240958d04a3f8ca73df62ce
BLAKE2b-256 fbad825b47ef6159a15c69154556fedfb6165ca48a061610c872e857ddf3576e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page