Skip to main content

Graph engine - distributed graph engine to host graphs.

Project description

DeepGNN Overview

DeepGNN is a framework for training machine learning models on large scale graph data. DeepGNN contains all the necessary features including:

  • Distributed GNN training and inferencing on both CPU and GPU.
  • Custom graph neural network design.
  • Online Sampling: Graph Engine (GE) will load all graph data, each training worker will call GE to get node/edge/neighbor features and labels.
  • Automatic graph partitioning.
  • Highly performant and scalable.

Project is in alpha version, there might be breaking changes in the future and they will be documented in the changelog.

Usage

Install pip package:

python -m pip install deepgnn-torch

If you want to build package from source, see instructions in CONTRIBUTING.md.

Train and evaluate a graphsage model with pytorch on cora dataset:

cd examples/pytorch/graphsage
./run.sh

Training other models

Examples folder contains various models one can experiment with DeepGNN. To train models with Tensorflow you need to install deepgnn-tf package, deepgnn-torch package contains packages to train pytorch examples. Each model folder contains a shell script run.sh that will train a corresponding model on a toy graph, a README.md file with a short description of a model, reference to original paper, and explanation of command line arguments.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

deepgnn_ge-0.1.51-py3-none-win_amd64.whl (2.7 MB view details)

Uploaded Python 3 Windows x86-64

deepgnn_ge-0.1.51-py3-none-manylinux_2_27_x86_64.whl (4.4 MB view details)

Uploaded Python 3 manylinux: glibc 2.27+ x86-64

deepgnn_ge-0.1.51-py3-none-macosx_10_9_x86_64.whl (4.0 MB view details)

Uploaded Python 3 macOS 10.9+ x86-64

File details

Details for the file deepgnn_ge-0.1.51-py3-none-win_amd64.whl.

File metadata

  • Download URL: deepgnn_ge-0.1.51-py3-none-win_amd64.whl
  • Upload date:
  • Size: 2.7 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.6.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.8.10

File hashes

Hashes for deepgnn_ge-0.1.51-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 8c76e11acb64a33eda248e2e9199a8bcb64ce5864d82e745bd9c555d3cf46096
MD5 4a6a4b932f39a5ce853a6dbfac0884a3
BLAKE2b-256 d44179d568d04f608c9eb7e038e23865ce1aefe86002686caaceffa77ba3a6fe

See more details on using hashes here.

File details

Details for the file deepgnn_ge-0.1.51-py3-none-manylinux_2_27_x86_64.whl.

File metadata

File hashes

Hashes for deepgnn_ge-0.1.51-py3-none-manylinux_2_27_x86_64.whl
Algorithm Hash digest
SHA256 0b3ca6a7edfa0c1f7b4c992be0f52f424919f8710b36824d8c7c64dcd98bd386
MD5 1495f893d1b7b56114789c7c3dcd69cf
BLAKE2b-256 3acdf420686985053e2f5f10b0c26a87f9511d1ff2f23a20bbd9671882e301f2

See more details on using hashes here.

File details

Details for the file deepgnn_ge-0.1.51-py3-none-manylinux1_x86_64.whl.

File metadata

  • Download URL: deepgnn_ge-0.1.51-py3-none-manylinux1_x86_64.whl
  • Upload date:
  • Size: 13.8 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.6.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.8.10

File hashes

Hashes for deepgnn_ge-0.1.51-py3-none-manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 8b6d6b9b7e3aed86330540cc334161dfeabc71b1c0fec0ce85294734df738031
MD5 2a868215c86e2caaf94b341960b5b531
BLAKE2b-256 5d0ed4efc1658e7bb7123f925d76a1fa09b0fa0dd05670d3a61a4e0bc4b78916

See more details on using hashes here.

File details

Details for the file deepgnn_ge-0.1.51-py3-none-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: deepgnn_ge-0.1.51-py3-none-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 4.0 MB
  • Tags: Python 3, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.6.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.8.10

File hashes

Hashes for deepgnn_ge-0.1.51-py3-none-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 4a2df050e920a049f48880f9a72fc6f7da311eaf76ce93901147cf7f06de4437
MD5 460eb2f8e68e0d47add0c8b937499e03
BLAKE2b-256 bfe44d8e5651b54e3faeca8fbba415038d7a495fba8db29bfb731a0fbbe9bb92

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page