Skip to main content

Graph engine - distributed graph engine to host graphs.

Project description

DeepGNN Overview

DeepGNN is a framework for training machine learning models on large scale graph data. DeepGNN contains all the necessary features including:

  • Distributed GNN training and inferencing on both CPU and GPU.
  • Custom graph neural network design.
  • Online Sampling: Graph Engine (GE) will load all graph data, each training worker will call GE to get node/edge/neighbor features and labels.
  • Automatic graph partitioning.
  • Highly performant and scalable.

Project is in alpha version, there might be breaking changes in the future and they will be documented in the changelog.

Usage

Install pip package:

python -m pip install deepgnn-torch

If you want to build package from source, see instructions in CONTRIBUTING.md.

Train and evaluate a graphsage model with pytorch on cora dataset:

cd examples/pytorch/graphsage
./run.sh

Training other models

Examples folder contains various models one can experiment with DeepGNN. To train models with Tensorflow you need to install deepgnn-tf package, deepgnn-torch package contains packages to train pytorch examples. Each model folder contains a shell script run.sh that will train a corresponding model on a toy graph, a README.md file with a short description of a model, reference to original paper, and explanation of command line arguments.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

deepgnn_ge-0.1.55.1-py3-none-win_amd64.whl (2.9 MB view details)

Uploaded Python 3 Windows x86-64

deepgnn_ge-0.1.55.1-py3-none-macosx_10_9_x86_64.whl (4.3 MB view details)

Uploaded Python 3 macOS 10.9+ x86-64

File details

Details for the file deepgnn_ge-0.1.55.1-py3-none-win_amd64.whl.

File metadata

  • Download URL: deepgnn_ge-0.1.55.1-py3-none-win_amd64.whl
  • Upload date:
  • Size: 2.9 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.6.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.8.10

File hashes

Hashes for deepgnn_ge-0.1.55.1-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 ca3fc089ef5fc731fe37a930787523568498ab6bbb8e64192d686853a817b635
MD5 4d40b38d3c59ccc7b3d12a06703009e4
BLAKE2b-256 1f9fe11a359e13473dbc56cffd6035e6e5a75395847cec5224c97132e7961edb

See more details on using hashes here.

File details

Details for the file deepgnn_ge-0.1.55.1-py3-none-manylinux1_x86_64.whl.

File metadata

  • Download URL: deepgnn_ge-0.1.55.1-py3-none-manylinux1_x86_64.whl
  • Upload date:
  • Size: 11.4 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.6.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.8.10

File hashes

Hashes for deepgnn_ge-0.1.55.1-py3-none-manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 e9bf736586fe359384ff2d09cd1dbe4a2fd3cd72d24f1c4b82b69574c6177151
MD5 f83ff34dadb6f629038af477c85120b5
BLAKE2b-256 3f0a99861541be25f1d144d699f813ca5843d0637368cb16a9eac560d53d894d

See more details on using hashes here.

File details

Details for the file deepgnn_ge-0.1.55.1-py3-none-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: deepgnn_ge-0.1.55.1-py3-none-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 4.3 MB
  • Tags: Python 3, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.6.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.8.10

File hashes

Hashes for deepgnn_ge-0.1.55.1-py3-none-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 817a38359a507f7f880018ab08d380a844671e0b595c92ed3b33ab58bbbac81d
MD5 21c32951cb886cdde98f6263f274e4e6
BLAKE2b-256 798b72dcccb77cfc2d009fb20f2fb2d69059004ed7aa869e492b8c5902ac001f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page