Skip to main content

Graph engine - distributed graph engine to host graphs.

Project description

DeepGNN Overview

DeepGNN is a framework for training machine learning models on large scale graph data. DeepGNN contains all the necessary features including:

  • Distributed GNN training and inferencing on both CPU and GPU.
  • Custom graph neural network design.
  • Online Sampling: Graph Engine (GE) will load all graph data, each training worker will call GE to get node/edge/neighbor features and labels.
  • Automatic graph partitioning.
  • Highly performant and scalable.

Project is in alpha version, there might be breaking changes in the future and they will be documented in the changelog.

Usage

Install pip package:

python -m pip install deepgnn-torch

If you want to build package from source, see instructions in CONTRIBUTING.md.

Train and evaluate a graphsage model with pytorch on cora dataset:

cd examples/pytorch/graphsage
./run.sh

Training other models

Examples folder contains various models one can experiment with DeepGNN. To train models with Tensorflow you need to install deepgnn-tf package, deepgnn-torch package contains packages to train pytorch examples. Each model folder contains a shell script run.sh that will train a corresponding model on a toy graph, a README.md file with a short description of a model, reference to original paper, and explanation of command line arguments.

Migrating Scripts

We provide a python module to help you upgrade your scripts to new deepgnn versions.

pip install google-pasta
python -m deepgnn.migrate.0_1_56 --script_dir directory_to_migrate

See CHANGELOG.md for full change details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

deepgnn_ge-0.1.58.dev3-py3-none-win_amd64.whl (3.1 MB view details)

Uploaded Python 3 Windows x86-64

File details

Details for the file deepgnn_ge-0.1.58.dev3-py3-none-win_amd64.whl.

File metadata

File hashes

Hashes for deepgnn_ge-0.1.58.dev3-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 e162af1d5a17f6b08fd0a13385a882f99220556495ce9ddd4a6f18113b1ec78f
MD5 3ae20716001416c4d99ddc26da510498
BLAKE2b-256 6c0c1dd89152844cbe2a578078073c0312f3da804a2970c993977b925da027d4

See more details on using hashes here.

File details

Details for the file deepgnn_ge-0.1.58.dev3-py3-none-manylinux1_x86_64.whl.

File metadata

File hashes

Hashes for deepgnn_ge-0.1.58.dev3-py3-none-manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 ad066a95a678c41f2534ec2836ec13d9ea76d940497f33e6fb4ecd41139ebf6b
MD5 b013c156b670fa0321c9fd7ec866ceec
BLAKE2b-256 d0462923d1801fd36910ff78f9d8af6c4cd972be1c839303e69e6da186fa675a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page