Graph engine - distributed graph engine to host graphs.
Project description
DeepGNN Overview
DeepGNN is a framework for training machine learning models on large scale graph data. DeepGNN contains all the necessary features including:
- Distributed GNN training and inferencing on both CPU and GPU.
- Custom graph neural network design.
- Online Sampling: Graph Engine (GE) will load all graph data, each training worker will call GE to get node/edge/neighbor features and labels.
- Automatic graph partitioning.
- Highly performant and scalable.
Project is in alpha version, there might be breaking changes in the future and they will be documented in the changelog.
Usage
Install pip package:
python -m pip install deepgnn-torch
If you want to build package from source, see instructions in CONTRIBUTING.md.
Train and evaluate a graphsage model with pytorch on cora dataset:
cd examples/pytorch/graphsage
./run.sh
Training other models
Examples folder contains various models one can experiment with DeepGNN. To train models with Tensorflow you need to install deepgnn-tf package, deepgnn-torch package contains packages to train pytorch examples. Each model folder contains a shell script run.sh that will train a corresponding model on a toy graph, a README.md file with a short description of a model, reference to original paper, and explanation of command line arguments.
Migrating Scripts
We provide a python module to help you upgrade your scripts to new deepgnn versions.
pip install google-pasta
python -m deepgnn.migrate.0_1_56 --script_dir directory_to_migrate
See CHANGELOG.md for full change details.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
File details
Details for the file deepgnn_ge-0.1.58.dev1-py3-none-win_amd64.whl.
File metadata
- Download URL: deepgnn_ge-0.1.58.dev1-py3-none-win_amd64.whl
- Upload date:
- Size: 3.1 MB
- Tags: Python 3, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 40b6a8c1f57264335f9f176d3b1e02ce238be2f778f6d49e4cceeaa7b86b2887 |
|
| MD5 | b9149f3532a940c365537c215521df23 |
|
| BLAKE2b-256 | a5bfe0d467ca621c03c1244398c3bc80825a9088ab44f0cd5f2554f12627a9d4 |
File details
Details for the file deepgnn_ge-0.1.58.dev1-py3-none-manylinux1_x86_64.whl.
File metadata
- Download URL: deepgnn_ge-0.1.58.dev1-py3-none-manylinux1_x86_64.whl
- Upload date:
- Size: 11.8 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | e9e299263fffba8a317c53413d72e681bcffc7d0db73e56532b5db58fdaf9be8 |
|
| MD5 | 05cf703253fac6ea2aa05b51b13238e5 |
|
| BLAKE2b-256 | e84ca7fb5b98572b5cbef0506cd852ef06075fee8d6d1c592a642d3a7552d797 |
File details
Details for the file deepgnn_ge-0.1.58.dev1-py3-none-macosx_10_9_x86_64.whl.
File metadata
- Download URL: deepgnn_ge-0.1.58.dev1-py3-none-macosx_10_9_x86_64.whl
- Upload date:
- Size: 107.0 kB
- Tags: Python 3, macOS 10.9+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9b722e06189b94d0aea784bbb1a4c7deda069853fc255e9fc699eb1dbde8f343 |
|
| MD5 | 518f6440e4e8bd304bdff580425a9369 |
|
| BLAKE2b-256 | cc3557bcfb426ef40ffa32e6b637df3ddf738332ba29e80033f410137cbc5c8b |
