Tools for tools for managing federated carbon clusters.
Project description
# Carbonate Utils
Utilities to plumb carbonate tools together.
Depends on the master (and yet unreleased) branches of whisper, carbonate and carbon.
## The Tools
### carbonate-sync
```bash
$ carbonate-sync --help
usage: carbonate-sync [-h] [-c CONFIG_FILE] [-C CLUSTER] [-S REMOTE_CLUSTER]
[-n NODE] [-b BATCH_SIZE] [--ssh-options SSH_OPTIONS]
[--rsync-options RSYNC_OPTIONS] [--temp-dir TEMP_DIR]
[--exclude EXCLUDE] [--start-time START_TIME]
[--end-time END_TIME] [--overwrite OVERWRITE]
carbonate-sync
optional arguments:
-h, --help show this help message and exit
-c CONFIG_FILE, --config-file CONFIG_FILE
Config file to use (default:
/opt/graphite/conf/carbonate.conf)
-C CLUSTER, --cluster CLUSTER
Cluster name (default: main)
-S REMOTE_CLUSTER, --remote-cluster REMOTE_CLUSTER
Remote cluster name (default: None)
-n NODE, --node NODE Name of the local node (same as in carbonate.conf).
(default: coulomier)
-b BATCH_SIZE, --batch-size BATCH_SIZE
Batch size for fetching metrics. (default: 1000)
--ssh-options SSH_OPTIONS
Pass option(s) to ssh. Make sure to use "--ssh-
options=" if option starts with '-' (default: -o
StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null -o Compression=no)
--rsync-options RSYNC_OPTIONS
Pass option(s) to rsync. Make sure to use "--rsync-
options=" if option starts with '-' (default:
--archive --sparse --update --modify-window=100800)
--temp-dir TEMP_DIR Temporary dir (default: /tmp)
--exclude EXCLUDE Comma separated regexp of paths to exclude (slow).
(default: ^carbon\.)
--start-time START_TIME
Sync data more recent than this time. (default: 0)
--end-time END_TIME Sync data older than this time (default: now).
(default: 1465420874.04)
--overwrite OVERWRITE
Overwrite local data with remote data (default:
false). (default: False)
```
# Authors
* Brice Arnould <b.arnould@criteo.com>
* Corentin Chary <c.chary@criteo.com>
# License and warnings
These tools should be considered beta quality right now.
Tests exist for most functionality, but there is still significant work to be done to make them bullet-proof.
The code is available under the MIT license.
Utilities to plumb carbonate tools together.
Depends on the master (and yet unreleased) branches of whisper, carbonate and carbon.
## The Tools
### carbonate-sync
```bash
$ carbonate-sync --help
usage: carbonate-sync [-h] [-c CONFIG_FILE] [-C CLUSTER] [-S REMOTE_CLUSTER]
[-n NODE] [-b BATCH_SIZE] [--ssh-options SSH_OPTIONS]
[--rsync-options RSYNC_OPTIONS] [--temp-dir TEMP_DIR]
[--exclude EXCLUDE] [--start-time START_TIME]
[--end-time END_TIME] [--overwrite OVERWRITE]
carbonate-sync
optional arguments:
-h, --help show this help message and exit
-c CONFIG_FILE, --config-file CONFIG_FILE
Config file to use (default:
/opt/graphite/conf/carbonate.conf)
-C CLUSTER, --cluster CLUSTER
Cluster name (default: main)
-S REMOTE_CLUSTER, --remote-cluster REMOTE_CLUSTER
Remote cluster name (default: None)
-n NODE, --node NODE Name of the local node (same as in carbonate.conf).
(default: coulomier)
-b BATCH_SIZE, --batch-size BATCH_SIZE
Batch size for fetching metrics. (default: 1000)
--ssh-options SSH_OPTIONS
Pass option(s) to ssh. Make sure to use "--ssh-
options=" if option starts with '-' (default: -o
StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null -o Compression=no)
--rsync-options RSYNC_OPTIONS
Pass option(s) to rsync. Make sure to use "--rsync-
options=" if option starts with '-' (default:
--archive --sparse --update --modify-window=100800)
--temp-dir TEMP_DIR Temporary dir (default: /tmp)
--exclude EXCLUDE Comma separated regexp of paths to exclude (slow).
(default: ^carbon\.)
--start-time START_TIME
Sync data more recent than this time. (default: 0)
--end-time END_TIME Sync data older than this time (default: now).
(default: 1465420874.04)
--overwrite OVERWRITE
Overwrite local data with remote data (default:
false). (default: False)
```
# Authors
* Brice Arnould <b.arnould@criteo.com>
* Corentin Chary <c.chary@criteo.com>
# License and warnings
These tools should be considered beta quality right now.
Tests exist for most functionality, but there is still significant work to be done to make them bullet-proof.
The code is available under the MIT license.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
carbonate-utils-0.4.0.tar.gz
(10.4 kB
view details)
File details
Details for the file carbonate-utils-0.4.0.tar.gz
.
File metadata
- Download URL: carbonate-utils-0.4.0.tar.gz
- Upload date:
- Size: 10.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a5954c445ccc247a024d9cc11e633160376091ecffafc6bcb7e16fa9ac35b0e4 |
|
MD5 | 4855a5d43f7515082dac9426cf41474a |
|
BLAKE2b-256 | 65bfe42a6477d2625af486bf1e90f3b8267b8275129eb87f1763ec6916f58346 |