Skip to main content

A minimalistic Google Storage client

Project description

gs is a command line interface (CLI) and Python library that provides a set of essential commands for Google Cloud Storage. It is modeled after the AWS CLI’s aws s3 command. Its features are:

  • Python 3 compatibility

  • A minimalistic set of dependencies

  • A tiny footprint

  • Intuitive convention-driven configuration of API credentials without browser login prompts

  • Checksum validation to ensure end-to-end data integrity in uploads and downloads

  • Progress bars for long-running upload and download operations

  • Resumable downloads

  • An attractive paging and table layout interface

  • A JSON object metadata output mode for feeding data to other utilities

Installation

pip install gs

Synopsis

Usage:

gs [OPTIONS] COMMAND [ARGS]...

Options:
--version

Show the version and exit.

--help

Show this message and exit.

Commands:

gs configure

Set gs config options, including the API key.

gs cp

Copy files to, from, or between buckets.

gs ls

List buckets or objects in a bucket/prefix.

gs mb

Create a new Google Storage bucket.

gs mv

Move files to, from, or between buckets.

gs presign

Get a pre-signed URL for accessing an object.

gs rb

Permanently delete an empty bucket.

gs rm

Delete objects (files) from buckets.

gs sync

Sync a directory of files with bucket/prefix.

Run gs configure to configure Google service account access credentials that will be used by the gs command. You can create a new service account key at https://console.cloud.google.com/iam-admin/serviceaccounts.

Credentials

Before making API calls, gs ingests API credentials in the following order of priority:

  • First, gs checks if a GOOGLE_APPLICATION_CREDENTIALS environment variable is set. If so, it attempts to load and use credentials from the service account credentials filename referenced by the variable.

  • If that varible is not set, gs attempts to load service account credentials previously configured with gs configure (stored in ~/.config/gs/config.json).

  • If that fails, gs attempts to load a service account API token from Google instance metadata.

  • If that fails, gs gives up and prints an error.

Using the Python library interface

from gs import GSClient
client = GSClient()
object_meta = client.get("b/my-bucket/o/my-object")
with client.get("b/my-bucket/o/my-object", params=dict(alt="media"), stream=True) as res:
    object_bytes = res.raw.read()
presigned_url = client.get_presigned_url("my-bucket", "my-object", expires_at=time.time()+3600)
https://travis-ci.org/kislyuk/gs.png https://img.shields.io/pypi/v/gs.svg https://img.shields.io/pypi/l/gs.svg https://codecov.io/gh/kislyuk/gs/branch/master/graph/badge.svg

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gs-0.2.3.tar.gz (19.0 kB view details)

Uploaded Source

Built Distribution

gs-0.2.3-py2.py3-none-any.whl (22.0 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file gs-0.2.3.tar.gz.

File metadata

  • Download URL: gs-0.2.3.tar.gz
  • Upload date:
  • Size: 19.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: Python-urllib/2.7

File hashes

Hashes for gs-0.2.3.tar.gz
Algorithm Hash digest
SHA256 5d5c9b68afb3c61e40b2597ca4a9c65b256b8354d7c9118684944ba4bf8ca917
MD5 0efe515657250c46cfc186c49f860910
BLAKE2b-256 a97f6831a79ff9a6379cd9a560ed66ca3d0b2f3aa973b17a23ca4b20cde7a600

See more details on using hashes here.

File details

Details for the file gs-0.2.3-py2.py3-none-any.whl.

File metadata

  • Download URL: gs-0.2.3-py2.py3-none-any.whl
  • Upload date:
  • Size: 22.0 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: Python-urllib/2.7

File hashes

Hashes for gs-0.2.3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 8a7424e6bf54f70ccc075c5801378d7287e41560c7e2b5d1a355c7b7099b674b
MD5 bc9a1192dc13c86168c3aca2a2735a44
BLAKE2b-256 796a65297e7ea910381fadea4d8c8cf91add24426f69ec29caa3f2c2691fdfca

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page