Pubtools-quay
Project description
Set of scripts used for operating with Quay service
Requirements
Python 2.6+
Python 3.5+
Skopeo is required for the tagging operation
Features
pubtools-quay-tag-image - Copy a quay image from source to destination(s)
pubtools-quay-merge-manifest-list - Merge manifest lists of new and old images. The architectures of new (source) image overwrite destination’s archs. Archs missing from the source image will still remain in the merged manifest list. Destination image’s manifest list is overwritten by the merged manifest list.
pubtools-quay-untag - Remove tags from quay repositories. Tags to remove are specified by image references. In addition to Docker credentials, Quay API OAuth token has to be specified. Script will not perform the untagging operation if some image in a repo will lose its last tag. In this scenario, untagging can be forced by using the –remove-last argument.
Setup
$ pip install -r requirements.txt $ pip install . or $ python setup.py install
Usage
Locally copy an image from source to destination. Quay password is injected from the environment variable.
$ export QUAY_PASSWORD=token $ pubtools-quay-tag-image \ --source-ref quay.io/source/image:34 \ --dest-ref quay.io/target/image:34 \ --quay-user quay+username \
Connect to a remote host via ssh (using password) and perform the copying to multiple destinations.
$ export QUAY_PASSWORD=token $ export SSH_PASSWORD=123456 $ pubtools-quay-tag-image \ --source-ref quay.io/source/image:34 \ --dest-ref quay.io/target/image:34 \ --dest-ref quay.io/target/image2:34 \ --quay-user quay+username \ --remote-exec \ --ssh-remote-host 127.0.0.1 \ --ssh-remote-host-port 2222 \ --ssh-username user
Connect to a remote host via ssh (using private key), perform the copying, and send a UMB message.
$ export QUAY_PASSWORD=token $ export SSH_PASSWORD=123456 $ pubtools-quay-tag-image \ --source-ref quay.io/source/image:34 \ --dest-ref quay.io/target/image:34 \ --quay-user quay+username \ --remote-exec \ --ssh-remote-host 127.0.0.1 \ --ssh-remote-host-port 2222 \ --ssh-username user \ --ssh-key-filename /path/to/file.key \ --send-umb-msg \ --umb-url amqps://url:5671 \ --umb-url amqps://url2:5671 \ --umb-cert /path/to/file.crt \ --umb-topic VirtualTopic.eng.pub.some_topic
Merge manifest lists of source-ref and dest-ref and overwrite dest-ref with the result.
$ export QUAY_PASSWORD=token $ pubtools-quay-merge-manifest-list \ --source-ref quay.io/src/image:1 \ --dest-ref quay.io/dest/image:1 \ --quay-user quay+username
Untag multiple images and send a UMB message.
$ export QUAY_PASSWORD=token $ export QUAY_API_TOKEN=oauth_token $ pubtools-quay-tag-image \ --reference quay.io/src/image:1 \ --reference quay.io/src/image:2 \ --quay-user quay+username \ --remote-exec \ --ssh-remote-host 127.0.0.1 \ --ssh-remote-host-port 2222 \ --ssh-username user \ --ssh-key-filename /path/to/file.key \ --send-umb-msg \ --umb-url amqps://url:5671 \ --umb-url amqps://url2:5671 \ --umb-cert /path/to/file.crt \ --umb-topic VirtualTopic.eng.pub.some_topic
Untag an image and force the operation in case the tag is a last reference of some digest.
$ export QUAY_PASSWORD=token $ export QUAY_API_TOKEN=oauth_token $ pubtools-quay-tag-image \ --reference quay.io/src/image:1 \ --remove-last \ --quay-user quay+username \
ChangeLog
0.9.1 (2022-02-02)
Fixed creating manifests for v2ch2 single arch containers
0.9.0 (2022-28-1)
Support v2ch2 single arch containers
Support v2ch1 containers
Run rollback only when all index image builds fail
Add retries to image tagging as a part of pushes
Skip checking for repo deprecation based on value in target settings
Support extra source host for quay operations
Sign V2S1 manifests
Tag index image timestamps with permanent index image as a source
0.8.3 (2021-10-6)
Fix the usage of overwrite from index
0.8.2 (2021-10-6)
Make deprecation list functionality optional
0.8.1 (2021-10-5)
Disable sending UMB messages for taggign and untagging images
0.8.0 (2021-9-7)
Use SSL certificates for Pyxis authentication
Remove duplicate digests when getting signatures from Pyxis
Remove return of push_docker entrypoint
0.7.2 (2021-8-23)
Don’t raise 404 errors when deleting tags during rollback
0.7.1 (2021-8-20)
Fix installation of ‘docker’ dependency on Python 2.6
0.7.0 (2021-8-18)
Add hooks to declare events of interest
Create documentation
Add option to execute commands inside a container
Add pagination support for getting all tags via Docker HTTP API
Capture IIB operation exception
Get index image manifests with its own token
Lower python-qpid-proton version
0.6.0 (2021-7-14)
Create entrypoint for removing a Quay repo
Create entrypoint for clearing a Quay repo
Add signature removal to tag-docker operations
Drop unnecessary ‘external_repos’
Add using extra Quay tokens for OSBS organizations
Allow specifying multiple repos in remove-repo and clear-repo tasks
Skip signing when no operator claim messages are constructed
Add support for delimeter-less repositories
Change “repo” parameter of claim messages to have external representation
Fix loggers per pubtools conventions
Check username in output of skopeo –get-login
Remove the usage of Quay API reading repo data
Add signature removal for IIB operations
Update sigstore to be up-to-date with current implementation
Allow pushing to non-existent repo
0.5.0 (2021-6-2)
Fix intermediate index image
Implement tag docker
Add skip to signing if signing key is None
Fix pub XMLRPC call
Implement entrypoints for IIB methods
0.4.0 (2021-5-4)
Implement push-docker prototype
Change signing order to happen before pushing
Use intermediate index image for signing
0.3.0 (2021-2-11)
Fix the versioning constraint of pyrsistent dependency
0.2.0 (2021-2-9)
Fix the definition of requirements.txt, allowing installation on Python 2.6
0.1.0 (2021-2-9)
Initial release.
Added tag image entrypoint
Added merge manifest list entrypoint
Added push docker code skeleton
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file pubtools-quay-0.9.1.tar.gz.
File metadata
- Download URL: pubtools-quay-0.9.1.tar.gz
- Upload date:
- Size: 82.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | af20c1519569d4e2f4656beafd88a43edb16a55fa68de6ff836f4fd4bab6ef21 |
|
| MD5 | ce014fda92fe6bc0905ba5b37a381c1f |
|
| BLAKE2b-256 | d406a311c6c77d4884ad8b354749bc82b2bed140307d64aca5d4a29d739a9b7b |
File details
Details for the file pubtools_quay-0.9.1-py2.py3-none-any.whl.
File metadata
- Download URL: pubtools_quay-0.9.1-py2.py3-none-any.whl
- Upload date:
- Size: 87.7 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a2851dee482dc04793c198428ddd31a891e82950de110e5fc974a471351febd7 |
|
| MD5 | 47f6205d97d95876ce9ade17a6a0866c |
|
| BLAKE2b-256 | 021efd09d789483ec2cc9bbc22030304188ba9ff34c9b86f4dc9178520a37f0c |
