Skip to main content

Microsoft Azure Command-Line Tools Extended Batch Command Module

Project description

Microsoft Azure Batch CLI Extensions for Windows, Mac and Linux

This project is a preview build of the Microsoft Azure command-line interface to demonstrate proposed features in Azure Batch. For further details on the Azure CLI, please check the official documentation.

The purpose of this project is to allow customers to try out proposed Batch features and provide feedback to help shape the direction of the Batch service. The features presented here may not be compatible with other Batch client SDKs and tools, nor will they necessarily be adopted into the core Batch service.

As these features are still in preview, they will be updated regularly, and refined based on customer feedback. Unfortunately this may result in occasional breaking changes, though every effort will be made to keep this to a minimum.

Features

Input data upload to Batch linked storage accounts

A new command to allow a user to upload a set of files directly into the storage account linked to their Azure Batch account.

Input data references using linked storage accounts

Input data stored in linked storage under a file group can be simply referenced by a task by using some new ResourceFile properties.

Automatic persistence of task output files to a file group

When declaring task output files, you can now persist outputs to a named file group, without the need to generate a container SAS URL.

Download job outputs from directly from storage

A new command to allow a user to download job output files from a file group in the storage account linked to their Azure Batch account.

Pool and job templates with parameterization

Templates allow pools and jobs to be defined in parameterized json files with a format inspired by ARM templates.

Task factories for automatic task generation on job submission

Task factories provide a way for a job and all its tasks to be created in one command instead of calling azure batch task create for each task. There are currently three kinds of task factory:

  • Task Collection - tasks are explicitly defined as a part of the job

  • Parametric Sweep - a set of tasks are created by substituting a range or sequence of values into a template

  • Per File - a template task is replicated for each available input file

Split job configuration and management with reusable application templates

Application templates provide a way to partition the details of a job into two parts.

All of the details about how the job should be processed are moved into the application template, creating a reusable definition that is independent of a particular account. Application templates are parameterized to allow the processing to be customized without requiring modification of the template itself.

Easy software installation via package managers

Integration with existing 3rd party package managers to streamline the installation of applications. Currently the following package managers are supported:

  • Chocolatey - for Windows

  • APT - as used by some Linux distros including Ubuntu, Debian, and Fedora.

  • Yum - a package manager used by some Linux distros including Red Hat Enterprise Linux, Fedora, CentOS.

Samples

Samples for all of the preview features can be found in samples.

Installation

In order to make use of these features, you must have the Azure CLI installed. You can find futher instructions in the official documentation and in the Azure CLI GitHub repository.

This extension package can be installed to supplement the existing Azure CLI Batch commands. It can be installed using the CLI component tools:

$ az component update --add batch-extensions --allow-third-party

Azure Batch account requirements

In order to make use of the new features previewed here, you will need an Azure Batch account with a linked storage account. For more information on this, see Create an Azure Batch account using the Azure Portal.

Release History

1.0.0rc3 (2017-07-03)

  • Refactored extensions to separate core logic into a standalone SDK.

1.0.0rc2 (2017-04-25)

  • Support for Azure CLI 2.0.3.

1.0.0rc1 (2017-03-20)

  • Initial preview release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azure-cli-batch-extensions-1.0.0rc3.tar.gz (12.8 kB view details)

Uploaded Source

Built Distribution

azure_cli_batch_extensions-1.0.0rc3-py2.py3-none-any.whl (15.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file azure-cli-batch-extensions-1.0.0rc3.tar.gz.

File metadata

File hashes

Hashes for azure-cli-batch-extensions-1.0.0rc3.tar.gz
Algorithm Hash digest
SHA256 a9f82f6a9178c3e87698c72526251fb009ca97e51477233ec329a17f905c5c77
MD5 e372f3d245ab647c3dbd48b16226642c
BLAKE2b-256 e06b8b50c6c355b4b6d8520593a8079441ad4fda96619d0053e00459fafe52dd

See more details on using hashes here.

File details

Details for the file azure_cli_batch_extensions-1.0.0rc3-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for azure_cli_batch_extensions-1.0.0rc3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 1ac8a5bb0a14d0fd51af96e7d53cef917fda741fff467b4c61fffda26a52b88d
MD5 2743ca659872b3eb3e1b115a463196ba
BLAKE2b-256 4db9e8378257d2a0b0241547f8a51a3cd96d74c05d96f3a8308a6af483f5b6fd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page