Microsoft Azure Blob Storage Client Library for Python
Project description
Azure Storage Blobs client library for Python
Azure Blob storage is Microsoft's object storage solution for the cloud. Blob storage is optimized for storing massive amounts of unstructured data, such as text or binary data.
Blob storage is ideal for:
- Serving images or documents directly to a browser
- Storing files for distributed access
- Streaming video and audio
- Storing data for backup and restore, disaster recovery, and archiving
- Storing data for analysis by an on-premises or Azure-hosted service
Source code | Package (PyPi) | API reference documentation | Product documentation | Samples
Getting started
Install the package
Install the Azure Storage Blobs client library for Python with pip:
pip install azure-storage-blob --pre
Prerequisites: You must have an Azure subscription, and a Storage Account to use this package.
To create a Storage Account, you can use the Azure Portal, Azure PowerShell or Azure CLI:
az storage account create -n MyStorageAccountName -g MyResourceGroupName
Requires Python 2.7, 3.5 or later to use this package.
Authenticate the client
Interaction with Storage Blobs starts with an instance of the BlobServiceClient class. You need an existing storage account, its URL, and a credential to instantiate the client object.
Get credentials
To authenticate the client you have a few options:
- Use a SAS token string
- Use an account shared access key
- Use a token credential from azure.identity
Alternatively, you can authenticate with a storage connection string using the from_connection_string
method. See example: Client creation with a connection string.
You can omit the credential if your account URL already has a SAS token.
Create client
Once you have your account URL and credentials ready, you can create the BlobServiceClient:
from azure.storage.blob import BlobServiceClient
service = BlobServiceClient(account_url="https://<my-storage-account-name>.blob.core.windows.net/", credential=credential)
Key concepts
Blob storage offers three types of resources:
- The storage account
- A container in the storage account
- A blob in a container
Clients
The Storage Blobs SDK provides four different clients to interact with the Blob Service:
- BlobServiceClient - this client interacts with the Blob Service at the account level.
It provides operations to retrieve and configure the account properties
as well as list, create, and delete containers within the account.
For operations relating to a specific container or blob, clients for those entities
can also be retrieved using the
get_blob_client
orget_container_client
functions. - ContainerClient - this client represents interaction with a specific
container, although that container need not exist yet. It provides operations to create, delete, or
configure containers and includes operations to list, upload, and delete blobs in the container.
For operations relating to a specific blob, the client can also be retrieved using
the
get_blob_client
function. - BlobClient - this client represents interaction with a specific blob, although that blob need not exist yet. It provides blob operations to upload, download, delete, create snapshots, and list blobs, as well as specific operations per blob type.
- LeaseClient - this client represents lease interactions with a ContainerClient or BlobClient. It provides operations to acquire, renew, release, change, and break leases on the resources.
Blob Types
Once you've initialized a Client, you can choose from the different types of blobs:
- Block blobs store text and binary data, up to about 4.7 TB. Block blobs are made up of blocks of data that can be managed individually
- Append blobs are made up of blocks like block blobs, but are optimized for append operations. Append blobs are ideal for scenarios such as logging data from virtual machines
- Page blobs store random access files up to 8 TB in size. Page blobs store virtual hard drive (VHD) files and serve as disks for Azure virtual machines
For more information about the different types of blobs, see Understanding Block Blobs, Append Blobs, and Page Blobs
Examples
The following sections provide several code snippets covering some of the most common Storage Blob tasks, including:
Client creation with a connection string
Create the BlobServiceClient using the connection string to your Azure Storage account.
from azure.storage.blob import BlobServiceClient
service = BlobServiceClient.from_connection_string(conn_str="my_connection_string")
Uploading a blob
Upload a blob to your container.
from azure.storage.blob import BlobClient
blob = BlobClient.from_connection_string("my_connection_string", container="mycontainer", blob="my_blob")
with open("./SampleSource.txt", "rb") as data:
blob.upload_blob(data)
Use the async client to upload a blob to your container.
from azure.storage.blob.aio import BlobClient
blob = BlobClient.from_connection_string("my_connection_string", container="mycontainer", blob="my_blob")
with open("./SampleSource.txt", "rb") as data:
await blob.upload_blob(data)
Downloading a blob
Download a blob from your container.
from azure.storage.blob import BlobClient
blob = BlobClient.from_connection_string("my_connection_string", container="mycontainer", blob="my_blob")
with open("./BlockDestination.txt", "wb") as my_blob:
blob_data = blob.download_blob()
my_blob.writelines(blob_data.content_as_bytes())
Download a blob asynchronously.
from azure.storage.blob.aio import BlobClient
blob = BlobClient.from_connection_string("my_connection_string", container="mycontainer", blob="my_blob")
with open("./BlockDestination.txt", "wb") as my_blob:
stream = await blob.download_blob()
data = await stream.content_as_bytes()
my_blob.write(data)
Enumerating blobs
List the blobs in your container.
from azure.storage.blob import ContainerClient
container = ContainerClient.from_connection_string("my_connection_string", container="mycontainer")
blob_list = container.list_blobs()
for blob in blob_list:
print(blob.name + '\n')
List the blobs asynchronously.
from azure.storage.blob.aio import ContainerClient
container = ContainerClient.from_connection_string("my_connection_string", container="mycontainer")
blob_list = []
async for blob in container.list_blobs():
blob_list.append(blob)
print(blob_list)
Troubleshooting
Storage Blob clients raise exceptions defined in Azure Core.
All Blob service operations will throw a StorageErrorException on failure with helpful error codes.
Next steps
More sample code
Get started with our Blob samples.
Several Storage Blobs Python SDK samples are available to you in the SDK's GitHub repository. These samples provide example code for additional scenarios commonly encountered while working with Storage Blobs:
-
test_blob_samples_hello_world.py
(async version) - Examples for common Storage Blob tasks:- Set up a container
- Create a block, page, or append blob
- Upload blobs
- Download blobs
- Delete blobs
-
test_blob_samples_authentication.py
(async version) - Examples for authenticating and creating the client:- From a connection string
- From a shared access key
- From a shared access signature token
- From active directory
-
test_blob_samples_service.py
(async version) - Examples for interacting with the blob service:- Get account information
- Get and set service properties
- Get service statistics
- Create, list, and delete containers
- Get the Blob or Container client
-
test_blob_samples_containers.py
(async version) - Examples for interacting with containers:- Create a container and delete containers
- Set metadata on containers
- Get container properties
- Acquire a lease on container
- Set an access policy on a container
- Upload, list, delete blobs in container
- Get the blob client to interact with a specific blob
-
test_blob_samples_common.py
(async version) - Examples common to all types of blobs:- Create a snapshot
- Delete a blob snapshot
- Soft delete a blob
- Undelete a blob
- Acquire a lease on a blob
- Copy a blob from a URL
Additional documentation
For more extensive documentation on the Azure Storage Blobs, see the Azure Storage Blobs documentation on docs.microsoft.com.
Contributing
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file azure-storage-blob-12.0.0b3.zip
.
File metadata
- Download URL: azure-storage-blob-12.0.0b3.zip
- Upload date:
- Size: 276.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.35.0 CPython/3.6.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d5ca474d47ced7712995e51ce57e12351decb577820554d4a9df5c87351f42c4 |
|
MD5 | a35cedee281dd32c1c452e2516844fe3 |
|
BLAKE2b-256 | 723e5c301a0c118b9623fb3281bf126f3db6baa1fbb8ba9d05ac5b20de44e70d |
File details
Details for the file azure_storage_blob-12.0.0b3-py2.py3-none-any.whl
.
File metadata
- Download URL: azure_storage_blob-12.0.0b3-py2.py3-none-any.whl
- Upload date:
- Size: 259.4 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.14.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.35.0 CPython/3.6.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5b4bf3300b34ed4508340f6376ebf6674148a31de4036c29ffb95e8c63972cd3 |
|
MD5 | 6c754f8c5089c278ad700061ee54a9eb |
|
BLAKE2b-256 | 9eff6b4765c781b81f72995442b0c431038ff278aee3e186cbc4497a8f6a639b |