Skip to content

Latest commit

 

History

History
181 lines (138 loc) · 7.52 KB

README.md

File metadata and controls

181 lines (138 loc) · 7.52 KB

Azure Storage Blobs Batching client library for .NET

Server Version: 2019-02-02

Azure Blob storage is Microsoft's object storage solution for the cloud. Blob storage is optimized for storing massive amounts of unstructured data. This library allows you to batch multiple Azure Blob Storage operations in a single request.

Source code | Package (NuGet) | API reference documentation | REST API documentation | Product documentation

Getting started

Install the package

Install the Azure Storage Blobs Batching client library for .NET with NuGet:

dotnet add package Azure.Storage.Blobs.Batching --version 12.0.0-preview.4

Prerequisites

You need an Azure subscription and a Storage Account to use this package.

To create a new Storage Account, you can use the Azure Portal, Azure PowerShell, or the Azure CLI. Here's an example using the Azure CLI:

az storage account create --name MyStorageAccount --resource-group MyResourceGroup --location westus --sku Standard_LRS

Key concepts

Batching supports two types of subrequests: SetBlobAccessTier for block blobs and DeleteBlob for blobs.

  • Only supports up to 256 subrequests in a single batch. The size of the body for a batch request cannot exceed 4MB.
  • There are no guarantees on the order of execution of the batch subrequests.
  • Batch subrequest execution is not atomic. Each subrequest is executed independently.
  • Each subrequest must be for a resource within the same storage account.

Examples

Deleting blobs

using Azure.Storage;
using Azure.Storage.Blobs;
using Azure.Storage.Blobs.Specialized;
using Azure.Storage.Blobs.Models;

// Get a connection string to our Azure Storage account.  You can
// obtain your connection string from the Azure Portal (click
// Access Keys under Settings in the Portal Storage account blade)
// or using the Azure CLI with:
//
//     az storage account show-connection-string --name <account_name> --resource-group <resource_group>
//
// And you can provide the connection string to your application
// using an environment variable.
string connectionString = "<connection_string>";
BlobServiceClient serviceClient = new BlobServiceClient(connectionString);

// Get URIs for a couple of existing blobs
Uri a = serviceClient.GetBlobContainerClient("letters").GetBlobClient("a").Uri;
Uri b = serviceClient.GetBlobContainerClient("letters").GetBlobClient("b").Uri;
Uri c = serviceClient.GetBlobContainerClient("letters").GetBlobClient("c").Uri;

// Create a batch client
BlobBatchClient batchClient = serviceClient.GetBlobBatchClient();

// Delete several blobs in one batched request
batchClient.DeleteBlobs(new Uri[] { a, b, c });

Setting Access Tiers

string connectionString = "<connection_string>";
BlobServiceClient serviceClient = new BlobServiceClient(connectionString);

// Get URIs for a couple of existing blobs
Uri a = serviceClient.GetBlobContainerClient("letters").GetBlobClient("a").Uri;
Uri b = serviceClient.GetBlobContainerClient("letters").GetBlobClient("b").Uri;
Uri c = serviceClient.GetBlobContainerClient("letters").GetBlobClient("c").Uri;

// Create a batch client
BlobBatchClient batchClient = serviceClient.GetBlobBatchClient();

// Set the access tier for several blobs in one batched request
batchClient.SetBlobsAccessTier(new Uri[] { a, b, c }, AccessTier.Hot);

Fine-grained control

string connectionString = "<connection_string>";
BlobServiceClient serviceClient = new BlobServiceClient(connectionString);

// Create a batch client
BlobBatchClient batchClient = serviceClient.GetBlobBatchClient();

// Create a batch
BlobBatch batch = batchClient.GetBlobBatchClient();

// Add a few deletions to the batch
batch.DeleteBlob("letters", "a");
batch.DeleteBlob("letters", "b", DeleteSnapshotsOption.Include);

// Submit the batch
batchClient.SubmitBatch(batch);

Troubleshooting

All Blob service operations will throw a RequestFailedException on failure with helpful ErrorCodes. Many of these errors are recoverable. Subrequest failures will be bundled together into an AggregateException.

string connectionString = "<connection_string>";
BlobServiceClient serviceClient = new BlobServiceClient(connectionString);

// Get URIs for a blob that exists and a blob that doesn't exist
Uri valid = serviceClient.GetBlobContainerClient("valid").GetBlobClient("a").Uri;
Uri invalid = serviceClient.GetBlobContainerClient("invalid").GetBlobClient("b").Uri;

// Create a batch client
BlobBatchClient batchClient = serviceClient.GetBlobBatchClient();
try
{
    // Delete several blobs in a single request
    batchClient.DeleteBlobs(new Uri[] { valid, invalid });
}
catch (AggregateException ex)
{
    // Check ex.InnerExceptions for RequestFailedException instances
}

Next steps

Check out our sync and async samples for more.

Contributing

See the Storage CONTRIBUTING.md for details on building, testing, and contributing to this library.

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit cla.microsoft.com.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Impressions