blob_storage
DEPRECATED
This component is deprecated and will be removed in the next major version release. Please consider moving onto alternative components.
This component has been renamed to azure_blob_storage
.
- Common
- Advanced
# Common config fields, showing default valuesoutput:label: ""blob_storage:storage_account: ""storage_access_key: ""storage_sas_token: ""storage_connection_string: ""container: ""path: ${!count("files")}-${!timestamp_unix_nano()}.txtmax_in_flight: 1
# All config fields, showing default valuesoutput:label: ""blob_storage:storage_account: ""storage_access_key: ""storage_sas_token: ""storage_connection_string: ""public_access_level: PRIVATEcontainer: ""path: ${!count("files")}-${!timestamp_unix_nano()}.txtblob_type: BLOCKmax_in_flight: 1
Performance​
This output benefits from sending multiple messages in flight in parallel for
improved performance. You can tune the max number of in flight messages with the
field max_in_flight
.
Fields​
storage_account
​
The storage account to upload messages to. This field is ignored if storage_connection_string
is set.
Type: string
Default: ""
storage_access_key
​
The storage account access key. This field is ignored if storage_connection_string
is set.
Type: string
Default: ""
storage_sas_token
​
The storage account SAS token. This field is ignored if storage_connection_string
or storage_access_key
are set.
Type: string
Default: ""
storage_connection_string
​
A storage account connection string. This field is required if storage_account
and storage_access_key
/ storage_sas_token
are not set.
Type: string
Default: ""
public_access_level
​
The container's public access level. The default value is PRIVATE
.
Type: string
Default: "PRIVATE"
Options: PRIVATE
, BLOB
, CONTAINER
.
container
​
The container for uploading the messages to. This field supports interpolation functions.
Type: string
Default: ""
# Examplescontainer: messages-${!timestamp("2006")}
path
​
The path of each message to upload. This field supports interpolation functions.
Type: string
Default: "${!count(\"files\")}-${!timestamp_unix_nano()}.txt"
# Examplespath: ${!count("files")}-${!timestamp_unix_nano()}.jsonpath: ${!meta("kafka_key")}.jsonpath: ${!json("doc.namespace")}/${!json("doc.id")}.json
blob_type
​
Block and Append blobs are comprised of blocks, and each blob can support up to 50,000 blocks. The default value is +"
BLOCK"+
.`
This field supports interpolation functions.
Type: string
Default: "BLOCK"
Options: BLOCK
, APPEND
.
max_in_flight
​
The maximum number of messages to have in flight at a given time. Increase this to improve throughput.
Type: int
Default: 1