Skip to main content

big_data_pools

Creates, updates, deletes, gets or lists a big_data_pools resource.

Overview

Namebig_data_pools
TypeResource
Idazure.synapse_artifacts.big_data_pools

Fields

The following fields are returned by SELECT queries:

NameDatatypeDescription
idstringFully qualified resource ID for the resource. Ex - /subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/{resourceProviderNamespace}/{resourceType}/{resourceName}. # pylint: disable=line-too-long
namestringThe name of the resource.
autoPauseobjectAuto-pausing properties.
autoScaleobjectAuto-scaling properties.
cacheSizeintegerThe cache size.
creationDatestring (date-time)The time when the Big Data pool was created.
customLibrariesarrayList of custom libraries/packages associated with the spark pool.
defaultSparkLogFolderstringThe default folder where Spark logs will be written.
dynamicExecutorAllocationobjectDynamic Executor Allocation.
isComputeIsolationEnabledbooleanWhether compute isolation is required or not.
lastSucceededTimestampstring (date-time)The time when the Big Data pool was updated successfully.
libraryRequirementsobjectLibrary version requirements.
locationstringThe geo-location where the resource lives. Required.
nodeCountintegerThe number of nodes in the Big Data pool.
nodeSizestringThe level of compute power that each node in the Big Data pool has. Known values are: "None", "Small", "Medium", "Large", "XLarge", "XXLarge", and "XXXLarge".
nodeSizeFamilystringThe kind of nodes that the Big Data pool provides. Known values are: "None" and "MemoryOptimized".
provisioningStatestringThe state of the Big Data pool.
sessionLevelPackagesEnabledbooleanWhether session level packages enabled.
sparkConfigPropertiesobjectSpark configuration file to specify additional properties.
sparkEventsFolderstringThe Spark events folder.
sparkVersionstringThe Apache Spark version.
tagsobjectResource tags.
typestringThe type of the resource. E.g. "Microsoft.Compute/virtualMachines" or "Microsoft.Storage/storageAccounts".

Methods

The following methods are available for this resource:

NameAccessible byRequired ParamsOptional ParamsDescription
getselectbig_data_pool_name, endpointGet Big Data Pool.
listselectendpointList Big Data Pools.

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

NameDatatypeDescription
big_data_pool_namestringThe Big Data Pool name. Required.
endpointstringThe service endpoint host (no scheme). (default: )

SELECT examples

Get Big Data Pool.

SELECT
id,
name,
autoPause,
autoScale,
cacheSize,
creationDate,
customLibraries,
defaultSparkLogFolder,
dynamicExecutorAllocation,
isComputeIsolationEnabled,
lastSucceededTimestamp,
libraryRequirements,
location,
nodeCount,
nodeSize,
nodeSizeFamily,
provisioningState,
sessionLevelPackagesEnabled,
sparkConfigProperties,
sparkEventsFolder,
sparkVersion,
tags,
type
FROM azure.synapse_artifacts.big_data_pools
WHERE big_data_pool_name = '{{ big_data_pool_name }}' -- required
AND endpoint = '{{ endpoint }}' -- required
;