Error details Error details ResourceInUnupdatableState Target Spark pool specified in Spark job definition is not in succeeded state. Current state: Provisioning

Hi @Johnny Lam It looks like your CI/CD deployment is trying to push artifacts (like a notebook or pipeline) that reference a Spark pool before that pool has finished provisioning. When ARM or your CI/CD engine sees the pool’s provisioningState still at “Provisioning,” any subresources that target it can’t be updated or created, hence the ResourceInUnupdatableState error.

Here’s what you can do:

1. Wait for the pool to finish provisioning before deploying downstream artifacts
   • If you’re using Azure CLI in your pipeline, add a step after creating/updating the Spark pool:

     
      az synapse spark pool wait \
     
      --workspace-name <yourWorkspace> \
     
      --name <yourSparkPool> \
     
      --updated
     
     

     This command will block until the pool’s provisioningState transitions to “Succeeded.”
2. Leverage dependsOn in your ARM templates
   • Make sure your job definition or notebook resource in the ARM template has a dependsOn entry pointing to the Spark pool resource. That way, ARM knows to fully finish creating the pool before trying to deploy anything that references it.
3. Check for provisioning delays or failures
   • If the pool stays stuck in “Provisioning” for a long time, verify that you’re not hitting subscription or regional quotas, and check Azure Service Health for any ongoing issues.
   • Sometimes custom libraries can slow or block pool creation. If you recently added packages, try removing them to see if the pool can finish provisioning.

After adding the wait or proper dependency, your artifacts should deploy cleanly once the pool is in a “Succeeded” state. Hope that helps!

References:

https://learn.microsoft.com/azure/synapse-analytics/cicd/continuous-integration-delivery?wt.mc_id=knowledgesearch_inproduct_azure-cxp-community-insider#troubleshoot-artifacts-deployment

https://learn.microsoft.com/cli/azure/synapse/spark/pool?view=azure-cli-latest#az_synapse_spark_pool_wait