Azure Data Lake Analytics (U-SQL) Azure Databricks & Microsoft Fabric Data Engineering
Distributed Apache Spark and lakehouse data engineering platforms for large-scale batch ETL, streaming data transformation, and machine learning on Azure.
Naming timeline
- Azure Data Lake Analytics (U-SQL)
On-demand U-SQL batch job service on Microsoft.DataLakeAnalytics/accounts (retired February 29, 2024).
- Azure Databricks & Microsoft Fabric Data EngineeringCurrent name
ADLA and U-SQL retired in favor of open-format Apache Spark lakehouse workloads on Azure Databricks, Azure Synapse Spark, and Microsoft Fabric.
What replaced Azure Data Lake Analytics (U-SQL)?
Azure Data Lake Analytics (U-SQL) has been superseded by Azure Databricks & Microsoft Fabric Data Engineering, with the latest change on 29 February 2024 (ADLA Retirement & Spark Migration). Distributed Apache Spark and lakehouse data engineering platforms for large-scale batch ETL, streaming data transformation, and machine learning on Azure. The underlying legacy API or CLI surface is deprecated, so a technical migration is required.
Also known as
- Azure Data Lake Analytics
- ADLA
- Azure Synapse Apache Spark
Technical identifiers
Legacy identifiers deprecated. The underlying API or CLI surface for the legacy name is officially deprecated, so this change requires a technical migration rather than a label update.
| ARM Resource Providers (Microsoft.*) | Microsoft.Databricks/workspaces Microsoft.Synapse/workspaces/bigDataPools Microsoft.Fabric/capacities Microsoft.DataLakeAnalytics/accounts (retired) |
|---|---|
| Azure CLI (az) / PowerShell | az databricks az synapse spark az dla (retired) |
| Entra ID / Azure RBAC Roles | Contributor Data Lake Analytics Developer (retired) |
| Terraform Resources (azurerm_*) | azurerm_databricks_workspace azurerm_synapse_spark_pool azurerm_data_lake_analytics_account (retired) |
Microsoft.DataLakeAnalytics/accounts (az dla, azurerm_data_lake_analytics_account) was retired on February 29, 2024 in favor of Apache Spark on Azure Databricks, Azure Synapse, and Microsoft Fabric.
Notes & disambiguation
- Launched in general availability on November 16, 2016 alongside Azure Data Lake Store, Azure Data Lake Analytics (ADLA) executed batch big data jobs using Microsoft's proprietary U-SQL language (combining declarative SQL with C#).
- On February 29, 2024, Microsoft officially retired Azure Data Lake Analytics and U-SQL, directing customers to migrate batch data processing and lakehouse workloads to Apache Spark on Azure Databricks, Azure Synapse Analytics, or Microsoft Fabric Data Engineering.
- The legacy Microsoft.DataLakeAnalytics/accounts ARM resource provider, az dla CLI, and azurerm_data_lake_analytics_account Terraform resource are retired (`deprecated: true`) in favor of Microsoft.Databricks/workspaces (azurerm_databricks_workspace), Microsoft.Synapse/workspaces, and Microsoft.Fabric/capacities.
Sources & official documentation
- Official documentation ↗
- Product page ↗
- Overview of Azure Data Lake Analytics (Retirement Notice) — Microsoft Learn
- What is Azure Databricks? — Microsoft Learn
- Microsoft.DataLakeAnalytics/accounts ARM & Bicep Reference — Microsoft Learn
- Microsoft.Databricks/workspaces ARM & Bicep Reference — Microsoft Learn
Catalog last updated . Spotted an error? Suggest an edit