What is Azure Data Lake Storage?
Azure Data Lake Storage Gen2 is Microsoft’s storage solution for big data analytics. It is a capability set built on top of Azure Blob Storage: enabling the hierarchical namespace gives a storage account a true directory structure with POSIX-compatible access rights, while remaining fully compatible with the Blob Storage APIs. Its predecessor, Azure Data Lake Storage Gen1, was fully retired on February 29, 2024; Gen2 is now the only current variant.
Core Features
- Hierarchical namespace for efficient, atomic directory operations
- Petabyte-scale storage with high throughput for parallel analytics workloads
- Four access tiers: Hot, Cool, Cold, and Archive for different access patterns
- POSIX-compatible ACLs for fine-grained permissions at file and folder level
- Native integration with Databricks, Azure Synapse Analytics, Microsoft Fabric, and HDInsight
Typical Use Cases
- Central data lake for analytics and machine learning platforms
- Long-term archiving of enterprise data with automated tiering
- Staging area for ETL and data engineering pipelines (e.g., with Azure Data Factory or Databricks)
- Foundation for lakehouse architectures where raw and curated data are managed together
Benefits
- Significantly faster directory operations than a flat blob namespace, especially with very large numbers of files
- Cost-effective through manual or automated tiering between Hot, Cool, Cold, and Archive
- Full compatibility with Blob Storage APIs and the broader Azure analytics ecosystem
- Enterprise security via Microsoft Entra ID, ACLs, encryption, and private endpoints
Integration with innFactory
As a Microsoft Solutions Partner, innFactory supports you with Azure Data Lake Storage: data lake architecture, migration from on-premises or Gen1, access control, and cost optimization across access tiers.
Typical Use Cases
Frequently Asked Questions
What is Azure Data Lake Storage Gen2?
Azure Data Lake Storage Gen2 is not a separate storage SKU but a hierarchical namespace capability you enable on an Azure storage account. It combines the scalability and cost efficiency of Blob Storage with a filesystem-like folder structure for big data analytics.
What happened to Azure Data Lake Storage Gen1?
Gen1 was fully retired on February 29, 2024, and is no longer reachable. Existing Gen1 workloads had to be migrated to Gen2 beforehand. For new projects, only Gen2 (hierarchical namespace on Blob Storage) is an option.
What access tiers are available?
Hot for frequent access with no minimum storage duration, Cool for less frequent access (30-day minimum), Cold for very infrequent but still online access (90-day minimum), and Archive for long-term archiving (180-day minimum, requiring rehydration before access). Storage costs decrease while access costs and retrieval times increase from Hot to Archive.
How does the hierarchical namespace work?
The hierarchical namespace organizes objects in a true directory structure with atomic operations at the directory level. Renaming or deleting a folder containing very many files is therefore significantly faster than with a flat blob namespace without a hierarchical namespace.
What security features are available?
Integration with Microsoft Entra ID (formerly Azure AD) for authentication, POSIX-compatible ACLs at file and folder level, encryption at rest, private endpoints, and firewall rules to restrict network access.
Note: All product information on this page has been compiled with care, but is provided without guarantee and may be outdated or incomplete. Cloud services evolve rapidly — features, pricing, SLAs, and availability change frequently. Authoritative and up-to-date information can only be found on the official product page of Azure (official documentation). This page does not represent an offer by Azure.
