Blog
How to Realize Your File Requirements in Azure - Part 1
An overview into how to solve challenges that moving to the cloud presents for file services, enterprise database applications, high-performance computing and analytics.
As companies make the decision to transform IT operations by moving more of their applications1 to the cloud, they are often confronted with barriers. Some are simple annoyances that we hate but learn to cope with, while others are far more critical to getting your applications into the cloud.
One of these core struggles revolves around a seemingly simple topic – File Services. Though file services were once thought to not be a requirement in the cloud, enterprises quickly started to encounter this problem, from simple shared directories of data to more complex issues with enterprise applications, and even high-performance computing environments.
In this Article, we open with an overview of a new file service offering in Azure, and then examine in-depth the challenges IT departments face when addressing cloud mandates across:
- file services-based applications,
- enterprise database environments,
- high-performance computing workloads, and data analytics
We highlight considerations for choosing Azure NetApp Files as the solution for data infrastructure challenges with these application environments and point you in the right direction to get started.
An Introduction to Azure NetApp Files
Azure NetApp Files is a Microsoft Azure service that offers a fully managed, highly available solution for provisioning file services in Azure. NetApp was selected by Microsoft to build this solution because of our industry-leading reputation and years of experience in building data management systems for the cloud, providing data protection, scalability, and advanced storage management. The service is used like any other cloud storage service, allowing seamless administration with all your cloud infrastructure. Azure NetApp Files is sometimes described as a first-party service, which simply means that while Azure NetApp Files is built on NetApp Technology, it is sold and supported by Microsoft.
The service brings support for both Linux and Windows files, with three service levels, such that customers can choose the protocol and performance that best match their application requirements. Unlike any other cloud storage, Azure NetApp Files reduces customers’ risk by offering on-demand, in-place service level changes, so the service level can be changed in seconds without requiring a time-consuming data copy.
“Unlike any other cloud storage, Azure NetApp Files reduces customers’ risk by offering on-demand, in-place service level changes...”
ADDITIONAL AZURE NETAPP FILES CAPABILITIES
Benefits:
- Built on highly available NetApp technology that ensures your data is available when applications need it most
- Simple Azure-native service interface on the Azure Portal means there is nothing to purchase – you consume Azure NetApp files as part of your Azure agreement with Microsoft
- Linux NFS v3, v4.1 and Windows SMB support
- Maximums
- Volume size 100TB
- File Size 16TB
- Secure, always-on encryption-at-rest
- Built on Azure service infrastructure with full Azure CLI support
File Services – Challenges in the Cloud
When it comes to shared storage in the cloud, enterprises – even those operating exclusively in the cloud – are struggling to deploy mission-critical workloads to Azure.
In addition to the obvious challenge of running a major workload in the cloud, there is a need to spin-up file-based storage – whether in small amounts or for large-scale, high-performance file applications – while still providing availability guarantees and data management functions to ensure robust data across multiple data formats and operating systems.
According to research from IDC, Linux owns 68% of the OS market share globally[i], and it’s no surprise that Linux is dominating in Azure. Enterprises love to build applications on Linux. The system is robust, flexible, proven, and, as a “free” open source technology, does not require permissions or command licensing fees.
Files systems in the cloud must provide the following:
Agile Data Performance. With a wide variation in performance for file applications, from simple shared files to files in critical database environments, it is important to have file services that support multiple SLAs but can scale to high-performance access and throughput for peak operability.
Data Compatibility. An enterprise’s file services need to be compatible with all their host data formats and operating systems. Linux environments are the de facto standard when it comes to enterprise applications, but often access comes from both Linux and Windows clients. Having a robust, multi-protocol file service solution is a requirement to moving any of these applications to Azure.
High Data Availability. When it comes to running an enterprise file service, any disruption in normal operation can negatively impact the business. Whether an outage is caused by a disaster or through an update process, it is essential to ensure the availability of the file share, with zero downtime and no data loss.
Robust and Protected Data. File shares require companies to comply with industry-specific data security and data protection regulations, and because file shares are often the most important part of a business’s operation, the ability to automatically create copies is mandatory to meet the stringent RPO, RTO, and backup requirements for most industries.
Data Security. When moving outside the data center, security becomes a major concern for data anywhere it resides, whether in flight or at rest. It’s imperative that the file system is in the user’s control at all times. Ensuring data security at all levels is crucial to preventing losses before they happen. Role-based access and encrypted data can keep data more secure.
File Services with Azure NetApp Files
On top of the performance, with Azure NetApp Files, users no longer have to worry about storage management. The service takes care of all the setup, configuration, updates, performance, and service levels. The service is built on the NetApp technology that has served enterprise customers for more than 25 years – faster and better than ever.
NetApp Snapshot Technology
For data protection, no solution supports a file service more efficiently than NetApp Snapshot technology. Snapshot copies give Azure NetApp Files the ability to provide companies with point-in-time backups that can be created instantly and do not add to their data footprint in Azure, which can save both time and money while ensuring that important data protection goals are maintained. You also get powerful, high-speed data copies based on any one of these Snapshot copies that can be used for a number of purposes, such as building test environments and restoring systems in the event of accidental or malicious data loss events.
Fully managed service. Data management is handled completely by Microsoft, not the customer.
Scalability and performance. Spin up to 100TB at times of extreme high-performance storage needs in just seconds.
Compatibility. Support for SMB, NFSv3, and NFSv4.1 file shares, giving shared file access across Linux, UNIX, and Windows operating systems for greater host-client data operability.
Integration. Complete integration with file directory metadata, keeping domain credentials, access and authentication, and group memberships, including full compatibility with Microsoft Active Directory.
Data protection. Data corruption or loss can be prevented with efficient, automatic data Snapshot copies.
Automation. Schedule tasks directly via the Azure CLI to meet file-share demands with automation and orchestration capabilities.
“For data protection, no solution supports a file service more efficiently than NetApp Snapshot technology.”
Conclusion and Next Steps
Database systems are complex enterprise applications that depend heavily on the I/O systems they use. For the best results, storage services must combine performance, data protection, scalability, security, and flexibility into a single solution.
High-performance, scalable and highly available shared file storage is crucial to delivering a data analytics platform. The ability to effectively manage data from multiple source systems can be another major obstacle. Azure NetApp Files provides cloud-based file service solutions that address the major challenges in creating a repository for data analytics workloads, and can be used with custom-built Apache Hadoop clusters or public cloud analytics services.
Azure NetApp Files has been purpose built to deliver the highest levels of I/O performance and scalability. End users simply input the size of storage volume they need, choose the appropriate service level for their performance requirements, and NetApp takes care of the rest. This removes the significant burden on organizations to manage in-house NAS solutions.
The synchronization capabilities of Azure NetApp Files allow data from multiple systems to be consolidated into a single storage volume. Data can also be synchronized out of Azure NetApp Files to provide integration with other external systems. Volume cloning adds to the ability to manage and work with large volumes of data.
Deciding whether Azure NetApp Files is right for you is simple because it is a service you can easily run from your Azure portal. For instructions on how to get started, contact us email: [email protected]