More about AWS EFS
- Understanding AWS EFS Shared Storage for Files, Block Storage, Object Storage and VDI
- EFS Backup: Backing Up NFS Data in AWS
- EFS IA vs Cloud Volumes ONTAP Data Tiering: File Share Tiering Options on AWS
- AWS NFS File Shares with Amazon EFS: 5 Key Considerations
- AWS EFS Performance Do’s and Dont's
- AWS EFS: Is It the Right Storage Solution for You?
- AWS File Sharing with AWS EFS
Amazon EFS is an AWS file sharing service that lets you manage file shares, like those used on traditional networks, and mount them on cloud or on-premises machines using the NFS protocol.
In this post, we’ll review the basics of AWS EFS, give you some tips to help you optimize your performance, and see how it compares to other AWS storage options. Finally, we’ll show you how NetApp Cloud Volumes ONTAP can help you get the most out of whatever file service option you choose.
In this article, you will learn:
- What AWS EFS is
- What backup solutions are available for EFS
- Tips for optimizing EFS performance
- How AWS storage services compare
- How Cloud Volumes ONTAP can help you support file shares
What Is AWS EFS?
AWS Elastic File System (EFS) is one of three main storage services offered by Amazon. It is a scalable, cloud-based file system for Linux-based applications and workloads that can be used in combination with AWS cloud services and on-premise resources. EFS offers a choice between two storage classes, Infrequent Access and Standard access, depending on your needs. Standard access storage is designed for frequently accessed files while Infrequent Access is intended for storing long-lived but less used files at a lower cost.
EFS uses the NFSv4 protocol for its file system structure, which mirrors a standard on-premise structure and simplifies transferring and accessing your files. It can be used in combination with Elastic Cloud Compute (EC2) instances or as a stand-alone file system. EFS does not require storage provisioning and is pay-for-use allowing you to scale services as needed.
Some of EFS’ key features include:
Files are accessible from AWS services as well as from on-premise. They can be simultaneously accessed by up to a thousand EC2 instances within the cloud or via VPN or AWS Direct Connect, making EFS good for hybrid solutions. File access is possible across multiple AWS Availability Zones (AZs) and Regions, for easier collaboration and global remote work.
EFS is designed for low latency with IOPS and throughput that scale with usage and the number of attached instances, meaning that as storage size grows, performance increases. At peak performance, it offers 10 GB/sec throughput and 500k IOPS. EFS scales automatically as data is moved in or out, minimizing fears of running out of space or paying for storage you aren’t using. Learn more about how file sharing impacts cloud scalability and agility.
Secure and Compliant
EFS allows multiple layers of security and relies on your existing security infrastructure. It can be used with Amazon's Identity and Access Management (IAM) roles as well as VPC security groups and allows you to define individual file permissions using POSIX. EFS has built-in compliance with common regulatory standards, including PCI DSS, HIPAA, and SOC with the ability to meet others if necessary. Learn more about best practices for secure cloud file sharing.
AWS EFS Backup Solutions
Since a storage solution is only really useful when it can be backed up, you should be aware of your backup options with EFS. Keep in mind, other ways exist if you want to use third-party products integrated with AWS. Also, learn more about general considerations for backup and archiving in the cloud.
Amazon Backup Service
AWS Backup is a fully managed service that allows you to create, manage, and automate incremental backups according to a schedule you define through a central location. This system is PCI and ISO compliant and HIPAA eligible, to ensure that your compliance needs are covered. It is possible to use AWS Backup whether your system has a cloud-native, hybrid, or on-premise configuration.
This solution is easy to implement, and incremental backups help keep your costs low but requires manually pausing the applications and processes being backed up and only allows backups to be stored on EFS.
EFS to EFS Backup
There is no built-in EFS backup, and EFS does not have a native snapshot mechanism. So, before AWS Backup was released, backups had to be done using a template in AWS CloudFormation. This involves using scripts to access the AWS Data Pipeline, from which you must transfer data between multiple services before finally storing the backed-up data in EFS. With this process, you are still able to control backup schedules and life cycles as with the AWS Backup Service.
The main downsides of this option are that it does require some programming knowledge and is not easily monitored. Additionally, if you are not careful to change time constraints according to the amount of data you are backing up, your process can fail.
Backing Up to Amazon S3
Backing up your data to S3 is another option you might consider and one that can help decrease your storage costs. This process begins the same as the EFS to EFS backup but rather than moving the incremental backups from S3 to EFS at the end of the process, they are simply left in S3.
Like EFS to EFS, you can schedule your backups and manage life cycle length but you must also have some programming ability and be familiar with the use of scripts for automating processes.
How to Optimize AWS EFS Performance
To get the greatest ROI with EFS, you will need to take steps to optimize your configuration performance. Although specific changes will depend on your needs, the following tips apply to most EFS users.
Monitor Your EFS Burst Credits
One of the biggest shocks for EFS adopters comes the first time they run out of burst credits and they see their performance sharply drop. To avoid this, make sure that you monitor your burst credits either manually or by adding alerts in CloudWatch that will notify you when they run low. Making sure to schedule backups during periods of low use or during non-working hours will help save your credits for when they are truly needed.
You should keep in mind that EFS volumes start with a .5MB/s transfer rate and only 7.2 minutes of burst credits for throughput up to 100MB/s, which is probably not enough to meet your needs. You can increase these numbers by increasing the amount of data you’re storing but there is no way to simply buy additional credits.
Don’t Run Applications from EFS
If you plan to run and host applications from EFS, Elastic Block Storage (EBS) is a better option for you. EFS is not meant for the large file read volumes or fast speed that tasks like managing codebases or application deployment require, so you should not try to use it for these tasks. Instead, stick to tools that deploy code to local filesystems or containers.
Using EFS as it is designed, for storage of media assets, exported data files, asynchronous logs, etc. will ensure that you see the sort of performance you’re expecting and that your productivity doesn’t suffer.
Choose the Right Performance Mode
EFS is designed with two different performance mode options: General Purpose and Max I/O.
General Purpose is the default setting and the one that will work best for most users. It focuses on lower throughput levels in exchange for lower latency and is good for tasks like web-hosting and content management.
Max I/O focuses on higher throughput at the cost of higher latency, making it better for tasks such as big data analysis or media processing.
Keep in mind, both will see an increase in throughput performance as you attach more concurrent instances as long as the workload can be spread across the instances.
Amazon Storage Services: EFS vs EBS vs S3
To know whether EFS truly is the best option for you, you’ll want to compare it to your other two main options, EBS and S3.
EFS is fairly easy to learn to use because it mirrors a traditional file hierarchy structure. Since it allows multiple instances to be connected simultaneously across regions and AZs, it does not require as much redundant storage as other options and allows for easy cloud file sharing and collaboration.
As mentioned, EFS is ideal for use in global content management systems, big data analytics, and media processing workflows.
EBS uses volumes to provide low-latency block storage for use with EC2 instances. It can be a bit complicated to set up as it requires that you choose your volume type, according to performance requirements, from the start and it doesn’t automatically scale like other options.
EBS is designed for application hosting and storage and high-volume databases. Learn more about AWS EBS in our extensive series of blog posts.
Simple Storage Service (S3) provides object storage, without the use of EC2 instances, that is accessible directly through the internet. It is the cheapest option and provides a lot of flexibility in storage, but can require some programming proficiency as it is typically managed through AWS Software Development Kits (SDKs). Learn how to mount Amazon S3 as a drive to simplify management.
S3 works well for static website hosting, version management, log file storage, media distribution or streaming, and big data analytics.
For a side-by-side comparison of these three options:
$0.3 per GB/month and $6 per MB/month for provisioned throughput
$.045-$0.125 per GB/month, depending on volume type
$0.021-0.023 per GB/month depending on total storage
Up to 500k IOPS and 10+ GB/s throughput
Minimum of 3GB/s
Varies by volume type
Minimum of 3 IOPS per GB of storage
3500 PUT/LIST/DELETE requests per second
5500 GET requests per second
Availability and Accessibility
Highly available but no SLA defining percent
Accessed by up to 1K instances from multiple AZ or Regions
Accessed via a single EC2 instance
Accessed via Internet and API
Managed via user and group level permissions
File access requires endpoint access
Managed via IAM and security groups
Managed via IAM and bucket policies
Storage and File Limits
Unlimited storage size
47.9 TB file size
16 TB storage per volume with unlimited volumes
File size limited by volume size
Unlimited storage size
5TB file size limit
*AWS pricing is rather complex but the NetApp AWS calculator can help you better understand and reduce your costs.
How Cloud Volumes ONTAP Can Help You Support File Shares
NetApp Cloud Volumes ONTAP, the leading enterprise-grade storage management solution, delivers secure, proven storage management services on AWS, Azure and Google Cloud. Cloud Volumes ONTAP supports up to a capacity of 368TB, and supports various use cases such as file services, databases, DevOps or any other enterprise workload.
Cloud Volumes ONTAP provides a cloud file share service that supports efficient NFS and SMB file storage and facilitates secure cloud file sharing.
Learn More About AWS EFS
AWS Shared Storage for Files, Block & Object Storage
Shared storage enables you to store, distribute, and share your data across multiple locations and users. AWS offers a wide range of shared options for storage, including shared files, block, and object storage.
This article explains how shared storage works on AWS, and the main differences between AWS shared storage options.
EFS Performance Do’s and Don’ts
AWS EFS is a popular cloud file sharing service that can be mounted on Amazon EC2 instances, alongside Amazon EBS.
Learn which scenarios EFS can and cannot provide high performance, understand EFS performance options and get performance optimization tips.
Read more: AWS EFS Performance Do’s and Dont's
AWS NFS File Shares with Amazon EFS: 5 Key Considerations
Network File System (NFS) is a distributed file system protocol that lets users access files over a network similar to the way they access local storage.
In this article, we’ll look at 5 key considerations to address when using AWS EFS as your NFS solution, including operating system support, on-premise access to files, and managing backups.
See Our Additional Guides on Key IaaS Topics
We have authored in-depth guides on several other topics that can also be useful as you explore the world of IaaS.
Learn about cloud migration and what major challenges to expect when implementing a cloud migration strategy in your organization.
See top articles in our cloud migration strategy guide:
- Cloud Migration Tools: Transferring Your Data with Ease
- Cloud Data Integration 101: Benefits, Challenges, and Tools
- 3 Cloud Migration Approaches and Their Pros and Cons
Discover how high available systems are reliable and resilient and see how AWS can help you achieve high availability for cloud workloads, across 3 dimensions.
See top articles in our AWS high availability guide:
- AWS Availability Zones: Architecture and Considerations for Planning Your Deployment
- AWS Data Loss Prevention: 5 Strategies and 5 Tools You Can Use
- AWS GovCloud Services: Sensitive and Classified Data on the Public Cloud
Learn about Amazon’s basic framework for migration, and how to plan for common challenges that affect almost every migration project.
See top articles in our AWS migration guide:
- 5 Steps to the Cloud: AWS Migration Checklist
- AWS Case Studies with NetApp Cloud Volumes ONTAP
- AWS Database Migration Service: Copy-Paste Your Database to Amazon
Learn what is AWS EBS and how to perform common EBS operations. Including five highly useful EBS features that can help you optimize performance and billing.
See top articles in our guide to AWS EBS:
- Are You Getting Everything You Can from AWS EBS Volumes?: Optimizing Your Storage Usage
- AWS EBS Volume Backup with EBS Snapshots
- Cloning Amazon EBS Volumes: A Solution to the AWS EBS Cloning Problem
Learn about tools and practices that can help you manage and optimize costs on the Microsoft Azure cloud.
See top articles in our Azure cost management:
- Azure Cost Management: Visualize, Predict and Optimize Your Azure Bill
- Azure Cost Optimization: 12 Ways to Save on Azure
- Azure Storage Pricing: Blobs, Files, Tables and Managed Disks
Learn how AWS cost optimization works, free Amazon tools that can help manage costs, and best practices for reducing your cloud bill.
See top articles in our AWS cost optimization guide:
- AWS Costs: 3 Ways to Save Big and 10 Price Variations to Watch Out For
- AWS Storage Costs: All in One Place
- AWS Cost Saving Guidebook Shows How You Can Optimize EBS Costs
Learn about aspects of considerations when implementing Azure migration: migration models, state assessment, storage configuration, security, and maintenance.
See top articles in our Azure migration guide:
- 11-Step Azure Migration Checklist
- Moving Clouds: Migration from AWS to Azure and Azure to AWS
- Azure Migration Tools: One-Click Migration for VMs and Data
High availability is one of the major benefits of cloud services. The guarantee that your data will remain accessible is critical to supporting high priority workloads and applications and is the reason many move to the cloud in the first place.
This guide explains what high availability is and how to optimize Azure high availability.
See top articles in our Azure high availability guide:
- Azure Availability Zones: An In-Depth Look
- Azure High Availability with Cloud Volumes ONTAP
- Azure Proximity Placement Groups and Cloud Volumes ONTAP
Learn how to use Linux on Azure, including guides for cloud-based enterprise Linux deployments and performance tips.
See top articles in our guide to Linux on Azure:
- Solve Enterprise Linux File Requirements in Azure
- Build Your Own Enterprise NFS Service
- Linux on Azure Workload Migration: Challenges and Solutions
Discover services and techniques for cloud-based HPC, including unique Azure HPC features and use cases.
See top articles in our guide to HPC on Azure:
- Cloud Architects: Supercharge Your HPC Workloads in Azure
- Migrate Legacy Apps to the Cloud
- Solve Azure HPC Challenges eBook
Learn about all SAP solutions offered as a service on Azure, including HANA, S/4HANA, NetWeaver and Hybris, migration considerations and best practices.
See top articles in our guide to SAP on Azure:
- SAP HANA Architecture: Components, Storage Types, and Cloud Offerings
- Start Your SAP on Microsoft Azure Cloud Journey
- SAP HANA Certification for Azure NetApp Files
Learn what options are available for VDI on Azure. Understand how the architecture works and discover best practices for VDI deployments.
See top articles in our guide to VDI on Azure:
- FSLogix: An In-Depth Look
- Azure Windows Virtual Desktop: How to Setup, Deploy, and Manage a Cloud-Based VDI
- Azure VDI Pricing: Understand Windows Virtual Desktop Costs
Learn about the tools AWS provides for building big data infrastructure, including data lakes and big data analytics systems.
See top articles in our guide on AWS Big Data:
- AWS Data Lake: End-to-End Workflow in the Cloud
- AWS Data Analytics: Choosing the Best Option for You
- AWS ElastiCache for Redis: How to Use the AWS Redis Service
Learn how to migrate your workloads and data to Google Cloud, including in-depth comparisons between GCP and other cloud providers, tools, strategies, costs, and more.
See top articles in our guide on Google Cloud migration:
- AWS vs Azure vs Google Cloud: Choosing the Best Cloud Provider for You
- Google Cloud Costs: Understanding and Managing Your GCP Bill
- Google Cloud Migration Tools: Copying 1GB or 500TB? Learn How