When to Use Snowmobile?
Snowmobile is designed for a very specific use case: migrating massive, exabyte-scale datasets that would be impractical to move over the internet.
- Data Volume: The primary indicator for Snowmobile is when you need to move more than 10 PB of data. For datasets smaller than 10 PB, AWS Snowball Edge is typically the more appropriate choice.
- Common Scenarios:
- Complete data center migrations.
- Moving entire video libraries or scientific research repositories.
- Shutting down legacy infrastructure and needing to archive massive volumes of data in the cloud.
- Any scenario where transferring data online would take many months or even years.
Key Specifications
- Storage Capacity: Up to 100 PB of data per Snowmobile.
- Form Factor: A 45-foot long, 8-foot wide, 9.6-foot tall ruggedized shipping container. It is climate-controlled, water-resistant, and tamper-resistant.
- Connectivity: Requires a high-speed network backbone connection from your data center. AWS provides a removable networking rack and fiber optic cables to connect to your network.
- Power: Requires significant power (around 250 kW), which must be provided by the customer's site.
The End-to-End Workflow
The Snowmobile process is a high-touch service managed closely by AWS personnel.
- Initial Consultation: The process begins with a discussion with AWS to assess your project needs and data volumes.
- Site Survey: AWS personnel conduct a mandatory site survey at your data center. They verify that there is adequate physical space to park the container, sufficient power, and appropriate network infrastructure for a high-speed connection.
- Snowmobile Arrival & Setup: AWS personnel drive the Snowmobile to your site. They handle all aspects of setup, including parking, power, and connecting the mobile networking rack to your local network.
- Data Migration: Once connected, the Snowmobile appears as a network storage target on your LAN. Your IT staff are responsible for copying the data from your local sources (like SAN, NAS, or HDFS) to the Snowmobile at high speed.
- Return to AWS: After your data is loaded, AWS personnel drive the Snowmobile to the pre-arranged AWS Region.
- Data Ingestion: At the AWS data center, your data is imported directly from the Snowmobile into your designated Amazon S3 or Amazon S3 Glacier buckets.
- Job Completion: You are notified once the data import is complete and your data is accessible in AWS.
Multi-Layered Security
Security is paramount for Snowmobile and is addressed at every level of the process.
- Physical Security:
- The container is tamper-resistant and waterproof.
- The Snowmobile is tracked by GPS and has 24/7 video surveillance and alarm monitoring.
- It is operated and monitored by dedicated AWS security personnel.
- An optional escort security vehicle can follow the Snowmobile during transit.
- Data Security:
- All data is encrypted at rest with 256-bit encryption before it is written.
- You manage the encryption keys using the AWS Key Management Service (KMS). AWS personnel do not have access to your data or your encryption keys.
- Secure Chain of Custody: From the moment it arrives at your site until your data is fully ingested into S3, the Snowmobile and its contents are managed and monitored by AWS personnel, ensuring a secure end-to-end chain of custody.
Snowmobile vs. Snowball Edge
Feature | AWS Snowball Edge | AWS Snowmobile |
---|---|---|
Data Volume | Up to ~80 TB per device (Petabyte-scale jobs using multiple devices) | Up to 100 PB per truck (Exabyte-scale jobs) |
Use When... | You need to move terabytes to under 10 petabytes. | You need to move more than 10 petabytes. |
Management | Self-managed by the customer using the console and AWS OpsHub. | Fully managed and operated by AWS personnel. |
Form Factor | Ruggedized, portable appliance (suitcase-sized). | 45-foot shipping container on a semi-trailer truck. |
Edge Compute | Yes (can run EC2 and Lambda). | No (purely for data transport). |
Sources |