29/01/2023
The ml.p4de.24xlarge instances have 80 GB of memory per GPU (640 GB total) along with support for up to 8 TB of local NVMe SSD storage. This enables high performance machine learning inference of compute intensive workloads on SageMaker such as large language models, and generative AI models. These....