Docs
gpu
Best Practices for Large AI Models
Rapid Deployment of T5 Model

T5

Introduction

T5 is a large language model NLP published by Google, namely Text-To-Text Transfer Transformer. UCloud Global Mirror Market provides mirror images of T5-Base and T5-3B models.

Quick Deployment

Log in to the UCloud Global console (https://console.ucloud-global.com/uhost/uhost/create), select the machine type “GPU-type”, “V100S”. Detailed configuration of CPU and GPU numbers can be selected as needed. Minimally recommended configuration: T5-Base 10-core CPU 64G memory 1 V100S chip.
T5-3B 20-core CPU 128G memory 2 V100S chips Select “Mirror Market” for the mirror image, search for “T5” in mirror name, and create GPU cloud host with this mirror image.
After the creation of the GPU cloud host is successful, log into the GPU cloud host.

Our pre-installed image provides the following information:

  1. Fine-tuning
  2. Inference