AI說書 - 從0開始 - 392 | Hugging Face T5 模型之翻譯功能範例

我想要一天分享一點「LLM從底層堆疊的技術」，並且每篇文章長度控制在三分鐘以內，讓大家不會壓力太大，但是又能夠每天成長一點。

!pip install transformers -qq 
!pip install accelerate -qq 
!pip install sentencepiece -qq
from transformers import T5Tokenizer, T5ForConditionalGeneration

tokenizer = T5Tokenizer.from_pretrained("google/flan-t5-xl")
model = T5ForConditionalGeneration.from_pretrained("google/flan-t5-xl", device_map = "auto")

input_text = "translate English to German: How old are you?"
input_ids = tokenizer(input_text, return_tensors = "pt").input_ids.to("cuda")
outputs = model.generate(input_ids)
print(tokenizer.decode(outputs[0]))

結果為：