5.5

文档摘要

5.5 NLP5.5 NLPBERTGPTTransformerNLPSeq2SeqFine-tuningPrompt EngineeringLoRAPEFTAI NLPNLP——Pre-trained Language Models, PLMsAI“”NLP Fine-tuningCVNLPOffer 1.1 NLP NLP 1.2 “” 1.3 Auto-encoding Models BERT“” Auto-regressive Models GPT“” -T5BART Transformer BERTGPT“”——TransformerTransformer2017GoogleNLPRNNCNNAttention Mechanism 2.1 RNNCNN RNN CNN RNN 2.