Coursera自然语言处理专项课程04：Natural Language Processing with Attention Models笔记 Week03（完结）

Natural Language Processing Specialization

Introduction
https://www.coursera.org/specializations/natural-language-processing

Certificate

Natural Language Processing with Attention Models

Course Certificate

本文是学习这门课 Natural Language Processing with Attention Models的学习笔记，如有侵权，请联系删除。

文章目录

• Natural Language Processing Specialization
• Natural Language Processing with Attention Models
• Week 03: Question Answering
• • • Learning Objectives
  • Week 3 Overview
  • Transfer Learning in NLP
  • ELMo, GPT, BERT, T5
  • Reading: ELMo, GPT, BERT, T5
  • Bidirectional Encoder Representations from Transformers (BERT)
  • BERT Objective
  • Reading: BERT Objective
  • Fine tuning BERT
  • Transformer: T5
  • Reading: Transformer T5
  • Multi-Task Training Strategy
  • GLUE Benchmark
  • Lab: SentencePiece and BPE
  • • Introduction to Tokenization
    • SentencePiece Preprocessing
    • • NFKC Normalization
      • Lossless Tokenization
    • BPE Algorithm
    • • Preparing our Data
      • BPE Algorithm
      • Additional Discussion of BPE Algorithm
    • Train SentencePiece BPE Tokenizer on Example Data
    • • Explore SentencePiece Model
      • Train SentencePiece BPE model with our example.txt
    • Optionally try to implement BPE using a priority queue below
  • Welcome to Hugging Face
    标签：Week03,use,Natural,text,Attention,question,will,answer,model
    From： https://blog.csdn.net/shizheng_Li/article/details/137246246