Transformer-Introduction

• HuggingFace ecosystem

  • Transformers: https://github.com/huggingface/transformers
  • Datasets: https://github.com/huggingface/datasets
  • Tokenizers: https://github.com/huggingface/tokenizers
  • Accelerate: https://github.com/huggingface/accelerate
  • HuggingFace Hub: https://huggingface.co/models

• Common NLP tasks

  • Classifying whole sentences: sentiment analysis, spam classification, verify sentence grammer, logical relation between sentences
  • Classifying each word in a sentence: NER, pos tag
  • Generating text content: Text generation, fill in the blanks with masked words
  • Extracting an answer from a text: QnA
  • Generating a new sentence from an input text: NMT, text summarization