Page 10 - LARGE LANUGAGE MODEL AND SMALL LANUGAGE MODEL
P. 10
Examples of SLM
1.Phi-2
A 2.7 billion-parameter model from Microsoft that performs well in
mathematical reasoning, common sense, and language
understanding
2. DistilBERT
A faster and lighter version of Google's BERT
3. Orca 2
A model from Microsoft that improves reasoning abilities
4. GPT-Neo and GPT-J
Open source versions of OpenAI's GPT model
