Emergent Capabilities of LLM as They Get Bigger
In Emergent abilities of large language models, emergent ability are defined as an ability that is “not present in small models but is present in large models.” Is emergence a rare phenomena, or are many tasks actually emergent? It turns out that there are more than 100 examples of emergent abilities that already been empirically …