In recent years, model parameters have exploded to a huge number of parameters (540 B with PaLM). The question that has been asked is whether this number of parameters is necessary.
According to OpenAI, as models grow, there is an increase in performance. In addition, there is the appearance of e...