jeffyoulose

jeffyoulose t1_jdbgdq3 wrote

In 6 months people will be bored of chatGPT and BARD and will be distracted by the next hot thing (maybe a new war or an economic crisis).

This tech has the smell of a fad like wordle was for 2022. Remember all those variants of wordle? All forgotten and shoved into that shoebox under the bed like everything else. Remember the excitement surrounding self driving tech 5-8 years ago? Also now forgotten.

And all the excitement about LLM applications is exactly like the excitement about block chain. Everyone will declare that they are going to study using LLMs for xyz. But give up after a few months after finding out that these systems spew out garbage and you need to pay millions for the GPU farm and the human raters to train the (reward) models. Prompt engineers will have to recompose prompts to achieve stability and reproducibility across models.

Just ask anyone who has played around with stable diffusion. You start with fluent text description but soon enough you are using massive positive and negative word lists to get anything close to what you want SD to render.

Start ups will fail when they find out that their applications are tied to specific versions of models.

−1