It is not ‘LLM companies’. It is OpenAI.
And not from buying memory either. Last year they made two deals with two major memory manufacturers, which together meant they were purchasing a significant percentage of the world’s memory production. And they negotiated these two deals in secret, each company not knowing that the other was in discussions, and announced the two deals on the same day. They weren’t even buying memory chips you can put in a server, but finished wafers with memory chips printed on them. These wafers then have to be cut up into chips, those chips have to be put in packages, themselves tested, and then soldered down to memory modules. As far as I know, OpenAI has no ability to do this. So it seems likely they purchased a significant portion of the world’s memory production just to drive up prices and keep their competitors from having it.
It is not ‘LLM companies’. It is OpenAI. And not from buying memory either. Last year they made two deals with two major memory manufacturers, which together meant they were purchasing a significant percentage of the world’s memory production. And they negotiated these two deals in secret, each company not knowing that the other was in discussions, and announced the two deals on the same day. They weren’t even buying memory chips you can put in a server, but finished wafers with memory chips printed on them. These wafers then have to be cut up into chips, those chips have to be put in packages, themselves tested, and then soldered down to memory modules. As far as I know, OpenAI has no ability to do this. So it seems likely they purchased a significant portion of the world’s memory production just to drive up prices and keep their competitors from having it.