What GenAI is forThe business leaders pumping all this money of course don’t understand the technology. They’re doing this for exactly one reason: They think they can discard armies of employees and replace them with LLM services, at the cost of shipping shittier products. Do you think your management would spend that kind of money to help you with a quicker first draft or a summarized inbox?
…
Then there’s the other thing that nobody talks about, the massive greenhouse-gas load that all those data centers are going to be pumping out.
I don’t know about GPT-4, but
GPT-3 used 700,000 liters of water to train. Retrieval from it costs 0.14 kWh per 100-word email. I’m sure that there’s a lot of variance there, but if it’s in the ballpark, keep in mind that you can raise the temperature of 1L of water from room temperature to boiling with 0.1 kWh.