ForgottenFlux@lemmy.world to Technology@lemmy.worldEnglish · 11 months agoGoogle's AI-powered search summaries use 10x more energy than a standard Google search | The Hidden Environmental Impact of AIjacobin.comexternal-linkmessage-square143fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkGoogle's AI-powered search summaries use 10x more energy than a standard Google search | The Hidden Environmental Impact of AIjacobin.comForgottenFlux@lemmy.world to Technology@lemmy.worldEnglish · 11 months agomessage-square143fedilink
minus-squarekromem@lemmy.worldlinkfedilinkEnglisharrow-up0·11 months agoExactly. The difference between a cached response and a live one even for non-AI queries is an OOM difference. At this point, a lot of people just care about the ‘feel’ of anti-AI articles even if the substance is BS though. And then people just feed whatever gets clicks and shares.
minus-squarequick@thelemmy.clublinkfedilinkEnglisharrow-up0·11 months agoGoogles tpu can’t handle llm’s lol. What do you mean “exactly”?
minus-squarekromem@lemmy.worldlinkfedilinkEnglisharrow-up0·11 months ago In fact, Gemini was trained on, and is served, using TPUs. https://cloud.google.com/blog/products/ai-machine-learning/bringing-gemini-to-organizations-everywhere Google said its TPUs allow Gemini to run “significantly faster” than earlier, less-capable models. https://www.forbes.com/sites/richardnieva/2023/12/07/google-deepmind-gemini-tpu/ Did you think Google’s only TPUs are the ones in the Pixel phones, and didn’t know that they have server TPUs?
Exactly. The difference between a cached response and a live one even for non-AI queries is an OOM difference.
At this point, a lot of people just care about the ‘feel’ of anti-AI articles even if the substance is BS though.
And then people just feed whatever gets clicks and shares.
Googles tpu can’t handle llm’s lol. What do you mean “exactly”?
Did you think Google’s only TPUs are the ones in the Pixel phones, and didn’t know that they have server TPUs?