There was some previous discussion here, though you should take the linked article with a grain of salt as someone pointed out that the author of the article isn't exactly neutral.

https://discuss.online/post/32799122

The tl;dr is that it's hard to say for sure. It certainly takes energy to run services like chatgpt, but how much energy it takes vs other things that people don't blink at like eating meat or watching netflix is unclear. It's also very entangled with a conversation about how backwards we are in energy generation. The energy cost of responding to any particular query is going down as models get more efficient, though that doesn't mean overall energy use will go down, see Jevons paradox:

In economics, the Jevons paradox occurs when technological advancements make a resource more efficient to use (thereby reducing the amount needed for a single application); however, as the market cost of using the resource drops, if demand is highly price elastic, this results in overall quantity demanded increasing, causing total resource consumption to rise.