This tool is estimated by the amount of electricity consumed by your Chatbot messages

Photo of author

By [email protected]


Have you ever wondered about the amount of electricity you use when claiming, or thank the artificial intelligence model? Facial engineer Julian Delvandy hugged, so built tool To help get to the answer.

Artificial intelligence models consume energy every time they are turned on. They are operated on specialized graphics and chips that need a lot of energy to implement the widespread mathematical work burdens. It is not easy to determine the consumption of typical energy, but it is Widely expected This increased use of artificial intelligence technologies will increase electricity needs to new horizons in the next two years.

Pushing the demand for more energy to provide artificial intelligence with some companies to follow -up Eclipicinous Strategies. Tools such as Delavande aim to draw attention to this, and possibly give some artificial intelligence users.

“Even small energy savings can correspond through millions Written in a statement.

The Delavande tool is designed to work with Chat UI, which is an open source front of models such as Meta’s Lama 3.3 70B and Google Gemma 3. The power tool is estimated to consume the messages sent to and from the actual time model, as it was reported to consume the consumption of Watt-Hours watches. It also compares the use of typical energy with the use of common home appliances, such as microwave ovens and lamps.

According to the tool, the Llama 3.3 70B claim to write a typical email is used about 0.1841 watts of an hour-which is equivalent to running a microwave for 0.12 seconds or using a toaster for 0.02 seconds.

It should be noted that the tool estimates are only – estimates. Do not claim Delavande that it is incredibly accurate. However, it is a reminder that everything – including Chatbots – has a cost.

“With projects such as the degree of artificial intelligence and the broader research on the imprint of artificial intelligence, we press for transparency in the open resource community. One day, energy use can be visible like food feeding labels!” Delvandy and his influences wrote.





https://techcrunch.com/wp-content/uploads/2024/12/Energy-sector-Getty.jpg?resize=1200,801

Source link

Leave a Comment