Powering the AI inference boom: Is it time to downsize the data centre?
In the world of artificial intelligence, the focus used to be on training AI models. Now, increasingly, it’s on “inference”Β β the actual execution of the tasks we ask these systems to perform.Β David GurlΓ© is a French tech entrepreneur whose startup Antimatter aims to service the inference boom with energy solutions, mini data centres that fit inside a container and appropriate softwareΒ β for only a fraction of the cost and time.