The cost of training can run into millions of dollars, Lange said. “The high cost of training is giving people some challenges,” said Danny Lange, vice president of AI and machine learning at gaming and automotive AI company Unity Technologies. That process requires compute-heavy tuning and testing of large numbers of parameters or combinations of different model types and inputs using terabytes or petabytes of data. Some companies are considering on-prem setups in the model building phase, when ML and deep-learning models are trained before they are released to operate in the wild. “If you have the capability, it may make sense to stand up your own and run those workloads in your own colo, because the costs of running it in the cloud does get quite expensive at certain scale.” And now I think there's more of an equilibrium where they are now investing again in their hybrid infrastructure - on-prem infrastructure combined with the cloud,” Raghavendra told Protocol. They went from having everything on-prem, to everything in the cloud when I was there. Raghavendra left Walmart in 2020 after seven years with the company in senior engineering and merchant technology roles.
The on-prem trend is growing among big box and grocery retailers that need to feed product, distribution and store-specific data into large machine learning models for inventory predictions, said Vijay Raghavendra, chief technology officer at SymphonyAI, which works with grocery chain Albertsons. There's more of an equilibrium where they are now investing again in their hybrid infrastructure. Cost is actually a big driver, said Robinson, noting the hefty price of running computationally intensive deep-learning models such as GPT-3 or other large-language transformer models, which businesses today use in their conversation AI tools and chatbots, on cloud servers. “We still have a ton of customers who want to go on a cloud migration, but we're definitely now seeing - at least in the past year or so - a lot more customers who want to repatriate workloads back onto on-premise because of cost,” said Thomas Robinson, vice president of strategic partnerships and corporate development at MLOps platform company Domino Data Lab. For many years, cloud providers have argued that the computing requirements for machine learning would be far too expensive and cumbersome to start up on their own, but the field is maturing. At the same time, a global pharma company is training its machine learning models on premises, using servers it manages by itself.Ĭloud computing isn’t going anywhere, but some companies that use machine learning models and the tech vendors supplying the platforms to manage them say machine learning is having an on-premises moment.
A quick-service restaurant chain is running its AI models on machines inside its stores to localize delivery logistics.
0 kommentar(er)
