Back to the stories

Microsoft brings Foundry Local AI inference to Azure Local environments

Score 9.4,

Cloud AI Infrastructure

AI models can now run inside the same customer-controlled environment where their data is generated. That matters when data needs to stay on site, or a location cannot rely on a connection to the wider cloud.

Microsoft’s Foundry Local on Azure Local gives organizations a way to run models on infrastructure they control. The deployment is designed for local, disconnected, or regulated settings.

For those organizations, the change is practical: they can process data on premises instead of sending it elsewhere for the AI to work on.

Think of it as bringing the tool to the files. The model runs locally, so processing can stay where the data is created. Organizations still need an Azure Local environment and enough computing capacity for their workload.

The next test is whether this setup proves practical for more organizations with strict location or connectivity needs. How many will choose to run AI this way?