The best architecture is sometimes hybrid: local + cloud AI

Hybrid is usually the right answer and usually implemented badly — arrived at by accident rather than designed, which gives you the costs of both and the clarity of neither.