Define what needs to change
Bring useful inference onto constrained devices, balancing model quality with latency, memory, power and reliable field operation.
Recognise the signals
- Network latency interrupts the workflow
- The model exceeds device memory or thermal limits
- A lab deployment is difficult to update in the field