Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/operations/optimize-edge-ai-power-performance.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ Implement power-aware AI inference strategies for edge devices that dynamically

- **Defer non-urgent inference**: Queue and batch low-priority inference requests to run during optimal power conditions (e.g., when device is charging or plugged in).
- **Thermal-aware throttling**: Monitor device temperature and reduce inference frequency or model complexity before hardware throttling occurs.
- **Battery-level policies**: Implement tiered power policies that progressively reduce AI workload intensity as battery depletes (e.g., 100-70%: full performance, 70-30%: reduced frequency, <30%: minimal/disabled).
- **Battery-level policies**: Implement tiered power policies that progressively reduce AI workload intensity as battery depletes (e.g., 100-70%: full performance, 70-30%: reduced frequency, below 30%: minimal/disabled).
- **Enable dynamic voltage and frequency scaling (DVFS)**: Configure hardware to operate at lower frequencies when peak performance isn't needed.
- **Account for mixed-signal accelerator sensitivity**: Analog and mixed-signal AI accelerators exhibit performance that varies with process, voltage, and temperature (PVT). This is usually mitigated during hardware-aware training, but it still matters at inference in deployed systems—accuracy and energy can drift as temperature or supply voltage change. Prefer routing work to such accelerators within their validated operating envelope, and in a heterogeneous system fall back to a more robust (e.g. digital) compute unit when conditions move outside it.
- **Schedule across heterogeneous compute units**: With CPUs, GPUs, NPUs, and non-von-Neumann accelerators increasingly present on the same edge device, treat scheduling as a placement decision—dispatch each request to the unit offering the best energy-per-inference for the current accuracy target and operating conditions, not just to a single default processor.
Expand Down
Loading