Skip to content

Latest commit

 

History

History
executable file
·
75 lines (54 loc) · 2.19 KB

README.md

File metadata and controls

executable file
·
75 lines (54 loc) · 2.19 KB
Raw

Performance Test

1. AFE

1.1 Resource Occupancy(ESP32)

algorithm Type RAM Average cpu loading(compute with 2 cores) Frame Length
AEC(HIGH_PERF) 114 KB 11% 32 ms
NS 27 KB 5% 10 ms
AFE Layer 73 KB

1.2 Resource Occupancy(ESP32S3)

algorithm Type RAM Average cpu loading(compute with 2 cores) Frame Length
AEC(LOW_COST) 152.3 KB 8% 32 ms
AEC(HIGH_PERF) 166 KB 11% 32 ms
BSS(LOW_COST) 198.7 KB 6% 64 ms
BSS(HIGH_PERF) 215.5 KB 7% 64 ms
NS 27 KB 5% 10 ms
MISO 56 KB 8% 16 ms
AFE Layer 227 KB

2. WakeNet

2.1 Resource Occupancy(ESP32)

Model Type Parameter Num RAM Average Running Time per Frame Frame Length
Quantised WakeNet5 41 K 15 KB 5.5 ms 30 ms
Quantised WakeNet5X2 165 K 20 KB 10.5 ms 30 ms
Quantised WakeNet5X3 371 K 24 KB 18 ms 30 ms

2.2 Resource Occupancy(ESP32S3)

Model Type RAM PSRAM Average Running Time per Frame Frame Length
Quantised WakeNet8 @ 2 channel 50 KB 1640 KB 10.0 ms 32 ms
Quantised WakeNet9 @ 2 channel 16 KB 324 KB 3.0 ms 32 ms
Quantised WakeNet9 @ 3 channel 20 KB 347 KB 4.3 ms 32 ms

2.3 Performance

Distance Quiet Stationary Noise (SNR = 4 dB) Speech Noise (SNR = 4 dB) AEC Interruption (-10 dB)
1 m 98% 96% 94% 96%
3 m 98% 96% 94% 94%

False triggering rate: 1 time in 12 hours

Note: We use the ESP32-S3-Korvo V4.0 development board and the WakeNet9(Alexa) model in our test.

3. MultiNet

2.1 Resource Occupancy(ESP32)

Model Type Internal RAM PSRAM Average Running Time per Frame Frame Length
MultiNet 2 13.3 KB 9KB 38 ms 30 ms

2.2 Resource Occupancy(ESP32S3)

Model Type Internal RAM PSRAM Average Running Time per Frame Frame Length
MultiNet 4 16.8KB 1866 KB 18 ms 32 ms
MultiNet 4 Q8 10.5 KB 1009 KB 11 ms 32 ms
MultiNet 5 Q8 16 KB 2310 KB 12 ms 32 ms

2.3 Performance with AFE

|Model Type|Distance| Quiet | Stationary Noise (SNR = 4 dB)| Speech Noise (SNR = 4 dB)| |:---:|:---:|:---:|:---:|:---:|:---:| |MultiNet 4|3 m|98%|93%|92%| |MultiNet 4 Q8|3 m|94%|92%|91%|