【ESP32-Korvo测评】 08 ESP-Skainet开发准备
本帖最后由 天意无罪 于 2021-3-20 20:30 编辑<p style="text-align:justify"><span style="font-size:10.5pt"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="font-family:宋体">折腾了几个晚上，终于把</span></span><span lang="EN-US" style="font-size:12.0pt">ESP-IDF</span><span style="font-size:12.0pt"><span style="font-family:宋体">开发环境搭好了，下面该进入正题了，语音应用开发。</span></span></span></span></p>
<p style="text-align:justify"> </p>
<p style="margin-bottom:16px"><span style="font-size:12pt"><span style="background:white"><span style="line-height:150%"><span style="font-family:宋体"><span style="color:black">乐鑫的语音开发组件为<b>ESP-Skainet，</b></span><span style="color:#24292e">以最便捷的方式支持基于乐鑫的 ESP32 芯片的唤醒词识别和命令词识别应用程序的开发。使用 ESP-Skainet，可以轻松构建唤醒词识别和命令词识别应用程序。</span></span></span></span></span></p>
<p style="margin-bottom:16px"><span style="font-size:12pt"><span style="background:white"><span style="line-height:150%"><span style="font-family:宋体"><span lang="EN-US" style="color:black"><img id="图片_x0020_48" src="file:///C:/Users/dengrb/AppData/Local/Temp/msohtmlclip1/01/clip_image001.jpg" style="width:415.5pt; height:202.5pt" /> </span></span></span></span></span></p>
<h2><span style="font-size:18pt"><span style="background:white"><span style="line-height:150%"><span style="font-family:宋体"><span style="font-weight:bold"><span style="font-size:12.0pt"><span style="line-height:150%"><span style="color:#24292e">唤醒词识别</span></span></span></span></span></span></span></span></h2>
<p style="text-align:start; -webkit-text-stroke-width:0px"><span style="font-size:12pt"><span style="background:white"><span style="line-height:150%"><span style="box-sizing:border-box"><span style="font-variant-ligatures:normal"><span style="font-variant-caps:normal"><span style="orphans:2"><span style="widows:2"><span style="text-decoration-thickness:initial"><span style="text-decoration-style:initial"><span style="text-decoration-color:initial"><span style="word-spacing:0px"><span style="font-family:宋体"><span style="color:#24292e">唤醒词模型<a href="https://github.com/espressif/esp-sr/tree/master/wake_word_engine/README_cn.md" style="color:blue; text-decoration:underline"><span style="text-decoration:none"><span style="text-underline:none">WakeNet</span></span></a>，致力于提供一个低资源消耗的的高性能模型，支持类似“Alexa”，“天猫精灵”，“小爱同学”等唤醒词的识别。</span></span></span></span></span></span></span></span></span></span></span></span></span></span></p>
<p style="text-align:start; -webkit-text-stroke-width:0px"><span style="font-size:12pt"><span style="background:white"><span style="line-height:150%"><span style="box-sizing:border-box"><span style="font-variant-ligatures:normal"><span style="font-variant-caps:normal"><span style="orphans:2"><span style="widows:2"><span style="text-decoration-thickness:initial"><span style="text-decoration-style:initial"><span style="text-decoration-color:initial"><span style="word-spacing:0px"><span style="font-family:宋体"><span style="color:#24292e">目前乐鑫免费开放“Hi，乐鑫”， “你好小智”， “你好小鑫”， “hi，Jeson”唤醒词。如果用户需要其它唤醒词，乐鑫提供有唤醒词定制服务，具体可参考<a href="https://github.com/espressif/esp-sr/tree/master/wake_word_engine/%E4%B9%90%E9%91%AB%E8%AF%AD%E9%9F%B3%E5%94%A4%E9%86%92%E8%AF%8D%E5%AE%9A%E5%88%B6%E6%B5%81%E7%A8%8B.md" style="color:blue; text-decoration:underline"><span lang="EN-US" style="text-decoration:none"><span style="text-underline:none">乐鑫语音唤醒词定制流程</span></span></a>。</span></span></span></span></span></span></span></span></span></span></span></span></span></span></p>
<h2 style="border-bottom:var(--color-border-secondary); text-align:start; -webkit-text-stroke-width:0px"><span style="font-size:18pt"><span style="background:white"><span style="line-height:150%"><span style="box-sizing:border-box"><span style="font-variant-ligatures:normal"><span style="font-variant-caps:normal"><span style="orphans:2"><span style="widows:2"><span style="text-decoration-thickness:initial"><span style="text-decoration-style:initial"><span style="text-decoration-color:initial"><span style="word-spacing:0px"><span style="font-family:宋体"><span style="font-weight:bold"><span style="font-size:12.0pt"><span style="line-height:150%"><span style="color:#24292e">语音命令词识别</span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></h2>
<p style="text-align:start; -webkit-text-stroke-width:0px"><span style="font-size:12pt"><span style="background:white"><span style="line-height:150%"><span style="box-sizing:border-box"><span style="font-variant-ligatures:normal"><span style="font-variant-caps:normal"><span style="orphans:2"><span style="widows:2"><span style="text-decoration-thickness:initial"><span style="text-decoration-style:initial"><span style="text-decoration-color:initial"><span style="word-spacing:0px"><span style="font-family:宋体"><span style="color:#24292e">命令词识别模型<a href="https://github.com/espressif/esp-sr/tree/master/speech_command_recognition/README_cn.md" style="color:blue; text-decoration:underline"><span style="text-decoration:none"><span style="text-underline:none">MultiNet</span></span></a>，致力于提供一个灵活的离线语音命词识别框架。用户可方便根据需求自定义语音命令，无需重新训练模型。</span></span></span></span></span></span></span></span></span></span></span></span></span></span></p>
<p style="text-align:start; -webkit-text-stroke-width:0px"><span style="font-size:12pt"><span style="background:white"><span style="line-height:150%"><span style="box-sizing:border-box"><span style="font-variant-ligatures:normal"><span style="font-variant-caps:normal"><span style="orphans:2"><span style="widows:2"><span style="text-decoration-thickness:initial"><span style="text-decoration-style:initial"><span style="text-decoration-color:initial"><span style="word-spacing:0px"><span style="font-family:宋体"><span style="color:#24292e">目前模型支持类似“打开空调”，“打开卧室灯”等中文命令词识别和"Turn on/off the light" 等英文命令词识别，自定义语音命令词最大个数为 100。</span></span></span></span></span></span></span></span></span></span></span></span></span></span></p>
<h2 style="border-bottom:var(--color-border-secondary); text-align:start; -webkit-text-stroke-width:0px"><span style="font-size:18pt"><span style="background:white"><span style="line-height:150%"><span style="box-sizing:border-box"><span style="font-variant-ligatures:normal"><span style="font-variant-caps:normal"><span style="orphans:2"><span style="widows:2"><span style="text-decoration-thickness:initial"><span style="text-decoration-style:initial"><span style="text-decoration-color:initial"><span style="word-spacing:0px"><span style="font-family:宋体"><span style="font-weight:bold"><span style="font-size:12.0pt"><span style="line-height:150%"><span style="color:#24292e">声学算法</span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></h2>
<p style="text-align:start; -webkit-text-stroke-width:0px"><span style="font-size:12pt"><span style="background:white"><span style="line-height:150%"><span style="box-sizing:border-box"><span style="font-variant-ligatures:normal"><span style="font-variant-caps:normal"><span style="orphans:2"><span style="widows:2"><span style="text-decoration-thickness:initial"><span style="text-decoration-style:initial"><span style="text-decoration-color:initial"><span style="word-spacing:0px"><span style="font-family:宋体"><span style="color:#24292e">目前ESP-Skainet集成了回声消除 AEC(Acoustic Echo Cancellation)，自动增益调节 AGC(automatic_gain_control)，噪声抑制 NS(Noise Suppression)，语音活动检测 VAD(Voice Activity Detection) 和麦克风阵列算法(Mic Array Speech Enhancement)。</span></span></span></span></span></span></span></span></span></span></span></span></span></span></p>
<p style="text-align:justify"> </p>
<p style="text-align:justify"><span style="font-size:10.5pt"><span style="line-height:150%"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="line-height:150%"><span style="font-family:宋体">要使用</span></span></span><span lang="EN-US" style="font-size:12.0pt"><span style="line-height:150%"><span style="font-family:宋体"><span style="color:#24292e">ESP-Skainet</span></span></span></span><span style="font-size:12.0pt"><span style="line-height:150%"><span style="font-family:宋体"><span style="color:#24292e">开发应用程序，首先还是得从GitHub上将开发包克隆下来，一想到这里，内心又开始抓狂了，因为之前安装ESP-IDF，从GitHub上克隆文件巨慢，经常失败。没办法，还是只有试试。</span></span></span></span></span></span></span></p>
<p style="text-align:justify"><span style="font-size:10.5pt"><span style="line-height:150%"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="line-height:150%"><span style="font-family:宋体"><span style="color:#24292e">启动ESP-IDF Command Prompt，输入命令：</span></span></span></span></span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><span lang="EN-US" style="border:none windowtext 1.0pt; font-size:10.0pt; padding:0cm"><span style="font-family:Consolas"><span style="color:#24292e">git clone --recursive https://github.com/espressif/esp-skainet.git </span></span></span></span></span></span></p>
<p align="left" style="text-align:left"> </p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="font-family:宋体"><span style="color:#24292e">等待了几分钟，果然还是失败了。</span></span></span></span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><img id="图片_x0020_49" src="file:///C:/Users/dengrb/AppData/Local/Temp/msohtmlclip1/01/clip_image002.png" style="width:415.5pt; height:87pt" /> </span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="font-family:宋体"><span style="color:#24292e">继续重试，等了十多分钟没有反应。既没有提示失败信息，也没有提示成功信息。</span></span></span></span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><img id="图片_x0020_50" src="file:///C:/Users/dengrb/AppData/Local/Temp/msohtmlclip1/01/clip_image003.png" style="width:414.75pt; height:158.25pt" /> </span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="font-family:宋体"><span style="color:#24292e">过了许久，还是提示无法连接</span></span></span><span lang="EN-US" style="font-size:12.0pt"><span style="font-family:Consolas"><span style="color:#24292e">GitHub</span></span></span><span style="font-size:12.0pt"><span style="font-family:宋体"><span style="color:#24292e">。</span></span></span></span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><img id="图片_x0020_51" src="file:///C:/Users/dengrb/AppData/Local/Temp/msohtmlclip1/01/clip_image004.png" style="width:414.75pt; height:84.75pt" /> </span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="font-family:宋体"><span style="color:#24292e">继续尝试，终于弹出下载进度提示信息了，泪奔啊。</span></span></span></span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><img id="图片_x0020_52" src="file:///C:/Users/dengrb/AppData/Local/Temp/msohtmlclip1/01/clip_image005.png" style="width:415.5pt; height:217.5pt" /> </span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="font-family:宋体"><span style="color:#24292e">又是漫长得等待，结果还是失败。</span></span></span></span></span></span></p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><img id="图片_x0020_53" src="file:///C:/Users/dengrb/AppData/Local/Temp/msohtmlclip1/01/clip_image006.png" style="width:415.5pt; height:171pt" /> </span></span></span></p>
<p align="left" style="text-align:left"> </p>
<p align="left" style="text-align:left"><span style="font-size:10.5pt"><span style="tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt"><span style="font-family:Calibri,sans-serif"><span style="font-size:12.0pt"><span style="font-family:宋体"><span style="color:#24292e">哎，看来得看网速和运气，算了，不折腾了，改天再试一下。</span></span></span></span></span></span></p>
<p>帖子里的图片无法显示</p>
<p>图好像裂了</p>
freebsder 发表于 2021-3-22 22:03
图好像裂了
<p>嗯，确实，晚上回去重新上传一下。</p>
littleshrimp 发表于 2021-3-22 21:20
帖子里的图片无法显示
<p>嗯，不知道是不是上传的时候出问题了。晚上下班回去重新弄一下。</p>
页:
[1]