全志异核多构 AI智能视觉V853开发板测评 - V853 YOLO v3 量化

IC爬虫

全志异核多构 AI智能视觉V853开发板测评 - V853 YOLO v3 量化 [复制链接]

 

<i class="pstatus"> 本帖最后由 IC爬虫 于 2022-12-4 21:29 编辑 </i> # V853 YOLO v3 量化 V853上的NPU 使用的是芯原微电子的IP，从这个NPU 支持openCL和shader来编程猜测，这个NPU的结构应该是一个类似GPU这种拥有众多微核的架构。 ## 1、量化工具安装 * 参考全志的在线文档-NPU工具安装<https://v853.docs.aw-ol.com/npu/npu_dev_startup/> ## 2、YOLO V3数据准备 * YOLO V3的模型文件核权重文件直接到YOLO 的官方网站去下载，直接参考这个文档<https://v853.docs.aw-ol.com/npu/npu_yolov3/> * 需要注意的是由于YOLO 的网站是国外的，模型的权重文件有几百M，下载的速度比较慢如果直接用浏览器下载的话有可能断连，我推荐用wget命令下载； * 测试图像的准备，从yolo 的git网站可以下载到原始的dog 和horses的图像，但是这些图片的并不是416*416的尺寸，在Ubuntu上可以用GIMP软件，安装命令：`sudo apt-get install gimp`; 安装好后可以打开你要的图像，对其进行修改； ## 3、模型转换 * 导入模型转换微芯原支持的模型和权重文件格式命令如下：`pegasus import darknet --model yolov3.cfg --weights yolov3.weights --output-model yolov3.json --output-data yolov3.data` * 使用以上的命令将生成两个文件，分别为：yolov3.json 和 yolov3.data * <ignore_js_op> <img style="cursor:pointer;" id="aimg_662406" aid="662406" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/171846wfoc1407xs74sg97.png" file="data/attachment/forum/202212/04/171846wfoc1407xs74sg97.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662406_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-18-26屏幕截图.png</strong> <em class="xg1">(271.49 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662406" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662406&handlekey=savephoto_662406">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:18 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> * <ignore_js_op> <img style="cursor:pointer;" id="aimg_662407" aid="662407" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/172011gr08hpjfozofir8d.png" file="data/attachment/forum/202212/04/172011gr08hpjfozofir8d.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662407_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-19-47屏幕截图.png</strong> <em class="xg1">(115.79 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662407" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662407&handlekey=savephoto_662407">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:20 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> * 创建YML文件，输入命令： `pegasus generate inputmeta --model yolov3.json --input-meta-output yolov3_inputmeta.yml` `pegasus generate postprocess-file --model yolov3.json --postprocess-file-output yolov3_postprocessmeta.yml` <ignore_js_op> <img style="cursor:pointer;" id="aimg_662409" aid="662409" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/173929pgi9ud57xb299dix.png" file="data/attachment/forum/202212/04/173929pgi9ud57xb299dix.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662409_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-37-21屏幕截图.png</strong> <em class="xg1">(64.65 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662409" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662409&handlekey=savephoto_662409">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:39 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> <ignore_js_op> <img style="cursor:pointer;" id="aimg_662408" aid="662408" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/173929olrga3eztwzjgxrv.png" file="data/attachment/forum/202212/04/173929olrga3eztwzjgxrv.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662408_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-36-48屏幕截图.png</strong> <em class="xg1">(80 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662408" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662408&handlekey=savephoto_662408">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:39 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> * 量化 生成下量化表文件，使用uint8非对称量化，修改 --batch-size 参数为你的 dataset.txt 里提供的图片数量, 我使用的是两张图像，输入量化的命令是： `pegasus quantize --model yolov3.json --model-data yolov3.data --batch-size 2 --device CPU --with-input-meta yolov3_inputmeta.yml --rebuild --model-quantize yolov3.quantize --quantizer asymmetric_affine --qtype uint8` <ignore_js_op> <img style="cursor:pointer;" id="aimg_662410" aid="662410" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/174220t0rqkj0kr64tao6r.png" file="data/attachment/forum/202212/04/174220t0rqkj0kr64tao6r.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662410_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-42-00屏幕截图.png</strong> <em class="xg1">(179.75 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662410" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662410&handlekey=savephoto_662410">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:42 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> * 预推理 利用前文的量化表执行预推理，得到推理 tensor，yolov3 是 1 输入 3 输出网络，所以一共产生了 4 个 tensor `pegasus inference --model yolov3.json --model-data yolov3.data --batch-size 2 --dtype quantized --model-quantize yolov3.quantize --device CPU --with-input-meta yolov3_inputmeta.yml --postprocess-file yolov3_postprocessmeta.yml` <ignore_js_op> <img style="cursor:pointer;" id="aimg_662411" aid="662411" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/174604g4zsxsxo4fwyofyf.png" file="data/attachment/forum/202212/04/174604g4zsxsxo4fwyofyf.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662411_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-45-04屏幕截图.png</strong> <em class="xg1">(209.54 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662411" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662411&handlekey=savephoto_662411">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:46 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> <ignore_js_op> <img style="cursor:pointer;" id="aimg_662412" aid="662412" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/174956w0r40gvxij0hxv2r.png" file="data/attachment/forum/202212/04/174956w0r40gvxij0hxv2r.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662412_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-49-36屏幕截图.png</strong> <em class="xg1">(128.49 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662412" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662412&handlekey=savephoto_662412">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:49 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> * 导出模板代码与模型 命令`pegasus export ovxlib --model yolov3.json --model-data yolov3.data --dtype quantized --model-quantize yolov3.quantize --batch-size 2 --save-fused-graph --target-ide-project 'linux64' --with-input-meta yolov3_inputmeta.yml --output-path ovxilb/yolov3/yolov3prj --pack-nbg-unify --postprocess-file yolov3_postprocessmeta.yml --optimize "VIP9000PICO_PID0XEE" --viv-sdk ${VIV_SDK}` <ignore_js_op> <img style="cursor:pointer;" id="aimg_662415" aid="662415" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/175515wdbabjzhjheb33ba.png" file="data/attachment/forum/202212/04/175515wdbabjzhjheb33ba.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662415_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-49-14屏幕截图.png</strong> <em class="xg1">(189.48 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662415" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662415&handlekey=savephoto_662415">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:55 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> <ignore_js_op> <img style="cursor:pointer;" id="aimg_662413" aid="662413" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/175423n0tor706u78x8raj.png" file="data/attachment/forum/202212/04/175423n0tor706u78x8raj.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662413_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-52-49屏幕截图.png</strong> <em class="xg1">(166.62 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662413" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662413&handlekey=savephoto_662413">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:54 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> 文件夹下最终的文件如下： <ignore_js_op> <img style="cursor:pointer;" id="aimg_662414" aid="662414" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/175423txnrbcl1zb4mnnbc.png" file="data/attachment/forum/202212/04/175423txnrbcl1zb4mnnbc.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662414_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 17-53-23屏幕截图.png</strong> <em class="xg1">(29.8 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662414" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662414&handlekey=savephoto_662414">保存到相册</a> </p> <p class="xg1 y">2022-12-4 17:54 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op> * 生成的模板文件如下： <ignore_js_op> <img style="cursor:pointer;" id="aimg_662416" aid="662416" src="static/image/common/none.gif" onclick="zoom(this, this.getAttribute('zoomfile'), 0, 0, '0')" zoomfile="data/attachment/forum/202212/04/180153if5hi78q067h77qq.png" file="data/attachment/forum/202212/04/180153if5hi78q067h77qq.png.thumb.jpg" inpost="1" onmouseover="showMenu({'ctrlid':this.id,'pos':'12'})" /> <div class="tip tip_4 aimg_tip" id="aimg_662416_menu" style="position: absolute; display: none" disautofocus="true"> <div class="xs0"> <p><strong>2022-12-04 18-00-33屏幕截图.png</strong> <em class="xg1">(43.72 KB, 下载次数: 0)</em></p> <p> <a href="javascript:;" class="loginf" >下载附件</a> <a href="javascript:;" onclick="showWindow(this.id, this.getAttribute('url'), 'get', 0);" id="savephoto_662416" url="home.php?mod=spacecp&ac=album&op=saveforumphoto&aid=662416&handlekey=savephoto_662416">保存到相册</a> </p> <p class="xg1 y">2022-12-4 18:01 上传</p> </div> <div class="tip_horn"></div> </div> </ignore_js_op>

lugl4313820

谢谢分享，辛苦了。