多光谱3D成像方法
DOI:
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TH741

基金项目:

国家自然科学基金(51775200)项目资助


Multispectral 3D imaging method
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    已有3D成像方法难以实现单目、单帧图像条件下同时获取场景图像及深度信息,也不能兼具时间效率高、体积紧凑、能耗低等优点。为此,创新地提出多光谱3D成像方法,通过具有纵向色散的光学成像镜头与快照式多光谱图像传感器两部分构成图像采集系统,使用离焦深度还原算法获取深度信息。其基本原理为:首先,增强纵向色差光学镜头使得同一物点在不同光谱波段图像上的成像离焦程度不同;其次,快照式窄带多光谱图像传感器单帧曝光同时获取多幅窄带光谱图像;再通过离焦深度还原算法根据多光谱图像边缘梯度获取3D信息。实验采用纵向色散增强型光学成像系统及快照式多光谱相机捕获450±10 nm、 525±10 nm、620±10 nm 3通道光谱图像,对5 m内场景进行3D深度恢复,获得了深度误差不高于5 cm的测量结果。实验结果表明多光谱3D视觉方法可以实现单目、所提单帧图像的深度估计。该方法能同时获得视觉及深度信息且无需空间位置配准及预先深度刻度,单帧图像处理平均耗时0186 s,图像采集系统尺寸为120 mm×77 mm×65 mm,其工作功率约为10 W,兼具时间效率高、体积紧凑、能耗低等优点。因此,所提方法有望在无人驾驶及智能机器人等领域获得广泛应用。

    Abstract:

    The existing 3D imaging methods can hardly acquire both visual image and depth information of a scene using a single device and a single frame. They cannot have the merits of high efficiency, compact size, and low energy consumption at the same time. Therefore, this study proposes an innovative multispectral 3D imaging method. The method obtains depth from the defocused images, which are captured by an image capture system consisting of an optical imaging lens with longitudinal dispersion and a snapshot multispectral image sensor. Its basic principle is illustrated as follows. First, the inherent longitudinal chromatic aberration of an optical imaging system (especially the longitudinal dispersionenhanced one) makes the defocusing blurs vary with different spectral bands. Secondly, a snapshot narrowband multispectral image (SNBMSI) sensor is used to obtain multiple spectral images at each single imaging frame. Finally, the depth from defocusing algorithm is utilized to recover the 3D information from the edge gradients of multiple spectral images. Evaluation experiments are conducted using a chromatic dispersionenhanced optical imaging system and a SNBMSI camera to capture 450±10, 525±10 and 620±10 nm three spectral images to recover depth of objects that are within 5 m away from the camera. Experimental results suggest that error of depth recovery is no higher than 5 cm. The proposed multispectral 3D imaging method can realize depth estimation using a monocular and with a single frame image. The proposed method has capability of obtaining both visual and depth information without neither spatial registration nor precalibration of depth. The time of single frame 3D imaging time is about 0186 s. The size of the image capture system is 120 mm×77 mm×65 mm and the working power of the image capture system is about 10W. The advantages of the proposed method include high time efficiency, compact volume, and low energy consumption. Therefore, the proposed multispectral 3D imaging method can be widely used in unmanned driving and intelligent robots.

    参考文献
    相似文献
    引证文献
引用本文

蒋威,易定容,孔令华,余卿,崔长彩.多光谱3D成像方法[J].仪器仪表学报,2019,40(8):140-147

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2022-02-22
  • 出版日期:
文章二维码