融合姿态引导与频域补偿的中远距离双视角视线测量方法
DOI:
CSTR:
作者:
作者单位:

1.上海大学机电工程与自动化学院上海200444; 2.上海市电站自动化技术重点实验室上海200444

作者简介:

通讯作者:

中图分类号:

TP391TH86

基金项目:

国家重点研发计划(2023YFF1203503)项目资助


Mid-to-long-range dual-view gaze measurement via pose guidance and frequency-domain compensation
Author:
Affiliation:

1.School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China; 2.Shanghai Key Laboratory of Power Station Automation Technology, Shanghai 200444, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对中远距离(1.0~3.0 m)视线测量中因成像尺度退化与大角度自遮挡导致的精度衰退问题,提出一种融合姿态引导与频域尺度补偿的双视角视线测量方法。首先,为突破单一近场数据集的验证局限,构建了中远距离双视角时空对齐数据集,完整保留了真实自然状态下眼-头动态耦合的复杂机理,为视线测量算法提供可靠的验证基准。其次,设计了头部姿态引导的动态特征调节模块,利用连续的6D姿态表征构建高维空间注意力语义掩码,通过自顶向下的先验约束,隔离并抑制因侧视透视畸变与物理遮挡引入的空间噪声。随后,为克服中远距离下眼部特征尺度急剧退化与拓扑细节丢失的瓶颈,提出尺度自适应高频补偿模块,通过双眼像素间距动态感知物理观测距离,并以此驱动尺度嵌入,结合频域二维离散余弦变换,自底向上重构在光学低通衰减中受损的高频眼动边界特征。最后,引入基于不确定性路由的多视角协同融合策略,在保障多视角空间几何物理一致性的基础上,该策略能够对受噪声干扰严重的单侧降质数据进行动态门控降权,实现跨异构视角特征的深度互补。实验结果表明,该方法在自建受控验证集与ETH-XGaze通用数据集上的平均角度误差分别降至3.52°与2.75°,展现出更优的测量精度与鲁棒性。

    Abstract:

    To address accuracy degradation caused by imaging scale decay and large-angle self-occlusion in mid-to-long-range (1.0~3.0 m) gaze measurement, a dual-view method integrating pose guidance and frequency-domain compensation is proposed. First, to overcome the limitations of near-field datasets, a mid-to-long-range dual-view spatiotemporally aligned dataset that preserves natural eye-head dynamic coupling mechanisms is constructed to provide a reliable benchmark. Second, a head pose-guided feature selection module is designed. By leveraging continuous 6D pose representations to generate spatial attention masks, it uses top-down prior constraints to isolate and suppress spatial noise from perspective distortion and occlusion. Subsequently, to tackle severe scale degradation and topological detail loss, a scale-adaptive high-frequency reconstruction compensation module is proposed. It dynamically infers the physical observation distance via inter-ocular pixel spacing to drive scale embeddings, and employs the 2D discrete cosine transform to bottom-up reconstruct attenuated high-frequency ocular boundary features in a bottom-up manner. Finally, an uncertainty-aware weight learning fusion strategy is introduced. While ensuring spatial geometric consistency, it dynamically penalizes unilaterally degraded views to achieve deep cross-view feature complementation. Experimental results demonstrate that the method reduces the mean angular error to 3.52° and 2.75° on the custom and ETH-XGaze datasets, respectively, exhibiting superior measurement accuracy and robustness.

    参考文献
    相似文献
    引证文献
引用本文

杨傲雷,梅尹颉,杨帮华,苗中华.融合姿态引导与频域补偿的中远距离双视角视线测量方法[J].仪器仪表学报,2026,47(7):165-175

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-09-24
  • 出版日期:
文章二维码