新的 GazeSense™ ROS 插件可用

机器人研究人员和开发人员现在可以依靠 GazeSense™ 桥来测量对 ROS 中物体的注意力

 

Gazesense - 深度感应相机的眼动追踪软件

机器人操作系统标志

 

GazeSense is an application that provides 3D eye tracking by relying on consumer 3D sensors. GazeSense allows users to define virtual 3D objects concerning the camera and world coordinate systems and measure people’s attention towards the objects.

通过新发布的 GazeSense ROS 插件,GazeSense 桥将通常通过自定义 API 提供的实时眼睛和注意力跟踪数据公开到机器人操作系统 (ROS) 中。

 

What Is 活性氧?

ROS is a flexible Robot Operating System framework for writing robot software. It’s a collection of tools, libraries, and conventions that aim to simplify the task of creating complex and robust robot behaviors across a wide variety of robotic platforms.

GazeSense 将在 ROS 上做什么? It offers a mechanism for perception, where GazeSense provides robotics researchers and developers with real-time signals on attention towards objects. One would be able to tell if a person interacting with the robot is looking at either of the defined objects or not or looking at the robot itself. The attention label (‘what is the person looking at’) is then published as a topic into the ROS framework. 

Sensing attention is particularly useful for people working in the human-robot interaction (HRI) as attention sensing is critical for understanding engagement intention and for building rapport.

The first iteration of the GazeSense ROS plugin is focused on a hard-coded version to allow a user to:

  • 定义对象并将它们输入 GazeSense;
  • 捕获对对象的注意力的 GazeSense 信号并将其发布到 ROS 中。

弹钢琴的人形机器人‘Robot playing piano,’ Photo by 弗兰克 V.不飞溅

If you are looking for more features, like, for example, a more ‘plug-n-play’ object definition for the GazeSense ROS bridge, reach out to us to let us know via an email to 产品@eyeware.tech 或只需在我们的 想法和要求 Trello Board.

 

我在哪里可以获得 GazeSense ROS 插件?

Gaze Sense is hosted on a Github repository for easy access and view.

Please take me to the GazeSense ROS plugin!

 

为什么我们要为所有使用 ROS 的机器人研究人员和开发人员创建一个 GazeSense ROS 插件?

Because creating genuinely robust and general-purpose robot software is hard, and no one can hope to do it alone. We are thus joining the world-class, collaborative robotics software development platform and vibrant ROS community of roboticists to help produce robust solutions and build on each other’s work.

The core of ROS is licensed under the standard three-clause BSD license, a very permissive open license that allows for reuse in commercial and closed source products.

你知道吗? Through their AWS RoboMaker, Amazon is using ROS to offer developers a place to develop and test robotics applications. If curious, you can explore ROS’s entire impactful history from 维基百科 by scrolling down to ‘milestones.’

Wanna have a GazeSense plugin available for another type of development platform or framework out there? Do you work with Unity, Matlab, or other niche platforms? Submit your preferred choice to our 想法和请求板 或通过电子邮件发送至 产品@eyeware.tech, and your voice will be heard! We aim to support your efforts and bring  3D eye tracking to real-world applications with easy integrations.

提交新平台插件请求!