动态图卷积网络用于点云学习

Dynamic Graph CNN for Learning on Point Clouds

迈克尔·布朗斯坦 Michael Bronstein · Imperial College · 2018-01-24 · arXiv:1801.07829 ↗ · 被引 7642

打开互动全文版(逐段中英对照 + 图/公式 + 论文问答)→

摘要 · Abstract

点云提供了一种灵活的几何表示,适用于计算机图形学中的无数应用;它们也是大多数 3D 数据采集设备的原始输出。尽管在图形学和视觉中早已提出了点云上的手工设计特征,但最近卷积神经网络在图像分析中的巨大成功表明,将 CNN 的见解适应到点云世界是有价值的。点云本质上缺乏拓扑信息,因此设计一个模型来恢复拓扑可以丰富点云的表示能力。为此,我们提出了一个新的神经网络模块,称为 EdgeConv,适用于基于 CNN 的点云高级任务,包括分类和分割。EdgeConv 作用于网络中每层动态计算的图上。它是可微的,可以插入到现有架构中。与在外部空间中操作或独立处理每个点的现有模块相比,EdgeConv 具有几个吸引人的特性:它结合了局部邻域信息;它可以堆叠应用以学习全局形状属性;在多层级系统中,特征空间中的亲和性捕获了原始嵌入中可能长距离的语义特征。我们在标准基准测试(包括 ModelNet40、ShapeNetPart 和 S3DIS)上展示了我们模型的性能。

Point clouds provide a flexible geometric representation suitable for countless applications in computer graphics; they also comprise the raw output of most 3D data acquisition devices. While hand-designed features on point clouds have long been proposed in graphics and vision, however, the recent overwhelming success of convolutional neural networks (CNNs) for image analysis suggests the value of adapting insight from CNN to the point cloud world. Point clouds inherently lack topological information so designing a model to recover topology can enrich the representation power of point clouds. To this end, we propose a new neural network module dubbed EdgeConv suitable for CNN-based high-level tasks on point clouds including classification and segmentation. EdgeConv acts on graphs dynamically computed in each layer of the network. It is differentiable and can be plugged into existing architectures. Compared to existing modules operating in extrinsic space or treating each point independently, EdgeConv has several appealing properties: It incorporates local neighborhood information; it can be stacked applied to learn global shape properties; and in multi-layer systems affinity in feature space captures semantic characteristics over potentially long distances in the original embedding. We show the performance of our model on standard benchmarks including ModelNet40, ShapeNetPart, and S3DIS.

核心贡献 · Key contributions

局限 · Limitations

论文章节 · Sections(共 15)

阅读逐段中英对照全文 →