FocalPoint: Adaptive Direct Manipulation for Selecting Small 3D Virtual Objects

Jiaju Ma, Jing Qian, Tongyu Zhou, and Jeff Huang

The Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT 2023)

Overview

We propose FocalPoint, a direct manipulation technique in smartphone augmented reality (AR) for selecting small densely-packed objects within reach, a fundamental yet challenging task in AR due to the required accuracy and precision. FocalPoint adaptively and continuously updates a cylindrical geometry for selection disambiguation based on the user's selection history and hand movements. This design is informed by a preliminary study which revealed that participants preferred selecting objects appearing in particular regions of the screen. We evaluate FocalPoint against a baseline direct manipulation technique in a 12-participant study with two tasks: selecting a 3 mm wide target from a pile of cubes and virtually decorating a house with LEGO pieces. FocalPoint was three times as accurate for selecting the correct object and 5.5 seconds faster on average; participants using FocalPoint decorated their houses more and were more satisfied with the result. We further demonstrate the finer control enabled by FocalPoint in example applications of robot repair, 3D modeling, and neural network visualizations.

Applications

FoamAR
Augmented Reality 3D Modeling App

Bibtex


@article{Ma2023focalpoint, author = {Ma, Jiaju and Qian, Jing and Zhou, Tongyu and Huang, Jeff}, title = {FocalPoint: Adaptive Direct Manipulation for Selecting Small 3D Virtual Objects}, year = {2023}, issue_date = {March 2023}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, volume = {7}, number = {1}, url = {https://doi.org/10.1145/3580856}, doi = {10.1145/3580856}, journal = {Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.}, month = {mar}, articleno = {22}, numpages = {26}, keywords = {augmented reality, adaptive selection technique, occluded targeting} }