Demo Link: alpha22724
https://code.futuretextlab.info/andrew/alpha22724/
Citation Text Block: Instead of a flat panel of text, the text block is now curved slightly in an arc around the user. Vertical swiping is the same as the previous test. Horizontal swiping has been added with functionality similar to alpha20724. Vertical and horizontal swipes are controlled by an open palm, with the hand orientation determining the type of swipe (see video). This currently only works with one hand, opposite the wrist sphere, with plans to implement on both hands in the future.
Text Distance Slider: A new slider has been added to the main side of the menu prism which controls the distance of the text. Closer text wraps tighter around the user, while further text unwraps into a flatter display. Swiping still works at all distances, but does require more precision at further distances (improper finger tracking may make this difficult, make sure your environment is well lit).
Text Selection Tool: Implemented a first draft of a selection tool. Right now, the tool is active by default and manifests into your hand as you pinch your index and thumb together. When pointing at text, you can fully squeeze your thumb and index together and hold to draw a selection around bits of text. Release to complete the selection. You cannot yet do anything with the selected text, but it is returned into the console as a readable string.
Known Bugs: The text selection is still rather buggy, with several known issues. It currently only works at the default text distance. Scaling the text display ends up offsetting the displayed highlight from the text (but should still export the correct text). Poor finger tracking makes the selection tool rather shaky, something that improves with good lighting but remains an issue outside our control. In addition, selecting large amounts of text causes a heavy drop in frame rate until the selection is complete.
Background Work: Early attempts have been started with collecting data from an html version of an ACM paper. On page load, the console prints a series of numbers, which are citations listed in the order they are found in document 3511095.3531271.
Refinements for next build
Text selection tool
- Make possible to turn on and off: Point to turn on laser pointer/selection at a distance.
Tap to activate pointed link or select pointed text. Point again to disable this ‘mode’. (Pointing is not a tool, it’s a gesture) - Change design to less be blue.
- Try design with no laser, only pointing and seeing selection, and invisible laser being a bit higher up, aligned with top of hand.
Control Panel
- Decide what controls to have where. (design issue)
Hand Tracking
- Polish interaction motions.
Small update
https://code.futuretextlab.info/andrew/alpha22924/
Main things changed would be the new ‘three-finger-curl’ to activate the pointer, the removal of the highlighter, change of selector tool color, hand motion smoothing, and changes to visuals while selecting. Still no functionality for selecting, but the laser dot plays a little ‘click’ animation when you tap your fingers.