Documents & Metadata go hand in hand with delivering a more usefully interactive experience for the author and reader.
Documents
Documents are where significant data and metadata is stored and are thus core to what interactions can be made available to the users.
We are initially dealing with the currently available document formats of PDF and to some degree HTML, as available in the ACM Digital Library.
We are also looking at what an Ideal Document might be.
Metadata
Metadata will underpin everything we do in this project since it is what makes clear to the system what data is what.
We are using the Visual-Meta approach but there is no reason to wrap this into JSON and other methods when useful.
Here is an introduction to how we can use this approach to get useful data out of a PDF to use in XR for enhanced views:
This uses Reader for macOS, developed by Frode Hegland, and should be accessible for any other developer who wants to use this approach. Work on this was privately funded by the Augmented Text Company and is not under this Sloan Foundation Project.