Since 18 of December 2019 conferences.iaea.org uses Nucleus credentials. Visit our help pages for information on how to Register and Sign-in using Nucleus.
13-17 May 2019
Daejeon, Republic of Korea
Europe/Vienna timezone
Meeting Material is now available and accessible from the left-menu

Navigational Data Management - A general approach to representation and exploitation of relationships in scientific data sets

15 May 2019, 11:40
20m
Daejeon, Republic of Korea

Daejeon, Republic of Korea

Board: O/6-3
Oral (Plenary Session) Database Techniques for Information Storage and Retrieval Plenary Oral

Speaker

Mr Joshua Stillerman (MIT Plasma Science and fusion Center)

Description

Across research disciplines, the size, complexity, and heterogeneity of data sets is growing rapidly. Large projects are often long-running collaborations between evolving groups of researchers. Integrating and documenting these large heterogeneous data collections is a requirement for these data to be exploited, and for them to retain their value and meaning over time. The traditional approach to these data management problems has been to have hard- coded, application-specific solutions. The Navigational Data Management (NDM) project provides a general solution that can be applied regardless of the science domain. NDM represents data and annotations as generalized objects, with relationships stored as labeled property graphs. Universal Resource Identifiers (URIs) provide a mechanism to refer to external data objects like files, MDSplus records, or drawings. The system stores metadata and data schemas and application behaviors as first class objects, allowing them to be modified, added to, and even annotated as the needs of the research group evolve. This new toolset is being applied to initial projects at several institutions as its development continues. NDM is coded as a single page application (SPA) using modern javascript front-end tools and a graph database as the back-end.

NDM was developed using an informal agile, prototype and iterate methodology. We will lay out the overall project design and how it changed in response to both technical challenges and initial user input. As the set of use cases, objects and relationship types grows, we revisit and generalize the software to accommodate them. This process will continue in order to become a system that can be applied across science domains and applications.

Primary author

Mr Joshua Stillerman (MIT Plasma Science and fusion Center)

Co-authors

Dr Martin Greenwald (MIT Plasma Science and Fusion Center) Dr John Wright (MIT Plasma Science and Fusion Center) Mr Jason Stillerman (MIT Plasma Science and Fusion Center)

Presentation Materials