• Login
    View Item 
    •   Home
    • Massey University Departments
    • Institute of Natural and Mathematical Sciences
    • Research Letters in the Information and Mathematical Sciences
    • View Item
    •   Home
    • Massey University Departments
    • Institute of Natural and Mathematical Sciences
    • Research Letters in the Information and Mathematical Sciences
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Sparse cross-products of metadata in scientific simulation management

    Icon
    View/Open Full Text
    Sparse_Cross-Products_of_Metadata_in_Scientific_Simulation_Management.pdf (4.979Mb)
    Abstract
    Managing scientific data is by no means a trivial task even in a single site environment with a small number of researchers involved. We discuss some issues concerned with posing well-specified experiments in terms of parameters or instrument settings and the metadata framework that arises from doing so. We are particularly interested in parallel computer simulation experiments, where very large quantities of warehouse-able data are involved. We consider SQL databases and other framework technologies for manipulating experimental data. Our framework manages the the outputs from parallel runs that arise from large cross-products of parameter combinations. Considerable useful experiment planning and analysis can be done with the sparse metadata without fully expanding the parameter cross-products. Extra value can be obtained from simulation output that can subsequently be data-mined. We have particular interests in running large scale Monte-Carlo physics model simulations. Finding ourselves overwhelmed by the problems of managing data and compute ¿resources, we have built a prototype tool using Java and MySQL that addresses these issues. We use this example to discuss type-space management and other fundamental ideas for implementing a laboratory information management system.
    Citation
    James, H.A., Hawick, K.A. (2005), Sparse cross-products of metadata in scientific simulation management, Research Letters in the Information and Mathematical Sciences, 7, 89-115
    Date
    2005
    Author
    James, H.A.
    Hawick, K.A.
    Publisher
    Massey University
    URI
    http://hdl.handle.net/10179/4451
    Collections
    • Research Letters in the Information and Mathematical Sciences
    Metadata
    Show full item record

    Copyright © Massey University
    | Contact Us | Feedback | Copyright Take Down Request | Massey University Privacy Statement
    DSpace software copyright © Duraspace
    v5.7-2023.7-7
     

     

    Information PagesContent PolicyDepositing content to MROCopyright and Access InformationDeposit LicenseDeposit License SummaryTheses FAQFile FormatsDoctoral Thesis Deposit

    Browse

    All of MROCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    Copyright © Massey University
    | Contact Us | Feedback | Copyright Take Down Request | Massey University Privacy Statement
    DSpace software copyright © Duraspace
    v5.7-2023.7-7