Changes between Version 54 and Version 55 of SatelliteBigData

Show
Ignore:
Timestamp:
2009/03/20 14:33:42 (15 years ago)
Author:
severin
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • SatelliteBigData

    v54 v55  
    7171In addition to the storage problem there is the issue of actually submitting our new data to public resources when publishing.  Our datasets are getting very big and FTP often is not good enough.  This forces many of us to have to submit data on DVD via FedEx for example.  This is not optimal. 
    7272 
    73 [Jessica: can you add your vertical red line to this as well?] 
     73In systems biology and transcriptomics (like the work of RIKEN-OSC), there is a need to collect lots of small data, but the process of network analysis and molecular function adds aditional structure onto this primary data.  Since this is still such a young area of research, we need to keep the primary data available since many of our ideas many change over time.  If we would compress this data and throw it away, then we are limiting our future ability to re-evaluate our theories in the face of both new and old data. But at the same time as our analyses become more sophisticated, we may need to work with larger and larger portions of this primary data.  This leads to a situation where we are working with both many small things, and many large things making this domain space big on both axes. -jessica 
    7474 
    7575==== Querying ====