November 21, 2006 L-Store Planning Meeting (VU)

Attending

• Hagewood (Nevoa)
• Brown, Dawson, de Ledesma, Sheldon, Tackett (VU)

Meeting Goal

Develop an initial strategy for development and releases of L-Store software. There was also some discussion of planned hardware deployment for the near term.

L-Store Releases and Features

L-Store Release 0.8 --- December 4 REDDnet@I2 meeting

• API documentation will be provided
• L-Store Commands Implemented:
  • mkdir
  • ls
  • write
  • read
  • help?
• Demonstration similar to SC06 will be made at REDDnet@I2 meeting.
• Clients will be made available for installation to attendees at REDDnet@I2
  • for user testing and application development
  • files written to depots should be considered scratch
• Server and Depot software will not be made available at this point.
• Bugs: a dozen or so bugs were discovered at SC06. As many of these as can be fixed will be, the rest will be fixed by "0.9" release.
• ACCRE will work with Med Center Staff (Leibler/Proteomics) to begin the process of migrating them over to using L-Store instead of ADIC
• StorCor/WebDav interface (Hunter)
  • This interface will work with existing depots
  • Software will be demo-ed at REDDnet@I2
  • Full integration with L-Store will likely not be complete at this stage

L-Store Release 0.9 --- End of January 2007

• Physical delete command will be implemented
• Remaining SC06 bugs will be fixed, plus any new ones discovered
• The meta-data server will be set up on a mirrored-raid device for fault tolerance
• Full L-Store/StorCor interoperability will be implemented
• Server/Depot software will be made available, but only to users willing to work closely with ACCRE staff supervision.
• Full scale testing of ADIC replacement for Proteomics will begin

L-Store Release 1.0 --- May/June 2007

• User Manual and Server Manual will be made available
• Actual release date will be re-evaluated in January of 2007
• Fault tolerance
  • recover from lost metadata (I am not sure what mechanism will be?)
  • If a depot dies, file metadata will be automatically reconstituted for those files where possible and unrecoverable files will be deleted from the system.
• Switch Proteomics over to L-Store, replace ADIC system.
• Real Server and Depot installer
• Authentication and Security features enabled
  • need to spell out more specifically what
• Load balancing on the meta-data servers will be implemented
• Monitoring system: an initial version from Hunters group will be integrated

IBP Development???

• Hunter will have two interns from Sun, he will have them work on the IBP software, convering it to Java.
• Larry has requested input on what is done
• will provide a lot more depot monitoring

Near-Term Hardware Deployment

• Validation, Verification, and Performance Testing Depot
  • We will deploy 20 of the Capricorn Depots in a single system that can be used for validation, verification, and performance testing.
  • This system will be for developers use only, and it can be taken down at any time. Software can be updated at any time.
  • Nightly, the L-Store development release code will be built, installed, and tested with Clyde. This may take a few months to get going smoothly.
• User System
  • The remainder of the systems (20) will be deployed as a user facility.