Aug 16, 2007: Difference between revisions
| Line 29: | Line 29: | ||
There was a discussion of the need to accelerate the development of our "view" technology, so that, as a part of the demonstration, the audience could see what LN technology, such as L-Store, was doing under the covers. LoRS View has proved to be effective for this purpose in the past, but it hasn't been adapted to work with L-Store and needs some updating in any case. Larry has examined the possibility of porting or otherwise leveraging LoRS View for this purpose. PR and his group are going to give it a try. There was a discussion of using the Google maps API to do the display. Larry has distributed what he had on the project, which included Chris's description of how LoRS View does what it does. | There was a discussion of the need to accelerate the development of our "view" technology, so that, as a part of the demonstration, the audience could see what LN technology, such as L-Store, was doing under the covers. LoRS View has proved to be effective for this purpose in the past, but it hasn't been adapted to work with L-Store and needs some updating in any case. Larry has examined the possibility of porting or otherwise leveraging LoRS View for this purpose. PR and his group are going to give it a try. There was a discussion of using the Google maps API to do the display. Larry has distributed what he had on the project, which included Chris's description of how LoRS View does what it does. | ||
* '''VOIC/Peru (Santi)''' | |||
Not much to report here, except that our depot in Lima didn't go down during the recent earthquake. | |||
* '''Vanderbilt TV News Archive (Alan?)''' | |||
We're still waiting on the Library to get their system set up on their end. | |||
* '''CMS/RHIC (Dan)''' | |||
Need programs up and running to receive data. This requires SRM and GridFTP compatability. Dan has hooked up LoRS via a plugin in to GridFTP. The CMS jobs that come from Vampire will run on local depots. | |||
The goal is to get hooked up into CMS infrastructure w/o anyone having to care that we’re using L-Store on the back end. We’re building a back end for GridFTP. | |||
We and to be able to register and receive the data. | |||
Stage 2: They want to be able to show the use of unteathered data. Want to move away from the model that requires moving the data whenever you want to compute on it. | |||
Main issue is with the exNodes. | |||
Working with the ROOT developers. Most jobs read 4 to 10% of the file. What’s killing performance is the latency, but they should be able to prefetch the data you need. The current IBP protocol doesn’t allow you | |||
Huadong may have code for an IBP client that will be required. | |||
* '''FACIT (Terry/others)''' | * '''FACIT (Terry/others)''' | ||
Revision as of 07:44, 23 August 2007
Coordinates
- Time: 10:00EST/9:00CST/7:00PST
- Conference #:510-665-5437 Meeting ID:7333
Attending
- Alan Tackett, Larry Dawson, Santi de Ledesma, Bobby Brown (Vanderbilt ACCRE, in Nashville)
- Dan Engh, Paul Sheldon (Vanderbilt Physics)
- Micah Beck, Terry Moore (UT)
- P.R. Blackwell, Diana Gunter (SFAU)
Agenda for today's call
LoDN Status (Micah)
LoDN is about ready to distribute; expect it to be deployed here at UT this weekend for a little more in service testing. Some of the main improvements include
- More predictable warming – where to put copies
- A lot of work has been done on security. ssh-http connections, the same certificate for signing the code and using the service.
Should be packaged up and ready for distribution by Aug. 30th.
Annual Report Status (Paul)
Paul is just getting this started and will be calling on the collaborators for contributions.
User Reports
- AmericaView (PR) - TexasView is planning to demo both at the Fall I2 meeting, America View fall conference (Sept. 19th and 20th) Elements of the plan include the following:
- Plan is to do what they did last year, but with more data. They need a few TB of space for this.
- They want use data from other states, which makes it all the more critical that they get a more stable and reliable storage infrastructure underneath them so that they won’t be able to upload repeatedly. Repeated uploads just won't be feasible if other people's data is being used.
- They’ll show speed of download. What they need is a stable place to store the demo data, and they want their new depots in place for this reason.
In terms of software, they need to look at the new L-Store code and API. The Vandy team reported that there were few, if any, changes to the API, so the TexasView software should still run. It was noted that there was enough in place to start using available depots. All the Vandy depots are available for them to test with. Santi will post information about using this infrastructure, which includes StoreCore and management software on the list. Duration is set to infinity. The Texas nodes have been ordered. Capricorn has it and will ship them to Vandy, probably end of next week.
There was a discussion of the need to accelerate the development of our "view" technology, so that, as a part of the demonstration, the audience could see what LN technology, such as L-Store, was doing under the covers. LoRS View has proved to be effective for this purpose in the past, but it hasn't been adapted to work with L-Store and needs some updating in any case. Larry has examined the possibility of porting or otherwise leveraging LoRS View for this purpose. PR and his group are going to give it a try. There was a discussion of using the Google maps API to do the display. Larry has distributed what he had on the project, which included Chris's description of how LoRS View does what it does.
- VOIC/Peru (Santi)
Not much to report here, except that our depot in Lima didn't go down during the recent earthquake.
- Vanderbilt TV News Archive (Alan?)
We're still waiting on the Library to get their system set up on their end.
- CMS/RHIC (Dan)
Need programs up and running to receive data. This requires SRM and GridFTP compatability. Dan has hooked up LoRS via a plugin in to GridFTP. The CMS jobs that come from Vampire will run on local depots. The goal is to get hooked up into CMS infrastructure w/o anyone having to care that we’re using L-Store on the back end. We’re building a back end for GridFTP. We and to be able to register and receive the data. Stage 2: They want to be able to show the use of unteathered data. Want to move away from the model that requires moving the data whenever you want to compute on it. Main issue is with the exNodes. Working with the ROOT developers. Most jobs read 4 to 10% of the file. What’s killing performance is the latency, but they should be able to prefetch the data you need. The current IBP protocol doesn’t allow you Huadong may have code for an IBP client that will be required.
- FACIT (Terry/others)
Upcoming Events
- Library of Congress meeting, Sept. 17
- Meeting in San Diego, Oct. 8th.
- Supercomputing 07
Milenium Copyright Issues
Deployment (Bobby)
- should be short
L-Store/Nevoa Software Development (Larry/Hunter)
- resource 0 problem progress?
- any other issues
All other business
- Micah's proposal for addressing certain security issues that might inhibit work with ORNL/TeraGrid.