Regression Analysis for profiling L-Store metadata throughput handling: Difference between revisions
Jump to navigation
Jump to search
(5 intermediate revisions by 2 users not shown) | |||
Line 22: | Line 22: | ||
{| class="wikitable" style="text-align:center" | {| class="wikitable" style="text-align:center" | ||
|- | |- | ||
!bgcolor=red | <font color=white> Type of Test || bgcolor=blue | <font color=white> Number of files || bgcolor=grey | <font color=white> Average File Size (MB) || bgcolor=grey | <font color=white> Average | !bgcolor=red | <font color=white> Type of Test || bgcolor=blue | <font color=white> Number of files || bgcolor=grey | <font color=white> Average File Size (MB) || bgcolor=grey | <font color=white> Average Transfer Time (sec) || bgcolor=grey | <font color=white> Average Throughput (MB/sec)|| bgcolor=grey | <font color=white> Median Transfer Time (sec) || bgcolor=grey | <font color=white> Maximum Transfer Time (sec) || bgcolor=grey | <font color=white> Std Deviation on Transfer Time | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>0.001|| bgcolor=grey | <font color=white>2.8|| bgcolor=grey | <font color=white>2.7|| bgcolor=grey | <font color=white>11.0|| bgcolor=grey | <font color=white>0.63 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>0.001|| bgcolor=grey | <font color=white>2.8|| bgcolor=grey | <font color=white> 0.0003|| bgcolor=grey | <font color=white>2.7|| bgcolor=grey | <font color=white>11.0|| bgcolor=grey | <font color=white>0.63 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>0.5|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>10.0|| bgcolor=grey | <font color=white>0.45 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>0.5|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white> 0.16||bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>10.0|| bgcolor=grey | <font color=white>0.45 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>1.0|| bgcolor=grey | <font color=white>3.5|| bgcolor=grey | <font color=white>3.4|| bgcolor=grey | <font color=white>4.5|| bgcolor=grey | <font color=white>0.22 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>1.0|| bgcolor=grey | <font color=white>3.5|| bgcolor=grey | <font color=white> 0.29||bgcolor=grey | <font color=white>3.4|| bgcolor=grey | <font color=white>4.5|| bgcolor=grey | <font color=white>0.22 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>50.0|| bgcolor=grey | <font color=white>8.4|| bgcolor=grey | <font color=white>8.3|| bgcolor=grey | <font color=white>10.0|| bgcolor=grey | <font color=white>0.49 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>50.0|| bgcolor=grey | <font color=white>8.4|| bgcolor=grey | <font color=white> 5.95||bgcolor=grey | <font color=white>8.3|| bgcolor=grey | <font color=white>10.0|| bgcolor=grey | <font color=white>0.49 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>100.0|| bgcolor=grey | <font color=white>13.0|| bgcolor=grey | <font color=white>13.0|| bgcolor=grey | <font color=white>16.0|| bgcolor=grey | <font color=white>0.8 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>100.0|| bgcolor=grey | <font color=white>13.0|| bgcolor=grey | <font color=white> 7.69||bgcolor=grey | <font color=white>13.0|| bgcolor=grey | <font color=white>16.0|| bgcolor=grey | <font color=white>0.8 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>150.0|| bgcolor=grey | <font color=white>18.0|| bgcolor=grey | <font color=white>18.0|| bgcolor=grey | <font color=white>19.0|| bgcolor=grey | <font color=white>0.87 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>150.0|| bgcolor=grey | <font color=white>18.0|| bgcolor=grey | <font color=white> 8.33||bgcolor=grey | <font color=white>18.0|| bgcolor=grey | <font color=white>19.0|| bgcolor=grey | <font color=white>0.87 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>200.0|| bgcolor=grey | <font color=white>23.0|| bgcolor=grey | <font color=white>23.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>1.3 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>200.0|| bgcolor=grey | <font color=white>23.0|| bgcolor=grey | <font color=white> 8.69||bgcolor=grey | <font color=white>23.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>1.3 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>250.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>47.0|| bgcolor=grey | <font color=white>1.2 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>250.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white> 9.26||bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>47.0|| bgcolor=grey | <font color=white>1.2 | ||
|- | |- | ||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>500.0|| bgcolor=grey | <font color=white>54.0|| bgcolor=grey | <font color=white>53.0|| bgcolor=grey | <font color=white>78.0|| bgcolor=grey | <font color=white>4.8 | !bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>500.0|| bgcolor=grey | <font color=white>54.0|| bgcolor=grey | <font color=white> 9.26||bgcolor=grey | <font color=white>53.0|| bgcolor=grey | <font color=white>78.0|| bgcolor=grey | <font color=white>4.8 | ||
|- | |||
!bgcolor=red | <font color=white>profile_upload|| bgcolor=blue | <font color=white>30|| bgcolor=grey | <font color=white>1000.0|| bgcolor=grey | <font color=white>100.0|| bgcolor=grey | <font color=white> 10||bgcolor=grey | <font color=white>100.0|| bgcolor=grey | <font color=white>120.0|| bgcolor=grey | <font color=white>4.0 | |||
|- | |- | ||
|} | |} |
Latest revision as of 10:03, 23 June 2006
Objective
As part of some of the initial testing with L-Store these tests are attempting to create a base reference model for meta data handling with L-Store. Specifically we are interested in seeing that as we increase from very small file sizes to large file sizes whether the latency profile is a linear fit or a non-linear fit.
Parameters
1. File Size: 1KB, 500KB, 1MB, 50 MB, 100MB, 150MB, 200MB, 250MB
2. Number of Files: 30 files
3. Number of threads: 10 threads
Results
- Number of Threads: 10
- Block Size : 1MB (Each Slice is 1MB)
- Number of Files : 30
- Current Status: In progress
- Time of Completion:
Type of Test | Number of files | Average File Size (MB) | Average Transfer Time (sec) | Average Throughput (MB/sec) | Median Transfer Time (sec) | Maximum Transfer Time (sec) | Std Deviation on Transfer Time |
---|---|---|---|---|---|---|---|
profile_upload | 30 | 0.001 | 2.8 | 0.0003 | 2.7 | 11.0 | 0.63 |
profile_upload | 30 | 0.5 | 3.0 | 0.16 | 3.0 | 10.0 | 0.45 |
profile_upload | 30 | 1.0 | 3.5 | 0.29 | 3.4 | 4.5 | 0.22 |
profile_upload | 30 | 50.0 | 8.4 | 5.95 | 8.3 | 10.0 | 0.49 |
profile_upload | 30 | 100.0 | 13.0 | 7.69 | 13.0 | 16.0 | 0.8 |
profile_upload | 30 | 150.0 | 18.0 | 8.33 | 18.0 | 19.0 | 0.87 |
profile_upload | 30 | 200.0 | 23.0 | 8.69 | 23.0 | 27.0 | 1.3 |
profile_upload | 30 | 250.0 | 27.0 | 9.26 | 27.0 | 47.0 | 1.2 |
profile_upload | 30 | 500.0 | 54.0 | 9.26 | 53.0 | 78.0 | 4.8 |
profile_upload | 30 | 1000.0 | 100.0 | 10 | 100.0 | 120.0 | 4.0 |