Regression Analysis for profiling L-Store metadata throughput handling: Difference between revisions

From ReddNet
Jump to navigation Jump to search
 
(21 intermediate revisions by 4 users not shown)
Line 14: Line 14:
<font color = maroon>
<font color = maroon>
* Number of Threads: 10
* Number of Threads: 10
* Block Size : 1MB (Each Slice is 1MB)
* Number of Files : 30
* Number of Files : 30
* Current Status: In progress
* Current Status: In progress
Line 21: Line 22:
{| class="wikitable" style="text-align:center"
{| class="wikitable" style="text-align:center"
|-
|-
!bgcolor=red | <font color=white> Type of Test  ||    bgcolor=blue | <font color=white> Number of files || bgcolor=grey | <font color=white> Average File Size (MB) || bgcolor=grey | <font color=white> Average Latency (sec) || bgcolor=grey | <font color=white> Median Latency (sec) || bgcolor=grey | <font color=white> Maximum Latency (sec) || bgcolor=grey | <font color=white> Std Deviation on Latency
!bgcolor=red | <font color=white> Type of Test  ||    bgcolor=blue | <font color=white> Number of files || bgcolor=grey | <font color=white> Average File Size (MB) || bgcolor=grey | <font color=white> Average Transfer Time (sec) || bgcolor=grey | <font color=white> Average Throughput (MB/sec)|| bgcolor=grey | <font color=white> Median Transfer Time (sec) || bgcolor=grey | <font color=white> Maximum Transfer Time (sec) || bgcolor=grey | <font color=white> Std Deviation on Transfer Time
|-
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>0.001|| bgcolor=grey | <font color=white>2.8|| bgcolor=grey | <font color=white>2.7|| bgcolor=grey | <font color=white>11.0|| bgcolor=grey | <font color=white>0.63
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>0.001|| bgcolor=grey | <font color=white>2.8|| bgcolor=grey | <font color=white> 0.0003|| bgcolor=grey | <font color=white>2.7|| bgcolor=grey | <font color=white>11.0|| bgcolor=grey | <font color=white>0.63
|-
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>0.5|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>10.0|| bgcoprofile_uploadlor=grey | <font color=white>0.45
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>0.5|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white> 0.16||bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>10.0|| bgcolor=grey | <font color=white>0.45
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>1.0|| bgcolor=grey | <font color=white>3.5|| bgcolor=grey | <font color=white> 0.29||bgcolor=grey | <font color=white>3.4|| bgcolor=grey | <font color=white>4.5|| bgcolor=grey | <font color=white>0.22
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>50.0|| bgcolor=grey | <font color=white>8.4|| bgcolor=grey | <font color=white> 5.95||bgcolor=grey | <font color=white>8.3|| bgcolor=grey | <font color=white>10.0|| bgcolor=grey | <font color=white>0.49
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>100.0|| bgcolor=grey | <font color=white>13.0|| bgcolor=grey | <font color=white> 7.69||bgcolor=grey | <font color=white>13.0|| bgcolor=grey | <font color=white>16.0|| bgcolor=grey | <font color=white>0.8
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>150.0|| bgcolor=grey | <font color=white>18.0|| bgcolor=grey | <font color=white> 8.33||bgcolor=grey | <font color=white>18.0|| bgcolor=grey | <font color=white>19.0|| bgcolor=grey | <font color=white>0.87
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>200.0|| bgcolor=grey | <font color=white>23.0|| bgcolor=grey | <font color=white> 8.69||bgcolor=grey | <font color=white>23.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>1.3
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>250.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white> 9.26||bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>47.0|| bgcolor=grey | <font color=white>1.2
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>500.0|| bgcolor=grey | <font color=white>54.0|| bgcolor=grey | <font color=white> 9.26||bgcolor=grey | <font color=white>53.0|| bgcolor=grey | <font color=white>78.0|| bgcolor=grey | <font color=white>4.8
|-
!bgcolor=red | <font color=white>profile_upload||    bgcolor=blue | <font color=white>30||    bgcolor=grey | <font color=white>1000.0|| bgcolor=grey | <font color=white>100.0|| bgcolor=grey | <font color=white> 10||bgcolor=grey | <font color=white>100.0|| bgcolor=grey | <font color=white>120.0|| bgcolor=grey | <font color=white>4.0
|-
|-
|}
|}

Latest revision as of 10:03, 23 June 2006

Objective

As part of some of the initial testing with L-Store these tests are attempting to create a base reference model for meta data handling with L-Store. Specifically we are interested in seeing that as we increase from very small file sizes to large file sizes whether the latency profile is a linear fit or a non-linear fit.

Parameters

1. File Size: 1KB, 500KB, 1MB, 50 MB, 100MB, 150MB, 200MB, 250MB

2. Number of Files: 30 files

3. Number of threads: 10 threads

Results

  • Number of Threads: 10
  • Block Size : 1MB (Each Slice is 1MB)
  • Number of Files : 30
  • Current Status: In progress
  • Time of Completion:


Type of Test Number of files Average File Size (MB) Average Transfer Time (sec) Average Throughput (MB/sec) Median Transfer Time (sec) Maximum Transfer Time (sec) Std Deviation on Transfer Time
profile_upload 30 0.001 2.8 0.0003 2.7 11.0 0.63
profile_upload 30 0.5 3.0 0.16 3.0 10.0 0.45
profile_upload 30 1.0 3.5 0.29 3.4 4.5 0.22
profile_upload 30 50.0 8.4 5.95 8.3 10.0 0.49
profile_upload 30 100.0 13.0 7.69 13.0 16.0 0.8
profile_upload 30 150.0 18.0 8.33 18.0 19.0 0.87
profile_upload 30 200.0 23.0 8.69 23.0 27.0 1.3
profile_upload 30 250.0 27.0 9.26 27.0 47.0 1.2
profile_upload 30 500.0 54.0 9.26 53.0 78.0 4.8
profile_upload 30 1000.0 100.0 10 100.0 120.0 4.0