L-Store Upload Structured Testing: Difference between revisions

From ReddNet
Jump to navigation Jump to search
No edit summary
 
(35 intermediate revisions by 5 users not shown)
Line 28: Line 28:
Please watch this page as we post results from our runs.
Please watch this page as we post results from our runs.


= Results for Small Uploads with Three different thread sizes and Small Number of Files =
= <font color=Blue> Results for small uploads: 10 Threads =
<font color = maroon>
* Number of Threads: 10
* Number of Files : 1500 (30 samples of 50 uploads)
* Size of file: 1 KB
* Current Status: Done
* Time of Completion: 14.00 CST, June 20th 2006


{| class="wikitable" style="text-align:center"
{| class="wikitable" style="text-align:center"
|-
!bgcolor=red | <font color=white> Type of Test  ||    bgcolor=blue | <font color=white> Number of files || bgcolor=grey | <font color=white> Average File Size (MB) || bgcolor=grey | <font color=white> Average Latency (sec) || bgcolor=grey | <font color=white> Median Latency (sec) || bgcolor=grey | <font color=white> Maximum Latency (sec) || bgcolor=grey | <font color=white> Std Deviation on Latency
|-
!bgcolor=red | <font color=white>small_upload||    bgcolor=blue | <font color=white>1500||    bgcolor=grey | <font color=white>0.001|| bgcolor=grey | <font color=white>2.8|| bgcolor=grey | <font color=white>2.7|| bgcolor=grey | <font color=white>11.0|| bgcolor=grey | <font color=white>0.63
|-
|}


= <font color=Blue> Results for medium uploads: 10 Threads =
<font color = maroon>
* Number of Threads: 10
* Number of Files : 1500 (30 samples of 50 uploads)
* Size of file: 500 KB
* Current Status: Done
* Time of Completion: 17.00 CST, June 20th 2006
{| class="wikitable" style="text-align:center"
|-
|-
!bgcolor=red | <font color=white> Type of Test ||     bgcolor=blue | <font color=white> Number of Threads      || bgcolor=grey | <font color=white> Average File Size || bgcolor=grey | <font color=white> Average Latency || bgcolor=grey | <font color=white> Median Latency || bgcolor=grey | <font color=white> Maximum Latency || bgcolor=grey | <font color=white> Std Deviation on Latency
!bgcolor=red | <font color=white> Type of Test   ||   bgcolor=blue | <font color=white> Number of files || bgcolor=grey | <font color=white> Average File Size (MB) || bgcolor=grey | <font color=white> Average Latency (sec) || bgcolor=grey | <font color=white> Median Latency (sec) || bgcolor=grey | <font color=white> Maximum Latency (sec) || bgcolor=grey | <font color=white> Std Deviation on Latency
|-
!bgcolor=red | <font color=white> Small Upload  ||      bgcolor=blue | <font color=white> 1      || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA 
|-
|-
!bgcolor=red | <font color=white> Small Upload  ||     bgcolor=blue | <font color=white> 20      || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA
!bgcolor=red | <font color=white>med_upload||   bgcolor=blue | <font color=white>1500||   bgcolor=grey | <font color=white>0.5|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>3.0|| bgcolor=grey | <font color=white>10.0|| bgcolor=grey | <font color=white>0.45
|-
|-
!bgcolor=red | <font color=white> Small Upload  ||      bgcolor=blue | <font color=white> 60      || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA || bgcolor=grey | <font color=white> NA
|}
|}


= <font color=Blue> Results for large uploads: 10 Threads =
<font color = maroon>
* Number of Threads: 10
* Number of Files : 1500 (30 samples of 50 uploads)
* Size of file: 250 MB
* Current Status: In Progress
* Expected : June 21st 2006
* Time of Completion: 9.00am CST, 21st June 2006




{| class="wikitable" style="text-align:center"
{| class="wikitable" style="text-align:center"
|-
|-
!bgcolor=red | <font color=white> Type of Test ||     bgcolor=blue | <font color=white> Number of Threads      ||   bgcolor=grey | <font color=white> Average File Size || bgcolor=grey | <font color=white> Average Latency || bgcolor=grey | <font color=white> Median Latency || bgcolor=grey | <font color=white> Maximum Latency || bgcolor=grey | <font color=white> Std Deviation on Latency
!bgcolor=red | <font color=white> Type of Test   ||   bgcolor=blue | <font color=white> Number of files || bgcolor=grey | <font color=white> Average File Size (MB) || bgcolor=grey | <font color=white> Average Latency (sec) || bgcolor=grey | <font color=white> Median Latency (sec) || bgcolor=grey | <font color=white> Maximum Latency (sec) || bgcolor=grey | <font color=white> Std Deviation on Latency
!bgcolor=red | <font color=white>upload||     bgcolor=blue | <font color=white>upload||    bgcolor=grey | <font color=white>48.609721157300001|| bgcolor=grey | <font color=white>48.609721157300001|| bgcolor=grey | <font color=white>48.609721157300001|| bgcolor=grey | <font color=white>48.609721157300001|| bgcolor=grey | <font color=white>48.609721157300001
|-
!bgcolor=red | <font color=white>large_upload||   bgcolor=blue | <font color=white>1500||    bgcolor=grey | <font color=white>250.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>27.0|| bgcolor=grey | <font color=white>47.0|| bgcolor=grey | <font color=white>1.2
|-
|}
|}

Latest revision as of 13:57, 20 August 2007

Objective

This is the first set of tests for Benchmarking L-Store system performance. We are setting up Upload testing to begin with.

Parameters

1. File Size:

 * Small:  1KB file will be used
 * Medium: 0.5MB file will be used
 * Large:  260MB file will be used

2. Number of Files

 * Small:  Essentially we will use the number of uploads set up as a surrogate for number of files. 50
 * Medium: 200
 * Large:  1000

3. Number of threads

 * Small:  1
 * Medium: 20
 * Large:  60
  • Experimental Design: Full Factorial (3*3*3=27 test cases). Each test case would be run 30 times to collect statistically significant data.


Please watch this page as we post results from our runs.

Results for small uploads: 10 Threads

  • Number of Threads: 10
  • Number of Files : 1500 (30 samples of 50 uploads)
  • Size of file: 1 KB
  • Current Status: Done
  • Time of Completion: 14.00 CST, June 20th 2006
Type of Test Number of files Average File Size (MB) Average Latency (sec) Median Latency (sec) Maximum Latency (sec) Std Deviation on Latency
small_upload 1500 0.001 2.8 2.7 11.0 0.63

Results for medium uploads: 10 Threads

  • Number of Threads: 10
  • Number of Files : 1500 (30 samples of 50 uploads)
  • Size of file: 500 KB
  • Current Status: Done
  • Time of Completion: 17.00 CST, June 20th 2006
Type of Test Number of files Average File Size (MB) Average Latency (sec) Median Latency (sec) Maximum Latency (sec) Std Deviation on Latency
med_upload 1500 0.5 3.0 3.0 10.0 0.45

Results for large uploads: 10 Threads

  • Number of Threads: 10
  • Number of Files : 1500 (30 samples of 50 uploads)
  • Size of file: 250 MB
  • Current Status: In Progress
  • Expected : June 21st 2006
  • Time of Completion: 9.00am CST, 21st June 2006


Type of Test Number of files Average File Size (MB) Average Latency (sec) Median Latency (sec) Maximum Latency (sec) Std Deviation on Latency
large_upload 1500 250.0 27.0 27.0 47.0 1.2