ReddNet - User contributions [en]

File:Cern bh write ATLA CHIC WP.jpg

2009-05-28T01:57:28Z

Kissele:

File:Cern bh read ATLA CHIC WP.jpg

2009-05-28T01:57:20Z

Kissele:

File:Cern bh write ATLA WP.jpg

2009-05-28T01:57:08Z

Kissele:

File:Cern bh read ATLA WP.jpg

2009-05-28T01:56:58Z

Kissele:

File:Cern bh write NP.jpg

2009-05-28T01:56:44Z

Kissele:

File:Cern bh read NP.jpg

2009-05-28T01:56:32Z

Kissele:

BWC results

2009-05-28T01:56:18Z

Kissele: /* CERN - Vanderbilt */

=== Testing Methodology ===

----

Bandwidth tests between REDDnet depots are performed using the ibp_perf tool to emulate depot-to-depot copies. The parameters used are as follows:

* Transfer sizes (MB): '''16, 64, 256, 1024, 2048, 4096 (when possible)'''
** A 32M allocation size is used for all transfers except the 16M (1M) and 64M (2M) cases.

* Number of files transfered: '''''transfer_size/allocation_size'''''

* Concurrent transfer threads: '''1, 2, 4, 8, 16, 32'''

* Block sizes: '''1024K, 2048K''' (1024K for results unless noted)

Each ibp_perf test case is run 5 times in sequence and the results are then averaged before graphing. When simulating depot-to-depot copies using all depots at a particular site, a one-to-one mapping is used in transferring data simultaneously between depots. Thus siteA-depot1 contacts siteB-depot1, siteA-depot2 contacts siteB-depot2, etc.

Full CSV results are available [http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/ here].

=== CERN - Vanderbilt (May 15 2009) ===

----

Direct tests from CERN to Vandy, aggregated over 4 depots.

[[Image:cern_bh_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_read_NP.pdf PDF]
[[Image:cern_bh_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_write_NP.pdf PDF]

Phoebus tests from CERN to Vandy, aggregated over 4 depots. One GW used at ATLA.

[[Image:cern_bh_read_ATLA_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_read_ATLA_WP.pdf PDF]
[[Image:cern_bh_write_ATLA_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_write_ATLA_WP.pdf PDF]

Phoebus tests from CERN to Vandy, aggregated over 4 depots. Two GWs used, CHIC-ATLA.

[[Image:cern_bh_read_ATLA_CHIC_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_read_ATLA_CHIC_WP.pdf PDF]
[[Image:cern_bh_write_ATLA_CHIC_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_write_ATLA_CHIC_WP.pdf PDF]

=== Vanderbilt (Blackhole) - UMich Direct ===

----

Direct tests from Vandy to UMich, aggregated throughput over 8 depots.

[[Image:bh_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_umich_read_NP.pdf PDF]
[[Image:bh_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_umich_write_NP.pdf PDF]

=== Vanderbilt (Blackhole) - Caltech ===

----

Direct tests from Vandy to Caltech, aggregated throughput over 8 depots.

[[Image:bh_calt_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_NP.pdf PDF]
[[Image:bh_calt_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_NP.pdf PDF]

Phoebus tests from Vandy to Caltech (ALTA-LOSA), aggregated over 8 depots.

[[Image:bh_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_WP.pdf PDF]
[[Image:bh_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_WP.pdf PDF]

=== CERN - UMich ===

----

Direct tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_NP.pdf PDF]
[[Image:cern_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_NP.pdf PDF]

Phoebus tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_WP.pdf PDF]
[[Image:cern_umich_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_WP.pdf PDF]

=== CERN - Vanderbilt ===

----

Direct tests from CERN to Vanderbilt, aggregated throughput over 4 depots. ibp_perf continues to hang on many of the longer transfers and the 2048MB points are omitted where one or more depots failed to complete the test.

[[Image:cern_vandy_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_read_NP.pdf PDF]
[[Image:cern_vandy_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_write_NP.pdf PDF]

The Amsterdam Phoebus gateway is still having hardware issues and results with Phoebus between these sites will be made available when possible. Some individual tests were performed before the Amsterdam host went down:

<pre>
direct : 1.2Gbps
LOSA : 700Mbps
CHIC-LOSA : 1.3Gbps
AMS-CHIC-LOSA : 2.0Gbps
</pre>

Performance to the CHIC or LOSA GWs directly is not stellar, but utilizing the Amsterdam GW was looking promising. Once/If the AMS GW comes online again we should expect this to be the ideal testing case for Phoebus.

=== Vanderbilt - Caltech ===

----

Direct tests from Vanderbilt to Caltech, aggregated throughput over 4 depots. Again, ibp_perf continues to hang on many of the longer tests and 4096MBpoints are omitted where one or more depots failed to complete the test. In this case, only vudepot1<->caltech-depot1 had problems with the 4096MB transfers.

[[Image:vandy_caltech_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_NP.pdf PDF]
[[Image:vandy_caltech_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_NP.pdf PDF]

Phoebus tests from Vanderbilt to Caltech through ATLA and LOSA GWs, aggregated throughput over 4 depots. I2 path is ATLA-HOUS-LOSA. Here we see Phoebus not performing as well as the direct tests. Seeing a steady improvement as the number of threads increases indicates that perhaps the path from the vandy/caltech sites to either ATLA/LOSA GWs is not performing as expected.

[[Image:vandy_caltech_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_WP.pdf PDF]
[[Image:vandy_caltech_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_WP.pdf PDF]

=== UMich - Caltech ===

----

* NOTE: need to run 4096MB tests

Direct tests between UMich and Caltech, aggregated throughput over 8 depots.

[[Image:umich_calt_8_read.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_read.pdf PDF]

[[Image:umich_calt_8_write.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_write.pdf PDF]

Phoebus tests between UMich and Caltech through CHIC and LOSA GWs, aggregated through over 8 depots. I2 path is CHIC-KANS-HOUS-LOSA. Only 4, 8, and 16 stream tests are shown. Due to current underpowered hardware, the Phoebus GWs become bottlenecks and are limited to a little over 3Gbps.

[[Image:umich_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_read_WP.pdf PDF]

[[Image:umich_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_write_WP.pdf PDF]

BWC results

2009-05-28T01:55:29Z

Kissele: /* Vanderbilt (Blackhole) - UMich Direct */

=== Testing Methodology ===

----

Bandwidth tests between REDDnet depots are performed using the ibp_perf tool to emulate depot-to-depot copies. The parameters used are as follows:

* Transfer sizes (MB): '''16, 64, 256, 1024, 2048, 4096 (when possible)'''
** A 32M allocation size is used for all transfers except the 16M (1M) and 64M (2M) cases.

* Number of files transfered: '''''transfer_size/allocation_size'''''

* Concurrent transfer threads: '''1, 2, 4, 8, 16, 32'''

* Block sizes: '''1024K, 2048K''' (1024K for results unless noted)

Each ibp_perf test case is run 5 times in sequence and the results are then averaged before graphing. When simulating depot-to-depot copies using all depots at a particular site, a one-to-one mapping is used in transferring data simultaneously between depots. Thus siteA-depot1 contacts siteB-depot1, siteA-depot2 contacts siteB-depot2, etc.

Full CSV results are available [http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/ here].

=== CERN - Vanderbilt ===

----

Direct tests from CERN to Vandy, aggregated over 4 depots.

[[Image:cern_bh_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_read_NP.pdf PDF]
[[Image:cern_bh_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_write_NP.pdf PDF]

Phoebus tests from CERN to Vandy, aggregated over 4 depots. One GW used at ATLA.

[[Image:cern_bh_read_ATLA_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_read_ATLA_WP.pdf PDF]
[[Image:cern_bh_write_ATLA_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_write_ATLA_WP.pdf PDF]

Phoebus tests from CERN to Vandy, aggregated over 4 depots. Two GWs used, CHIC-ATLA.

[[Image:cern_bh_read_ATLA_CHIC_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_read_ATLA_CHIC_WP.pdf PDF]
[[Image:cern_bh_write_ATLA_CHIC_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_bh_write_ATLA_CHIC_WP.pdf PDF]

=== Vanderbilt (Blackhole) - UMich Direct ===

----

Direct tests from Vandy to UMich, aggregated throughput over 8 depots.

[[Image:bh_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_umich_read_NP.pdf PDF]
[[Image:bh_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_umich_write_NP.pdf PDF]

=== Vanderbilt (Blackhole) - Caltech ===

----

Direct tests from Vandy to Caltech, aggregated throughput over 8 depots.

[[Image:bh_calt_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_NP.pdf PDF]
[[Image:bh_calt_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_NP.pdf PDF]

Phoebus tests from Vandy to Caltech (ALTA-LOSA), aggregated over 8 depots.

[[Image:bh_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_WP.pdf PDF]
[[Image:bh_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_WP.pdf PDF]

=== CERN - UMich ===

----

Direct tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_NP.pdf PDF]
[[Image:cern_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_NP.pdf PDF]

Phoebus tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_WP.pdf PDF]
[[Image:cern_umich_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_WP.pdf PDF]

=== CERN - Vanderbilt ===

----

Direct tests from CERN to Vanderbilt, aggregated throughput over 4 depots. ibp_perf continues to hang on many of the longer transfers and the 2048MB points are omitted where one or more depots failed to complete the test.

[[Image:cern_vandy_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_read_NP.pdf PDF]
[[Image:cern_vandy_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_write_NP.pdf PDF]

The Amsterdam Phoebus gateway is still having hardware issues and results with Phoebus between these sites will be made available when possible. Some individual tests were performed before the Amsterdam host went down:

<pre>
direct : 1.2Gbps
LOSA : 700Mbps
CHIC-LOSA : 1.3Gbps
AMS-CHIC-LOSA : 2.0Gbps
</pre>

Performance to the CHIC or LOSA GWs directly is not stellar, but utilizing the Amsterdam GW was looking promising. Once/If the AMS GW comes online again we should expect this to be the ideal testing case for Phoebus.

=== Vanderbilt - Caltech ===

----

Direct tests from Vanderbilt to Caltech, aggregated throughput over 4 depots. Again, ibp_perf continues to hang on many of the longer tests and 4096MBpoints are omitted where one or more depots failed to complete the test. In this case, only vudepot1<->caltech-depot1 had problems with the 4096MB transfers.

[[Image:vandy_caltech_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_NP.pdf PDF]
[[Image:vandy_caltech_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_NP.pdf PDF]

Phoebus tests from Vanderbilt to Caltech through ATLA and LOSA GWs, aggregated throughput over 4 depots. I2 path is ATLA-HOUS-LOSA. Here we see Phoebus not performing as well as the direct tests. Seeing a steady improvement as the number of threads increases indicates that perhaps the path from the vandy/caltech sites to either ATLA/LOSA GWs is not performing as expected.

[[Image:vandy_caltech_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_WP.pdf PDF]
[[Image:vandy_caltech_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_WP.pdf PDF]

=== UMich - Caltech ===

----

* NOTE: need to run 4096MB tests

Direct tests between UMich and Caltech, aggregated throughput over 8 depots.

[[Image:umich_calt_8_read.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_read.pdf PDF]

[[Image:umich_calt_8_write.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_write.pdf PDF]

Phoebus tests between UMich and Caltech through CHIC and LOSA GWs, aggregated through over 8 depots. I2 path is CHIC-KANS-HOUS-LOSA. Only 4, 8, and 16 stream tests are shown. Due to current underpowered hardware, the Phoebus GWs become bottlenecks and are limited to a little over 3Gbps.

[[Image:umich_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_read_WP.pdf PDF]

[[Image:umich_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_write_WP.pdf PDF]

File:Bh umich write NP.jpg

2009-05-28T01:49:48Z

Kissele:

File:Bh umich read NP.jpg

2009-05-28T01:49:35Z

Kissele:

BWC results

2009-05-28T01:49:01Z

Kissele: /* Vanderbilt (Blackhole) - Caltech */

=== Testing Methodology ===

----

Bandwidth tests between REDDnet depots are performed using the ibp_perf tool to emulate depot-to-depot copies. The parameters used are as follows:

* Transfer sizes (MB): '''16, 64, 256, 1024, 2048, 4096 (when possible)'''
** A 32M allocation size is used for all transfers except the 16M (1M) and 64M (2M) cases.

* Number of files transfered: '''''transfer_size/allocation_size'''''

* Concurrent transfer threads: '''1, 2, 4, 8, 16, 32'''

* Block sizes: '''1024K, 2048K''' (1024K for results unless noted)

Each ibp_perf test case is run 5 times in sequence and the results are then averaged before graphing. When simulating depot-to-depot copies using all depots at a particular site, a one-to-one mapping is used in transferring data simultaneously between depots. Thus siteA-depot1 contacts siteB-depot1, siteA-depot2 contacts siteB-depot2, etc.

Full CSV results are available [http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/ here].

=== Vanderbilt (Blackhole) - UMich Direct ===

----

Direct tests from Vandy to UMich, aggregated throughput over 8 depots.

[[Image:bh_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_umich_read_NP.pdf PDF]
[[Image:bh_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_umich_write_NP.pdf PDF]

=== Vanderbilt (Blackhole) - Caltech ===

----

Direct tests from Vandy to Caltech, aggregated throughput over 8 depots.

[[Image:bh_calt_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_NP.pdf PDF]
[[Image:bh_calt_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_NP.pdf PDF]

Phoebus tests from Vandy to Caltech (ALTA-LOSA), aggregated over 8 depots.

[[Image:bh_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_WP.pdf PDF]
[[Image:bh_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_WP.pdf PDF]

=== CERN - UMich ===

----

Direct tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_NP.pdf PDF]
[[Image:cern_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_NP.pdf PDF]

Phoebus tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_WP.pdf PDF]
[[Image:cern_umich_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_WP.pdf PDF]

=== CERN - Vanderbilt ===

----

Direct tests from CERN to Vanderbilt, aggregated throughput over 4 depots. ibp_perf continues to hang on many of the longer transfers and the 2048MB points are omitted where one or more depots failed to complete the test.

[[Image:cern_vandy_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_read_NP.pdf PDF]
[[Image:cern_vandy_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_write_NP.pdf PDF]

The Amsterdam Phoebus gateway is still having hardware issues and results with Phoebus between these sites will be made available when possible. Some individual tests were performed before the Amsterdam host went down:

<pre>
direct : 1.2Gbps
LOSA : 700Mbps
CHIC-LOSA : 1.3Gbps
AMS-CHIC-LOSA : 2.0Gbps
</pre>

Performance to the CHIC or LOSA GWs directly is not stellar, but utilizing the Amsterdam GW was looking promising. Once/If the AMS GW comes online again we should expect this to be the ideal testing case for Phoebus.

=== Vanderbilt - Caltech ===

----

Direct tests from Vanderbilt to Caltech, aggregated throughput over 4 depots. Again, ibp_perf continues to hang on many of the longer tests and 4096MBpoints are omitted where one or more depots failed to complete the test. In this case, only vudepot1<->caltech-depot1 had problems with the 4096MB transfers.

[[Image:vandy_caltech_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_NP.pdf PDF]
[[Image:vandy_caltech_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_NP.pdf PDF]

Phoebus tests from Vanderbilt to Caltech through ATLA and LOSA GWs, aggregated throughput over 4 depots. I2 path is ATLA-HOUS-LOSA. Here we see Phoebus not performing as well as the direct tests. Seeing a steady improvement as the number of threads increases indicates that perhaps the path from the vandy/caltech sites to either ATLA/LOSA GWs is not performing as expected.

[[Image:vandy_caltech_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_WP.pdf PDF]
[[Image:vandy_caltech_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_WP.pdf PDF]

=== UMich - Caltech ===

----

* NOTE: need to run 4096MB tests

Direct tests between UMich and Caltech, aggregated throughput over 8 depots.

[[Image:umich_calt_8_read.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_read.pdf PDF]

[[Image:umich_calt_8_write.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_write.pdf PDF]

Phoebus tests between UMich and Caltech through CHIC and LOSA GWs, aggregated through over 8 depots. I2 path is CHIC-KANS-HOUS-LOSA. Only 4, 8, and 16 stream tests are shown. Due to current underpowered hardware, the Phoebus GWs become bottlenecks and are limited to a little over 3Gbps.

[[Image:umich_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_read_WP.pdf PDF]

[[Image:umich_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_write_WP.pdf PDF]

File:Bh calt write WP.jpg

2009-05-07T18:27:45Z

Kissele:

File:Bh calt read WP.jpg

2009-05-07T18:27:13Z

Kissele:

File:Bh calt write NP.jpg

2009-05-07T18:26:58Z

Kissele:

File:Bh calt read NP.jpg

2009-05-07T18:26:41Z

Kissele:

BWC results

2009-05-07T18:24:17Z

Kissele: /* CERN - UMich */

=== Testing Methodology ===

----

Bandwidth tests between REDDnet depots are performed using the ibp_perf tool to emulate depot-to-depot copies. The parameters used are as follows:

* Transfer sizes (MB): '''16, 64, 256, 1024, 2048, 4096 (when possible)'''
** A 32M allocation size is used for all transfers except the 16M (1M) and 64M (2M) cases.

* Number of files transfered: '''''transfer_size/allocation_size'''''

* Concurrent transfer threads: '''1, 2, 4, 8, 16, 32'''

* Block sizes: '''1024K, 2048K''' (1024K for results unless noted)

Each ibp_perf test case is run 5 times in sequence and the results are then averaged before graphing. When simulating depot-to-depot copies using all depots at a particular site, a one-to-one mapping is used in transferring data simultaneously between depots. Thus siteA-depot1 contacts siteB-depot1, siteA-depot2 contacts siteB-depot2, etc.

Full CSV results are available [http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/ here].

=== Vanderbilt (Blackhole) - Caltech ===

----

irect tests from Vandy to Caltech, aggregated throughput over 8 depots.

[[Image:bh_calt_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_NP.pdf PDF]
[[Image:bh_calt_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_NP.pdf PDF]

Phoebus tests from Vandy to Caltech (ALTA-LOSA), aggregated over 8 depots.

[[Image:bh_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_read_WP.pdf PDF]
[[Image:bh_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/bh_calt_write_WP.pdf PDF]

=== CERN - UMich ===

----

Direct tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_NP.pdf PDF]
[[Image:cern_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_NP.pdf PDF]

Phoebus tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_WP.pdf PDF]
[[Image:cern_umich_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_WP.pdf PDF]

=== CERN - Vanderbilt ===

----

Direct tests from CERN to Vanderbilt, aggregated throughput over 4 depots. ibp_perf continues to hang on many of the longer transfers and the 2048MB points are omitted where one or more depots failed to complete the test.

[[Image:cern_vandy_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_read_NP.pdf PDF]
[[Image:cern_vandy_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_write_NP.pdf PDF]

The Amsterdam Phoebus gateway is still having hardware issues and results with Phoebus between these sites will be made available when possible. Some individual tests were performed before the Amsterdam host went down:

<pre>
direct : 1.2Gbps
LOSA : 700Mbps
CHIC-LOSA : 1.3Gbps
AMS-CHIC-LOSA : 2.0Gbps
</pre>

Performance to the CHIC or LOSA GWs directly is not stellar, but utilizing the Amsterdam GW was looking promising. Once/If the AMS GW comes online again we should expect this to be the ideal testing case for Phoebus.

=== Vanderbilt - Caltech ===

----

Direct tests from Vanderbilt to Caltech, aggregated throughput over 4 depots. Again, ibp_perf continues to hang on many of the longer tests and 4096MBpoints are omitted where one or more depots failed to complete the test. In this case, only vudepot1<->caltech-depot1 had problems with the 4096MB transfers.

[[Image:vandy_caltech_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_NP.pdf PDF]
[[Image:vandy_caltech_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_NP.pdf PDF]

Phoebus tests from Vanderbilt to Caltech through ATLA and LOSA GWs, aggregated throughput over 4 depots. I2 path is ATLA-HOUS-LOSA. Here we see Phoebus not performing as well as the direct tests. Seeing a steady improvement as the number of threads increases indicates that perhaps the path from the vandy/caltech sites to either ATLA/LOSA GWs is not performing as expected.

[[Image:vandy_caltech_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_WP.pdf PDF]
[[Image:vandy_caltech_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_WP.pdf PDF]

=== UMich - Caltech ===

----

* NOTE: need to run 4096MB tests

Direct tests between UMich and Caltech, aggregated throughput over 8 depots.

[[Image:umich_calt_8_read.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_read.pdf PDF]

[[Image:umich_calt_8_write.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_write.pdf PDF]

Phoebus tests between UMich and Caltech through CHIC and LOSA GWs, aggregated through over 8 depots. I2 path is CHIC-KANS-HOUS-LOSA. Only 4, 8, and 16 stream tests are shown. Due to current underpowered hardware, the Phoebus GWs become bottlenecks and are limited to a little over 3Gbps.

[[Image:umich_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_read_WP.pdf PDF]

[[Image:umich_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_write_WP.pdf PDF]

File:Cern umich write WP.jpg

2009-04-30T14:02:33Z

Kissele:

File:Cern umich read WP.jpg

2009-04-30T14:02:19Z

Kissele:

File:Cern umich write NP.jpg

2009-04-30T14:02:00Z

Kissele:

File:Cern umich read NP.jpg

2009-04-30T14:01:45Z

Kissele:

BWC results

2009-04-30T13:57:33Z

Kissele: /* CERN - Vanderbilt */

=== Testing Methodology ===

----

Bandwidth tests between REDDnet depots are performed using the ibp_perf tool to emulate depot-to-depot copies. The parameters used are as follows:

* Transfer sizes (MB): '''16, 64, 256, 1024, 2048, 4096 (when possible)'''
** A 32M allocation size is used for all transfers except the 16M (1M) and 64M (2M) cases.

* Number of files transfered: '''''transfer_size/allocation_size'''''

* Concurrent transfer threads: '''1, 2, 4, 8, 16, 32'''

* Block sizes: '''1024K, 2048K''' (1024K for results unless noted)

Each ibp_perf test case is run 5 times in sequence and the results are then averaged before graphing. When simulating depot-to-depot copies using all depots at a particular site, a one-to-one mapping is used in transferring data simultaneously between depots. Thus siteA-depot1 contacts siteB-depot1, siteA-depot2 contacts siteB-depot2, etc.

Full CSV results are available [http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/ here].

=== CERN - UMich ===

----

Direct tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_NP.pdf PDF]
[[Image:cern_umich_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_NP.pdf PDF]

Phoebus tests from CERN to UMich, aggregated throughput over 4 depots.

[[Image:cern_umich_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_read_WP.pdf PDF]
[[Image:cern_umich_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_umich_write_WP.pdf PDF]

=== CERN - Vanderbilt ===

----

Direct tests from CERN to Vanderbilt, aggregated throughput over 4 depots. ibp_perf continues to hang on many of the longer transfers and the 2048MB points are omitted where one or more depots failed to complete the test.

[[Image:cern_vandy_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_read_NP.pdf PDF]
[[Image:cern_vandy_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/cern_vandy_write_NP.pdf PDF]

The Amsterdam Phoebus gateway is still having hardware issues and results with Phoebus between these sites will be made available when possible. Some individual tests were performed before the Amsterdam host went down:

<pre>
direct : 1.2Gbps
LOSA : 700Mbps
CHIC-LOSA : 1.3Gbps
AMS-CHIC-LOSA : 2.0Gbps
</pre>

Performance to the CHIC or LOSA GWs directly is not stellar, but utilizing the Amsterdam GW was looking promising. Once/If the AMS GW comes online again we should expect this to be the ideal testing case for Phoebus.

=== Vanderbilt - Caltech ===

----

Direct tests from Vanderbilt to Caltech, aggregated throughput over 4 depots. Again, ibp_perf continues to hang on many of the longer tests and 4096MBpoints are omitted where one or more depots failed to complete the test. In this case, only vudepot1<->caltech-depot1 had problems with the 4096MB transfers.

[[Image:vandy_caltech_read_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_NP.pdf PDF]
[[Image:vandy_caltech_write_NP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_NP.pdf PDF]

Phoebus tests from Vanderbilt to Caltech through ATLA and LOSA GWs, aggregated throughput over 4 depots. I2 path is ATLA-HOUS-LOSA. Here we see Phoebus not performing as well as the direct tests. Seeing a steady improvement as the number of threads increases indicates that perhaps the path from the vandy/caltech sites to either ATLA/LOSA GWs is not performing as expected.

[[Image:vandy_caltech_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_read_WP.pdf PDF]
[[Image:vandy_caltech_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/vandy_calt_write_WP.pdf PDF]

=== UMich - Caltech ===

----

* NOTE: need to run 4096MB tests

Direct tests between UMich and Caltech, aggregated throughput over 8 depots.

[[Image:umich_calt_8_read.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_read.pdf PDF]

[[Image:umich_calt_8_write.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_8_write.pdf PDF]

Phoebus tests between UMich and Caltech through CHIC and LOSA GWs, aggregated through over 8 depots. I2 path is CHIC-KANS-HOUS-LOSA. Only 4, 8, and 16 stream tests are shown. Due to current underpowered hardware, the Phoebus GWs become bottlenecks and are limited to a little over 3Gbps.

[[Image:umich_calt_read_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_read_WP.pdf PDF]

[[Image:umich_calt_write_WP.jpg]]
[http://moonshine.damsl.cis.udel.edu/ibp_perf_tests/graphs/umich_calt_write_WP.pdf PDF]

BWC results

2009-04-23T05:37:56Z

Kissele: /* CERN - VANDERBILT */

BWC results

2009-04-23T05:24:19Z

Kissele: /* UMich - Caltech */

BWC results

2009-04-23T05:20:53Z

Kissele: /* CERN - VANDERBILT */

BWC results

2009-04-23T05:17:34Z

Kissele: /* UMich - Caltech */

File:Umich calt write WP.jpg

2009-04-23T05:16:56Z

Kissele:

File:Umich calt read WP.jpg

2009-04-23T05:16:42Z

Kissele:

File:Umich calt 8 write.jpg

2009-04-23T05:16:30Z

Kissele:

File:Umich calt 8 read.jpg

2009-04-23T05:16:14Z

Kissele:

BWC results

2009-04-23T05:16:06Z

Kissele: /* UMich - Caltech */

BWC results

2009-04-23T05:10:21Z

Kissele: /* Vanderbilt - Caltech */

BWC results

2009-04-23T05:09:13Z

Kissele: /* Vanderbilt - Caltech */

BWC results

2009-04-23T05:06:48Z

Kissele: /* Vanderbilt - Caltech */

BWC results

2009-04-23T05:05:47Z

Kissele: /* Vanderbilt - Caltech */

File:Vandy caltech write WP.jpg

2009-04-23T05:03:10Z

Kissele:

File:Vandy caltech read WP.jpg

2009-04-23T05:02:50Z

Kissele:

BWC results

2009-04-23T05:02:25Z

Kissele: /* Vanderbilt - Caltech */

File:Vandy caltech write NP.jpg

2009-04-23T05:00:25Z

Kissele:

File:Vandy caltech read NP.jpg

2009-04-23T05:00:06Z

Kissele:

BWC results

2009-04-23T04:59:44Z

Kissele: /* CERN - VANDERBILT */

BWC results

2009-04-23T04:56:52Z

Kissele: /* Testing Methodology */

BWC results

2009-04-23T04:56:26Z

Kissele: /* Testing Methodology */

BWC results

2009-04-23T04:55:36Z

Kissele: New page: === Testing Methodology === ---- Bandwidth tests between REDDnet depots are performed using the ibp_perf tool to emulate depot-to-depot copies. The parameters used are as follows: * T...

File:Cern vandy write NP.jpg

2009-04-23T04:45:37Z

Kissele:

File:Cern vandy read NP.jpg

2009-04-23T04:45:09Z

Kissele:

Tests

2009-04-23T04:13:19Z

Kissele: /* Current Tests */

== Test Documentation ==

* For each test:
** description of what you are testing
** estimate duration, estimate what you expect?
** description for your test method (what you did)
** result

== Proposed Tests ==

* Stress test on SFASU
* What happens when depots start to get full? (Harold and Dan)
** depots should do low-level reclamation/resource recovery - Dan and Alan will do this test later this week

== Current Tests ==

=== ibp_perf/BWC testing ===

* [[BWC_results|BWC results page]]

=== TSI simulation data using LoDN tools May '08 (Blondin/Sellers)===

=== Depot Fill-up Test on Michigan-cap (Gonzales) ===

We've been meaning to do a test on depots when they are full and users continue to request storage. Since Chris's tests with Dr. Blondin apparently got these depots close to full, I figured it was a natural time to see what happens when such overfilling behavior happens. The plan currently is to use lodn_cp to send 40GB files to all 4 depots and have the warmer replicate a copy to each. When the time comes to remove our data, this will also give us a good test of LoDN's best-effort deletion on the REDDnet depots.

Tests completed today (5/23/08) with the following results.

* Depots gave correct error codes after all available storage was occupied.
* LoDN delete freed up all the storage gobbled up by the test once the upload had been stopped.

All in all, both the depot and LoDN performed as hoped. The test did not test reclaiming of storage, which will have to be covered by some later test. Also, I think that repeating this test over a couple of fill and delete cycles would be a good way of coaxing out any storage leaks which may be occurring. Without objection, I will go though a few cycles of this over the weekend and post the results here early next week.

=== Ongoing Usage Tests - Spring '08 (Sheldon) ===

These tests are continuous, although they can be stopped (just ask me).

[http://www.hep.vanderbilt.edu/~sheldonp/budplots.html Results] are updated hourly.

==== Description of Tests ====

Currently all of these tests run on a handful of systems in the Vanderbilt Physics department. Our connection out is limited at 1 Gbs, this is one potential bottleneck on the tests I can run (the other is the 622 Mbs bandwidth of Vanderbilt's external connection.

* Downloads of a large 1.1 GByte file
** I have loaded several 1.1 GBytes files into the full REDDnet deployment of depots (40 depots or so).
** My tests continuously download this file and compare the checksum of the downloaded file to the original to check for bit rot (amoung other things).
** As soon as one download completes, another is started.
** A cron job is used to keep this process going.
** Several of these jobs are run on on different systems in the physics cluster on the 9th floor of Stevenson Center.

* Uploads/downloads of a large 1.1 GByte file
** I initially download one of the several files that I seeded REDDnet with.
** Once I verify that the download checksum is equal to that of the original file, I upload it back to REDDnet, giving it a new name so it doesn't overwrite the orginal.
** After each upload/download cycle, the files checksum is compared to the original.
** These process is kept going by a cron job.
** I count and plot the number of times files are successfully uploaded and downloaded, and add the number of downloads from the previous test, to get the total number of 1.1 GByte files moved each hour. This is ploted on the [http://www.hep.vanderbilt.edu/~sheldonp/budplots.html results] webpage. Also shown are the number of times a move error occurs, and the average upload and download times for the 1.1 GByte files.

* Recursive uploads/downloads of a directory.
** I use a recursive download to download a directory that was originally seeded on the REDDnet depots. I compare this directory to the original. If it is OK, I upload to a new temporary directory, download it again, and compare again.
** The upload/download cycle is repeated several times, and is kept going by a cron job.
** Statistics for these movements are shown on my [http://www.hep.vanderbilt.edu/~sheldonp/budplots.html results] webpage.

==== Motivations ====

* provide an ongoing "heartbeat" for REDDnet (is it working?)
* tests for bit rot in depots (which would result in regular failures).
* provide some feedback regarding performance (which would result in changes in download/upload times).
* provide some feedback on failure rates...

==== Results ====

* [http://www.hep.vanderbilt.edu/~sheldonp/budplots.html Results] are updated hourly.

== Test Archive ==