SC4 24hr Simultaneous Read-Write Tests

From GridPP Wiki
Revision as of 16:13, 15 November 2006 by Alessandra forti (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Tier 2 Results

Durham

File:ED-DUR-RW-test.png

Glasgow

Lancaster

File:EDLANCS-24hr-RW.png

Liverpool

File:ED-LIV-network-24hrs-readwrite.png

Manchester

File:EDMAN-RW-FTS-20061111.png

Manchester -> Edinburgh (read)

Date of Submission was 11/11/2006
Total number of FTS submissions = 32
2934/3200 transferred in 86361.268332 seconds
2.934e+12bytes transferred.
Average Bandwidth:271.788504886Mb/s

Edinburgh -> Manchester (write)

Date of Submission was 11/11/2006
Total number of FTS submissions = 29
2645/2900 transferred in 86370.0212131 seconds
2.645e+12bytes transferred.
Average Bandwidth:244.992414067Mb/s

Sheffield

Birmingham

File:RALPPBHAM1006.png

I started the 24 hour read/write with RALPP on Tue 11 Oct just before 1400.

The result of the read test is:

Date of Submission was 11/10/2006
 Total number of FTS submissions = 19
 1637/1900 transferred in 86332.8145201 seconds
 1.6384210176e+12bytes transferred.
Average Bandwidth:151.82370937Mb/s

The estimated average rate of the write test is 155Mb/s. The file transfer script (version 0.5.2-1) reported a wrong date and hence a wrong average rate:

Date of Submission was 1/1/1970
 Total number of FTS submissions = 23
 1639/2300 transferred in 1160571575.93 seconds
 1.639e+12bytes transferred.
Average Bandwidth:0.0112978813818Mb/s

The ganglia plot above shows that the rates in the BHAM->RALPP direction were considerably lower (50% reduction) in this test than in the uni-directional test while the difference between the rates of the write tests was not as significant.

The load on the DPM SE waw quite high (between 20 and 50) throughout the test, possibly high enough to cause two SFT RM tests to timeout.

Bristol

Cambridge

Oxford

Brunel

Brunel->RALPPD
Transfer Bandwidth Report Summary
=================================
transfer 0 (cd6bbccc-5eab-11db-b949-e6cd043d6f48)
16/100 (16000000000.0) transferred. Started at 14:24:16, Canceled at 16:24:53, Duration = 2:0:36, Bandwidth = 17.6877620274Mb/s
transfer 1 (0a369305-5ebd-11db-9cda-d8e9ca8bb8b4)
8/100 (8000000000.0) transferred. Started at 16:27:40, Canceled at 17:58:13, Duration = 1:30:32, Bandwidth = 11.7814358246Mb/s
transfer 2 (111d01ce-5eca-11db-9cda-d8e9ca8bb8b4)
8/100 (8000000000.0) transferred. Started at 18:0:55, Canceled at 19:31:25, Duration = 1:30:30, Bandwidth = 11.7861236415Mb/s
transfer 3 (181b1878-5ed7-11db-983f-bee6fd519f4e)
16/100 (16000000000.0) transferred. Started at 19:34:10, Canceled at 21:35:7, Duration = 2:0:56, Bandwidth = 17.6386564103Mb/s
transfer 4 (63a1c002-5ee8-11db-9aeb-884ba7711b8a)
8/100 (8000000000.0) transferred. Started at 21:37:57, Canceled at 23:8:9, Duration = 1:30:11, Bandwidth = 11.8271091236Mb/s
transfer 5 (5fd8e560-5ef5-11db-bb97-9f39275fa11b)
8/100 (8000000000.0) transferred. Started at 23:10:56, Canceled at 0:41:38, Duration = 1:30:41, Bandwidth = 11.7614903211Mb/s
transfer 6 (74258246-5f02-11db-8fa8-bed50c69e441)
8/100 (8000000000.0) transferred. Started at 0:44:33, Canceled at 2:14:34, Duration = 1:30:1, Bandwidth = 11.8479080779Mb/s
transfer 7 (6b074c50-5f0f-11db-be92-a9c20fdf7840)
8/100 (8000000000.0) transferred. Started at 2:17:21, Canceled at 3:47:28, Duration = 1:30:6, Bandwidth = 11.8371551428Mb/s
transfer 8 (62146c20-5f1c-11db-be92-a9c20fdf7840)
16/100 (16000000000.0) transferred. Started at 3:50:9, Canceled at 5:51:18, Duration = 2:1:8, Bandwidth = 17.609583505Mb/s
transfer 9 (b1108b06-5f2d-11db-bcbd-b6d19d9d7877)
8/100 (8000000000.0) transferred. Started at 5:54:3, Canceled at 7:24:19, Duration = 1:30:15, Bandwidth = 11.8170102439Mb/s
transfer 10 (b1b7dc1f-5f3a-11db-873e-aafc1f6dd63c)
8/100 (8000000000.0) transferred. Started at 7:27:8, Canceled at 8:57:16, Duration = 1:30:8, Bandwidth = 11.8327042183Mb/s
transfer 11 (abc9fe68-5f47-11db-87c2-b87c63e6ef06)
8/100 (8000000000.0) transferred. Started at 9:0:1, Canceled at 10:30:13, Duration = 1:30:12, Bandwidth = 11.825143792Mb/s
transfer 12 (a8651568-5f54-11db-bfd2-ca92950a4d5c)
16/100 (16000000000.0) transferred. Started at 10:32:59, Canceled at 12:34:49, Duration = 2:1:49, Bandwidth = 17.5117533444Mb/s
transfer 13 (c0d4b5d0-5f66-11db-9184-fc77ca039aae)
16/100 (16000000000.0) transferred. Started at 12:42:42, Active at 14:23:50, Duration = 1:41:7, Bandwidth = 21.0944300844Mb/s
                                                                                
Date of Submission was 19/10/2006
Total number of FTS submissions = 14
 152/1400 transferred in 86373.472718 seconds
 152000000000.0bytes transferred.
Average Bandwidth:14.0783965462Mb/s
RALPPD->Brunel
Transfer Bandwidth Report Summary
=================================
transfer 0 (d307bdfd-5eab-11db-b949-e6cd043d6f48)
87/100 (87000000000.0) transferred. Started at 14:24:25, Canceled at 3:38:50, Duration = 13:14:24, Bandwidth = 14.6021373165Mb/s
transfer 1 (5e2d0538-5f07-11db-8fa8-bed50c69e441)
68/100 (68000000000.0) transferred. Started at 3:40:13, Active at 14:24:14, Duration = 10:44:1, Bandwidth = 14.0782569544Mb/s
                                                                                
Date of Submission was 19/10/2006
Total number of FTS submissions = 2
 155/200 transferred in 86388.592756 seconds
 155000000000.0bytes transferred.
Average Bandwidth:14.3537469525Mb/s

IC-HEP

IC-LeSC

QMUL

RALPPD->QMUL
Transfer Bandwidth Report Summary
=================================
transfer 0 (2f62032d-5454-11db-a374-8dfe5f62b205)
39/100 (39000000000.0) transferred. Started at 10:31:52, Canceled at 12:1:31, Duration = 1:29:39, Bandwidth =
58.0009658383Mb/s
transfer 1 (0f11b10e-5461-11db-a374-8dfe5f62b205)
74/100 (74000000000.0) transferred. Started at 12:4:3, Canceled at 14:20:23, Duration = 2:16:20, Bandwidth =
72.3715065019Mb/s
transfer 2 (a0fc8faa-5473-11db-a374-8dfe5f62b205)
44/100 (44000000000.0) transferred. Started at 14:16:57, Canceled at 15:47:33, Duration = 1:30:36, Bandwidth =
64.7507839992Mb/s
transfer 3 (a5d74ff1-5480-11db-a374-8dfe5f62b205)
52/100 (52000000000.0) transferred. Started at 15:50:10, Canceled at 17:19:32, Duration = 1:29:22, Bandwidth =
77.5757536266Mb/s
transfer 4 (9c1fe76c-548d-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 17:23:0, Done at 20:12:41, Duration = 2:49:40, Bandwidth =
78.5798199667Mb/s
transfer 5 (ad11eadc-549e-11db-a374-8dfe5f62b205)
75/100 (75000000000.0) transferred. Started at 20:6:23, Canceled at 22:13:1, Duration = 2:6:38, Bandwidth =
78.9663379962Mb/s
transfer 6 (c898eb28-54b5-11db-a374-8dfe5f62b205)
47/100 (47000000000.0) transferred. Started at 22:11:51, Canceled at 0:15:59, Duration = 2:4:7, Bandwidth =
50.483518417Mb/s
transfer 7 (76e5d351-54c7-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 0:17:6, Canceled at 1:16:41, Duration = 0:59:35, Bandwidth = 0.0Mb/s
transfer 8 (20d8791c-54d0-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 1:21:2, Canceled at 2:19:26, Duration = 0:58:23, Bandwidth = 0.0Mb/s
transfer 9 (e64bd4bf-54d8-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 2:23:13, Canceled at 3:22:53, Duration = 0:59:39, Bandwidth = 0.0Mb/s
transfer 10 (c659cc04-54e1-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 3:26:21, Canceled at 4:26:30, Duration = 1:0:9, Bandwidth = 0.0Mb/s
transfer 11 (d7b5391d-54ea-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 4:30:32, Canceled at 5:32:5, Duration = 1:1:32, Bandwidth = 0.0Mb/s
transfer 12 (cec56308-54f3-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 5:33:33, Canceled at 6:39:47, Duration = 1:6:13, Bandwidth = 0.0Mb/s
transfer 13 (50e5118c-54fd-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 6:44:53, Canceled at 7:42:13, Duration = 0:57:19, Bandwidth = 0.0Mb/s
transfer 14 (ffe38677-5505-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 7:43:48, Canceled at 8:44:13, Duration = 1:0:24, Bandwidth = 0.0Mb/s
transfer 15 (adc1e56f-550e-11db-8c95-cde62faa8e54)
0/100 (0) transferred. Started at 8:46:52, Canceled at 9:47:26, Duration = 1:0:34, Bandwidth = 0.0Mb/s
transfer 16 (7e87cf4f-5517-11db-8c95-cde62faa8e54)
0/100 (0) transferred. Started at 9:49:57, Failed at 10:26:25, Duration = 0:36:27, Bandwidth = 0.0Mb/s
transfer 17 (febf2f56-5518-11db-8c95-cde62faa8e54)
0/100 (0) transferred. Started at 10:14:13, Active at 10:30:52, Duration = 0:16:38, Bandwidth = 0.0Mb/s
                                                                                                                             
Date of Submission was 6/10/2006
Total number of FTS submissions = 18
 431/1800 transferred in 51943.986537 seconds
 431000000000.0bytes transferred.
Average Bandwidth:66.3791947802Mb/s
QMUL->RALPPD
Transfer Bandwidth Report Summary
=================================
transfer 0 (33d6262e-5454-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 10:32:0, Done at 11:25:17, Duration = 0:53:17, Bandwidth =
250.196997381Mb/s
transfer 1 (97d08870-5459-11db-a374-8dfe5f62b205)
84/100 (84000000000.0) transferred. Started at 11:21:33, Canceled at 12:6:3, Duration = 0:44:29, Bandwidth =
251.690145951Mb/s
transfer 2 (323e0e3f-5461-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 12:7:8, Done at 13:1:3, Duration = 0:53:54, Bandwidth =
247.309555594Mb/s
transfer 3 (4f6f0811-5468-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 12:58:16, Done at 13:53:19, Duration = 0:55:2, Bandwidth =
242.235446179Mb/s
transfer 4 (ca4de655-546e-11db-a374-8dfe5f62b205)
84/100 (84000000000.0) transferred. Started at 13:54:26, Canceled at 15:27:49, Duration = 1:33:22, Bandwidth =
119.941017036Mb/s
transfer 5 (0c3a8fef-5476-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 14:36:26, Done at 15:27:55, Duration = 0:51:28, Bandwidth =
259.000719935Mb/s
transfer 6 (603df54d-547d-11db-a374-8dfe5f62b205)
96/100 (96000000000.0) transferred. Started at 15:29:5, Canceled at 16:15:50, Duration = 0:46:45, Bandwidth =
273.779751997Mb/s
transfer 7 (14d1c691-5484-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 16:16:59, Done at 17:10:6, Duration = 0:53:6, Bandwidth =
251.066002315Mb/s
transfer 8 (5874a11b-548a-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 17:6:7, Done at 17:58:9, Duration = 0:52:2, Bandwidth =
256.214713274Mb/s
transfer 9 (48bc69bb-5491-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 17:59:28, Done at 18:52:10, Duration = 0:52:41, Bandwidth =
253.006530759Mb/s
transfer 10 (1af44629-5498-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 18:48:57, Done at 19:39:49, Duration = 0:50:51, Bandwidth =
262.160991862Mb/s
transfer 11 (6e1cb5ce-549f-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 19:41:3, Done at 21:20:9, Duration = 1:39:5, Bandwidth =
134.557643326Mb/s
transfer 12 (1175d271-54a6-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 20:20:29, Done at 21:10:47, Duration = 0:50:17, Bandwidth =
265.151353739Mb/s
transfer 13 (338067d7-54ad-11db-a374-8dfe5f62b205)
84/100 (84000000000.0) transferred. Started at 21:18:52, Canceled at 22:56:37, Duration = 1:37:44, Bandwidth =
114.580870085Mb/s
transfer 14 (53a12e9f-54b4-11db-a374-8dfe5f62b205)
100/100 (100000000000.0) transferred. Started at 22:3:41, Done at 22:56:39, Duration = 0:52:58, Bandwidth =
251.708217592Mb/s
transfer 15 (123d1854-54bc-11db-a374-8dfe5f62b205)
88/100 (88000000000.0) transferred. Started at 22:57:57, Canceled at 0:29:25, Duration = 1:31:28, Bandwidth =
128.278422273Mb/s
transfer 16 (ee496e64-54c2-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 0:31:31, Canceled at 3:45:23, Duration = 3:13:51, Bandwidth = 0.0Mb/s
transfer 17 (c925ad26-54cd-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 1:2:55, Canceled at 3:2:57, Duration = 2:0:1, Bandwidth = 0.0Mb/s
transfer 18 (debbcadd-54e3-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 3:44:20, Canceled at 6:17:48, Duration = 2:33:28, Bandwidth = 0.0Mb/s
transfer 19 (39d8e3a3-54e9-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 4:20:38, Canceled at 5:44:7, Duration = 1:23:28, Bandwidth = 0.0Mb/s
transfer 20 (33eb9b19-54f9-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 6:19:34, Canceled at 9:48:2, Duration = 3:28:28, Bandwidth = 0.0Mb/s
transfer 21 (637c7a90-54fe-11db-a374-8dfe5f62b205)
0/100 (0) transferred. Started at 6:52:47, Canceled at 9:19:34, Duration = 2:26:47, Bandwidth = 0.0Mb/s
transfer 22 (14f3004c-5517-11db-8c95-cde62faa8e54)
0/100 (0) transferred. Started at 9:48:5, Failed at 10:23:17, Duration = 0:35:12, Bandwidth = 0.0Mb/s
transfer 23 (c5d4b845-5518-11db-8c95-cde62faa8e54)
0/100 (0) transferred. Started at 9:59:13, Active at 10:30:1, Duration = 0:30:48, Bandwidth = 0.0Mb/s
transfer 24 (325c287b-551b-11db-8c95-cde62faa8e54)
0/100 (0) transferred. Started at 10:16:29, Active at 10:31:12, Duration = 0:14:42, Bandwidth = 0.0Mb/s
transfer 25 (fd2d646f-551b-11db-8c95-cde62faa8e54)
0/100 (0) transferred. Started at 1:0:0, Pending at 1:0:0, Duration = 0:0:0, Bandwidth = 0.00Mb/s

Date of Submission was 6/10/2006
Total number of FTS submissions = 26
 1536/2600 transferred in 51943.986537 seconds
 1.536e+12bytes transferred.
Average Bandwidth:240.7208386Mb/s

File:Traffic 1005.gif

RHUL

Read

Transfer Bandwidth Report Summary
=================================
transfer 0 (8f979b2d-5d3c-11db-902e-f96957aaf2b9)
0/100 (0) transferred. Started at 18:34:26, Canceled at 20:6:40, Duration = 1:32:14, Bandwidth = 0.0Mb/s
transfer 1 (adf96531-5d49-11db-902e-f96957aaf2b9)
0/100 (0) transferred. Started at 20:9:21, Canceled at 21:41:9, Duration = 1:31:48, Bandwidth = 0.0Mb/s
transfer 2 (e23b5022-5d56-11db-b180-a585c51483dc)
16/100 (16000000000.0) transferred. Started at 21:43:52, Canceled at 23:45:32, Duration = 2:1:40, Bandwidth = 17.5324166039Mb/s
transfer 3 (4117eb6f-5d68-11db-aeee-eff8525af5f9)
0/100 (0) transferred. Started at 23:48:12, Canceled at 1:19:59, Duration = 1:31:47, Bandwidth = 0.0Mb/s
transfer 4 (738defd9-5d75-11db-b277-f50424c0a6c3)
100/100 (100000000000.0) transferred. Started at 1:21:51, Done at 6:16:45, Duration = 4:54:53, Bandwidth = 45.2132104051Mb/s
transfer 5 (7a99f816-5d96-11db-b1e9-fb09f39510ff)
100/100 (100000000000.0) transferred. Started at 6:3:37, Done at 9:54:6, Duration = 3:50:29, Bandwidth = 57.8463232554Mb/s
transfer 6 (257c9686-5db4-11db-9616-cc20c6d9eea3)
63/100 (63000000000.0) transferred. Started at 9:36:33, Active at 12:34:42, Duration = 2:58:9, Bandwidth = 47.1498613226Mb/s
 
Date of Submission was 17/10/2006
Total number of FTS submissions = 7
 279/700 transferred in 64816.6918688 seconds
 279000000000.0bytes transferred.
Average Bandwidth:34.4355741653Mb/s

Write

Transfer Bandwidth Report Summary
=================================
transfer 0 (8aed4cfc-5d3c-11db-902e-f96957aaf2b9)
45/100 (45000000000.0) transferred. Started at 18:35:21, Canceled at 23:9:39, Duration = 4:34:17, Bandwidth = 21.8743087291Mb/s
transfer 1 (3e402c89-5d63-11db-aeee-eff8525af5f9)
0/100 (0) transferred. Started at 23:12:21, Canceled at 0:44:5, Duration = 1:31:43, Bandwidth = 0.0Mb/s
transfer 2 (787b53bf-5d70-11db-b277-f50424c0a6c3)
80/100 (80000000000.0) transferred. Started at 0:47:1, Canceled at 4:29:54, Duration = 3:42:52, Bandwidth = 47.8590322674Mb/s
transfer 3 (548d263c-5d8d-11db-b1e9-fb09f39510ff)
100/100 (100000000000.0) transferred. Started at 4:24:14, Done at 10:12:26, Duration = 5:48:11, Bandwidth = 38.2931075941Mb/s
transfer 4 (f2738812-5dab-11db-a69c-e98ce8e262e8)
29/100 (29000000000.0) transferred. Started at 9:34:34, Active at 12:34:41, Duration = 3:0:6, Bandwidth = 21.4676341838Mb/s
 
Date of Submission was 17/10/2006
Total number of FTS submissions = 5
 254/500 transferred in 64759.8710611 seconds
 254000000000.0bytes transferred.
Average Bandwidth:31.3774559261Mb/s

File:RALPPDRHUL.png

UCL-CENTRAL

UCL-HEP