Difference between revisions of "ZFS-Tests"

From GridPP Wiki
Jump to: navigation, search
Line 1: Line 1:
 
This page is to track different configurations that were tested under different setups, raid systems, and file systems. If one needs to add comments to the own test setup, please use the running number and add a comment to it under the table.
 
This page is to track different configurations that were tested under different setups, raid systems, and file systems. If one needs to add comments to the own test setup, please use the running number and add a comment to it under the table.
  
 +
 +
<u>for tool testscript.sh:</u>
 +
* averaged sequential/parallel read: sum of all bytes over all files divided by total time taken
 +
* averaged sequential/parallel write: bytes per file divided by (total time taken divided by total number of files written)
 +
* parallel read/write default: 10 parallel reads and writes for large files, 20 parallel writes for small files
 +
* other default: 5.1 TB used of mixed files for read, 100x54GB and 200,000x131kB files written
  
  
Line 7: Line 13:
 
! Property
 
! Property
 
| 1
 
| 1
 +
| 2
 +
| 3
 
|-   
 
|-   
 
! Filesystem  
 
! Filesystem  
−
|ZFS
+
| ZFS
 +
| XFS
 +
| Ext4
 
|-
 
|-
 
! Special filesystem config  
 
! Special filesystem config  
 +
| xattr=sa, relatime=on
 
|  
 
|  
 +
|
 
|-
 
|-
 
! Kind of raid
 
! Kind of raid
−
|  
+
| 3xraidz2
 +
| raid60
 +
| raid60
 
|-
 
|-
 
! Number of Disks
 
! Number of Disks
−
|  
+
| 33, 11 per raidz2
 +
| 33, 11 per raid6
 +
| 33, 11 per raid6
 
|-
 
|-
 
! Kind of Disks
 
! Kind of Disks
−
|
+
| 2TB SAS, 7200k, 6Gbps
 +
| 2TB SAS, 7200k, 6Gbps
 +
| 2TB SAS, 7200k, 6Gbps
 
|-
 
|-
 
! Controller
 
! Controller
−
|  
+
| PERC H800 (33xraid0)
 +
| PERC H800
 +
| PERC H800
 
|-
 
|-
 
! Controller Cache used
 
! Controller Cache used
−
|  
+
| yes (512 MB)
 +
| yes (512 MB)
 +
| yes (512MB)
 
|-
 
|-
 
! RAM
 
! RAM
−
|  
+
| 12GB
 +
| 12GB
 +
| 12GB
 
|-
 
|-
 
! CPU
 
! CPU
−
|
+
| 2xE5620, 2.4GHz, HT on
 +
| 2xE5620, 2.4GHz, HT on
 +
| 2xE6520, 2.4GHz, HT on
 
|-
 
|-
 
! OS
 
! OS
−
|
+
| SL6
 +
| SL6
 +
| SL6
 
|-
 
|-
−
! averaged sequential read
+
! normal averaged sequential read
−
|
+
| 536MB/s
 +
| 856MB/s
 +
| 607MB/s
 
|-
 
|-
−
! averaged parallel read
+
! normal averaged parallel read
−
|
+
| 746MB/s
 +
| 538MB/s
 +
| 533MB/s
 
|-
 
|-
−
! averaged sequential large writes
+
! normal averaged sequential large writes
−
|
+
| 709MB/s
 +
| 667MB/s
 +
| 348MB/s
 
|-
 
|-
−
! averaged parallel large writes  
+
! normal averaged parallel large writes  
−
|
+
| 680MB/s
 +
| 314MB/s
 +
| 140MB/s
 
|-
 
|-
−
! averaged sequential small writes
+
! normal averaged sequential small writes
−
|
+
| 10MB/s
 +
| 2MB/s
 +
| 2MB/s
 
|-
 
|-
−
! averaged parallel small writes  
+
! normal averaged parallel small writes  
−
|
+
| 74MB/s
 +
| 15MB/s
 +
| 20MB/s
 +
|-
 +
! degrated averaged sequential read
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! degrated averaged parallel read
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! degrated averaged sequential large writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! degrated averaged parallel large writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! degrated averaged sequential small writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! degrated averaged parallel small writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! rebuild, averaged sequential read
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! rebuild, averaged parallel read
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! rebuild, averaged sequential large writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! rebuild, averaged parallel large writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! rebuild, averaged sequential small writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 +
|-
 +
! rebuild, averaged parallel small writes
 +
| MB/s
 +
| MB/s
 +
| MB/s
 
|-
 
|-
 
|}
 
|}
 +
 +
 +
<u>Comments:</u><br>
 +
Files for read test where on compressed area of ZFS (root files, tgz files, LSST data files)

Revision as of 14:14, 28 January 2017

This page is to track different configurations that were tested under different setups, raid systems, and file systems. If one needs to add comments to the own test setup, please use the running number and add a comment to it under the table.


for tool testscript.sh:

  • averaged sequential/parallel read: sum of all bytes over all files divided by total time taken
  • averaged sequential/parallel write: bytes per file divided by (total time taken divided by total number of files written)
  • parallel read/write default: 10 parallel reads and writes for large files, 20 parallel writes for small files
  • other default: 5.1 TB used of mixed files for read, 100x54GB and 200,000x131kB files written


Property 1 2 3
Filesystem ZFS XFS Ext4
Special filesystem config xattr=sa, relatime=on
Kind of raid 3xraidz2 raid60 raid60
Number of Disks 33, 11 per raidz2 33, 11 per raid6 33, 11 per raid6
Kind of Disks 2TB SAS, 7200k, 6Gbps 2TB SAS, 7200k, 6Gbps 2TB SAS, 7200k, 6Gbps
Controller PERC H800 (33xraid0) PERC H800 PERC H800
Controller Cache used yes (512 MB) yes (512 MB) yes (512MB)
RAM 12GB 12GB 12GB
CPU 2xE5620, 2.4GHz, HT on 2xE5620, 2.4GHz, HT on 2xE6520, 2.4GHz, HT on
OS SL6 SL6 SL6
normal averaged sequential read 536MB/s 856MB/s 607MB/s
normal averaged parallel read 746MB/s 538MB/s 533MB/s
normal averaged sequential large writes 709MB/s 667MB/s 348MB/s
normal averaged parallel large writes 680MB/s 314MB/s 140MB/s
normal averaged sequential small writes 10MB/s 2MB/s 2MB/s
normal averaged parallel small writes 74MB/s 15MB/s 20MB/s
degrated averaged sequential read MB/s MB/s MB/s
degrated averaged parallel read MB/s MB/s MB/s
degrated averaged sequential large writes MB/s MB/s MB/s
degrated averaged parallel large writes MB/s MB/s MB/s
degrated averaged sequential small writes MB/s MB/s MB/s
degrated averaged parallel small writes MB/s MB/s MB/s
rebuild, averaged sequential read MB/s MB/s MB/s
rebuild, averaged parallel read MB/s MB/s MB/s
rebuild, averaged sequential large writes MB/s MB/s MB/s
rebuild, averaged parallel large writes MB/s MB/s MB/s
rebuild, averaged sequential small writes MB/s MB/s MB/s
rebuild, averaged parallel small writes MB/s MB/s MB/s


Comments:
Files for read test where on compressed area of ZFS (root files, tgz files, LSST data files)

Retrieved from "https://www.gridpp.ac.uk/w/index.php?title=ZFS-Tests&oldid=13350"