{"id":163,"date":"2012-03-29T18:15:51","date_gmt":"2012-03-29T16:15:51","guid":{"rendered":"http:\/\/www.pmsapp.org\/?p=163"},"modified":"2012-04-17T13:10:09","modified_gmt":"2012-04-17T11:10:09","slug":"performance-testing-the-pmsapp-with-filebench","status":"publish","type":"post","link":"https:\/\/mail-e.dk\/pmsapp.org\/?p=163","title":{"rendered":"Performance testing the pmsApp with filebench &#8211; RAID1"},"content":{"rendered":"<p>Following on from my previous <a title=\"perf testing\" href=\"http:\/\/www.pmsapp.org\/2012\/03\/16\/performance-testing-the-pmsapp\/\">post<\/a>, I\u2019ve decided to use <a title=\"filebench\" href=\"http:\/\/sourceforge.net\/projects\/filebench\/?_test=b\">filebench<\/a>\u00a0 (Version 1.4.9.1)<br \/>\nfor a more structured testing approach. \u00a0Filebench is easy to work with, as it has already defined several application types (workload) profiles and is easy to install. The workloads can be defined easily (using <a title=\"WML\" href=\"http:\/\/sourceforge.net\/apps\/mediawiki\/filebench\/index.php?title=Filebench_Workload_Language\">WML scripting)<\/a> to mimic any sort of application load on the IO system. I cannot comment on how accurate these workloads are, but they make testing easy :).<\/p>\n<p>The method I\u2019ve used was very simple. Three runs of 60 seconds each, with the default settings for the workload profiles, except for the randomwrite and randomread workloads where I had to reduce the file size to 100 MB. I disabled randomization ( echo 0 &gt; \/proc\/sys\/kernel\/randomize_va_space ) as recommended by filebench. Filebench allocated 170 MB of shared memory on all the runs (this appears to be the default).<\/p>\n<p>The results are the average results of the three runs, except for the randomread workload where I only did two runs as the results were very similar. I did not repeat any tests as there was a lot less variation in the results. The results presented below are the IO summary result, rather than the individual operations results.<\/p>\n<p>So without further ado here are the results:<\/p>\n<table width=\"700\" border=\"0\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"86\"><\/td>\n<td valign=\"bottom\" width=\"86\"><strong>Workload<\/strong><\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"81\">varmail<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"80\">webserver<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"83\">fileserver<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"104\">randomwrite<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"94\">randomread<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"85\">webproxy<\/td>\n<\/tr>\n<tr>\n<td colspan=\"2\" valign=\"bottom\" nowrap=\"nowrap\" width=\"171\"><strong>Server<\/strong><\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"81\"><\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"80\"><\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"83\"><\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"104\"><\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"94\"><\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"85\"><\/td>\n<\/tr>\n<tr>\n<td colspan=\"2\" valign=\"bottom\" nowrap=\"nowrap\" width=\"171\">PMSTest (RAID1)<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"81\">1.24 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"80\">6.83 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"83\">4.20 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"104\">13.63 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"94\">89.1 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"85\">1.50 MB\/s<\/td>\n<\/tr>\n<tr>\n<td colspan=\"2\" valign=\"bottom\" nowrap=\"nowrap\" width=\"171\">PMSControl<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"81\">5.02 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"80\">3.73 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"83\">4.93 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"104\">39.83 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"94\">88.9 MB\/s<\/td>\n<td valign=\"bottom\" nowrap=\"nowrap\" width=\"85\">2.33 MB\/s<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>The webserver results are somewhat mystifying. The workload consists of opening, reading and closing files, so the results should be fairly similar but for some reason the pmsApp is faster!<\/p>\n<p>The rest of the results are as expected: \u00a0Writes are significantly slower due to nature of the pmsApp (namely a RAID array across a network link) and reads are comparable.<\/p>\n<p>It is also worth noting that regardless of the results, the test prep phase took longer, sometimes a lot longer, when running off the pmsApp, i.e on PMSTest.<\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li><a href=\"#\" class=\"sharing-anchor sd-button share-more\"><span>Share<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><div class=\"sharing-hidden\"><div class=\"inner\" style=\"display: none;\"><ul><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-163\" class=\"share-twitter sd-button share-icon\" href=\"https:\/\/mail-e.dk\/pmsapp.org\/?p=163&amp;share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\"><span>Twitter<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-163\" class=\"share-facebook sd-button share-icon\" href=\"https:\/\/mail-e.dk\/pmsapp.org\/?p=163&amp;share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\"><span>Facebook<\/span><\/a><\/li><li class=\"share-end\"><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Following on from my previous post, I\u2019ve decided to use filebench\u00a0 (Version 1.4.9.1) for a more structured testing approach. \u00a0Filebench is easy to work with, as it has already defined several application types (workload) profiles and is easy to install. &hellip; <a href=\"https:\/\/mail-e.dk\/pmsapp.org\/?p=163\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n<div class=\"sharedaddy sd-sharing-enabled\"><div class=\"robots-nocontent sd-block sd-social sd-social-icon-text sd-sharing\"><h3 class=\"sd-title\">Share this:<\/h3><div class=\"sd-content\"><ul><li><a href=\"#\" class=\"sharing-anchor sd-button share-more\"><span>Share<\/span><\/a><\/li><li class=\"share-end\"><\/li><\/ul><div class=\"sharing-hidden\"><div class=\"inner\" style=\"display: none;\"><ul><li class=\"share-twitter\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-twitter-163\" class=\"share-twitter sd-button share-icon\" href=\"https:\/\/mail-e.dk\/pmsapp.org\/?p=163&amp;share=twitter\" target=\"_blank\" title=\"Click to share on Twitter\"><span>Twitter<\/span><\/a><\/li><li class=\"share-facebook\"><a rel=\"nofollow noopener noreferrer\" data-shared=\"sharing-facebook-163\" class=\"share-facebook sd-button share-icon\" href=\"https:\/\/mail-e.dk\/pmsapp.org\/?p=163&amp;share=facebook\" target=\"_blank\" title=\"Click to share on Facebook\"><span>Facebook<\/span><\/a><\/li><li class=\"share-end\"><\/li><li class=\"share-end\"><\/li><\/ul><\/div><\/div><\/div><\/div><\/div>","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[1],"tags":[],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_shortlink":"https:\/\/wp.me\/p2gkts-2D","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=\/wp\/v2\/posts\/163"}],"collection":[{"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=163"}],"version-history":[{"count":8,"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=\/wp\/v2\/posts\/163\/revisions"}],"predecessor-version":[{"id":170,"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=\/wp\/v2\/posts\/163\/revisions\/170"}],"wp:attachment":[{"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=163"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=163"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mail-e.dk\/pmsapp.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=163"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}