File Server Comparison:
Microsoft Windows NT Server 4.0
Microsoft Windows NT Server 4.0 Is 25.5% Faster Than Novell NetWare 5 as a File Server and Has 2.7 Times Better Price/Performance
Mindcraft tested the file-server performance of Microsoft Windows NT Server 4.0 and Novell NetWare 5 on a Compaq ProLiant 1850R. We tested file sharing using TCP/IP for both servers. Table 1 shows the peak throughput measured for each system in megabits per second (Mbits/S), the price of the software tested, and the price/performance in dollars per Mbits/S.
Table 1: Summary
For a one-processor system at peak file server performance, Windows NT Server 4.0 is 18.7% faster than NetWare 5 and its price/performance is 2.5 times better. For a two-processor system, Windows NT Server 4.0 is 25.5% faster than NetWare 5 at peak performance. Its price/performance is 2.7 times better. The most surprising result we found was that a one-processor system running Windows NT Server 4.0 performed 4.2% better than the same system with two processors running NetWare 5.
Mindcraft tested these file servers with the Ziff-Davis Benchmark Operation NetBench 5.01 benchmark. We worked closely with Microsoft and Novell to obtain the best tuning parameters for both operating systems. We avoided using tuning parameters that might be construed as benchmark specials because we wanted to give you a better sense of how the products would perform when you deploy them. The Products Tested section gives the detailed operating system tuning we used.
Even with the release of NetWare 5, Windows NT Server 4.0 still provides the better solution based on performance and price/performance.
Looking at the Results
The NetBench 5.01 benchmark measures file server performance. Its primary performance metric is throughput in bytes per second. The NetBench documentation defines throughput as "The number of bytes a client transferred to and from the server each second. NetBench measures throughput by dividing the number of bytes moved by the amount of time it took to move them. NetBench reports throughput as bytes per second." We report throughput in megabits per second to make the charts easier to compare to other published NetBench results.
We tested file-sharing performance on Windows NT Server 4.0 and NetWare 5.0 using TCP/IP as the underlying protocol for both systems. Figure 1 shows the throughput we measured plotted against the number of test systems that participated in each data point.
Figure 1: NetBench Throughput Performance(larger numbers are better)
You need to know how NetBench 5.01 works in order to understand what the NetBench throughput measurement means. NetBench is designed to stress a file server by using a number of test systems to read and write files on it. Specifically, a NetBench test suite is made up of a number of mixes. A mix is a particular configuration of NetBench parameters, including the number of test systems used to load the server. Typically, each mix increases the load on the server by increasing the number of test systems involved while keeping the rest of the parameters the same. We modified the standard NetBench NBDM_60.TST test suite in order to test each product to its maximum performance level and to make the test run in a reasonable amount of time. For example, we used 144 test systems to make sure that each operating system achieved its maximum performance. The parameters we used are shown in NetBench Test Suite Configuration Parameters.
The three major areas to look at are:
This tells you the maximum throughput you can expect from a file server. NetBench throughput is primarily a function of how quickly a file server responds to file operations from a given number of test systems. So a more responsive file server will be able to handle more operations per second which will yield higher throughput.
Shape of the Performance Curve
How a product performs as a function of load is perhaps the most meaningful information NetBench produces. If performance drops off rapidly after the peak, users may experience significant unpredictable and slow response times as the load on the server increases. On the other hand, a product whose performance is flat or degrades slowly after the peak can deliver more predictable performance under load.
Where Peak Performance Occurs
How quickly these products reach their peak performance depends on the server hardware performance, the operating system performance, and the test system performance. In this case, we tested a fast server platform with significantly slower clients. This test lab setup meant that small numbers of clients could not generate enough requests to utilize the server processor(s) fully. So the part of the throughput performance curve to the left of the peak does not tell us anything of interest. For the products tested the shape of the performance curves after the peaks is relatively flat but does fall off slightly. This means that we did reach the maximum performance of the products. Had the peak occurred at the last data point, we would not have known whether or not we had tested the products to peak performance.
Windows NT Server 4.0 offers high-performance file sharing on one- and two-processor systems. It outperforms NetWare 5 and its performance characteristics help keep users more productive and aid system administrators in providing appropriate file-server capacity.
We calculated price/performance by dividing the street price of the software tested by the peak throughput measured in megabits per second. We left out the cost of the computer because the tests were run on the same system and because we assumed you were making a decision about which file server software to use.
We obtained a street price of $4,949 for a 144-user license of Windows NT Server 4.0 by requesting a quote from Source One/Microage, a value-added reseller. The quote was $779 for a 5-user license and $30/user * 139 users.
Source One/Microage also quoted us $10,035 as the street price for a 155-user license for NetWare 5 (because of the way Novell licenses NetWare 5, it is less expensive to get a license for the extra eleven users than it would be to get a license for exactly 144 users). The quote was $987 for a 5-user license, $5,649 for a 100-user license, and $3,399 for a 50-user license
Configuration and Tuning
We used the same Compaq ProLiant 1850R to test both Windows NT Server 4.0 and NetWare 5. Table 2 shows the system configuration we used.
Table 2: Compaq ProLiant 1850R Configuration
Windows NT Server 4.0 Configuration
To run the one-processor tests, we booted the ProLiant 1850R with the uniprocessor kernel version of Windows NT Server 4.0. Similarly, we used the multiprocessor kernel for the two-processor tests.
NetWare 5 Configuration
To run the one-processor tests, we booted the ProLiant 1850R with the symmetric multiprocessor platform specific module (PSM) CPQMPK.PSM commented out in the STARTUP.NCF file. Similarly, we used the multiprocessor kernel for the two-processor tests. That PSM was included for the two-processor tests.
NetWare 5 Client Configuration
We set the following parameters in the Advanced Settings for the NetWare Client 3.00:
We also set the following values in the registry on each client:
The Test Systems and Network Configuration
Mindcraft ran these tests using a total of 144 test systems made up of three types. Table 3, Table 4, and Table 5 show the system configurations. We used 72 Type A systems, 24 Type B systems, and 48 Type C systems.
Table 3: Type A Test Systems Configuration
Table 4: Type B Test Systems Configuration
Table 5: Type C Test Systems Configuration
Two switched networks made up of 12 Bay Networks LS28115 switches connected the test systems to the Compaq ProLiant 1850R. Figure 2 shows the test lab configuration.
Figure 2: Test Lab Configuration
Mindcraft, Inc. was commissioned by Microsoft Corporation to produce an independent and unbiased assessment of the file-server performance of Windows NT Server 4.0 and NetWare 5 using NetBench 5.01. We conducted the performance tests described in this report on September 22 and 24, 1998.
Mindcraft certifies that the results reported herein represent the file-server performance of Microsoft Windows NT Server 4.0 and Novell NetWare 5 running on a Compaq ProLiant 1850R as measured by NetBench 5.01.
Our test results should be reproducible by others who use the same test lab configuration as well as the computer and software configurations and modifications documented in this report.
Windows NT Server 4.0 on a One-Processor ProLiant 1850R
Windows NT Server 4.0 on a Two-Processor ProLiant 1850R
NetWare 5.0 on a One-Processor ProLiant 1850R
NetWare 5.0 on a Two-Processor ProLiant 1850R
The information in this publication is subject to change without notice.
MINDCRAFT, INC. SHALL NOT BE LIABLE FOR ERRORS OR OMISSIONS CONTAINED HEREIN, NOR FOR INCIDENTAL OR CONSEQUENTIAL DAMAGES RESULTING FROM THE FURNISHING, PERFORMANCE, OR USE OF THIS MATERIAL.
This publication does not constitute an endorsement of the product or products that were tested. This test is not a determination of product quality or correctness, nor does it ensure compliance with any federal, state or local requirements.
The Mindcraft tests discussed herein were performed without independent verification by Ziff-Davis and Ziff-Davis makes no representations or warranties as to the results of the tests.
Mindcraft is a registered trademark of Mindcraft, Inc.
Product and corporate names mentioned herein are trademarks and/or registered trademarks of their respective companies.
|Copyright © 1997-98. Mindcraft, Inc. All rights reserved.
Mindcraft is a registered trademark of Mindcraft, Inc.
For more information, contact us at: firstname.lastname@example.org
Phone: +1 (408) 395-2404
Fax: +1 (408) 395-6324