The key to getting good performance is metrics. You need to measure every aspect of a system as it’s running to determine where the problems are and to prioritize where to expend optimization effort. Particular metrics of interest are:
- Queue sizes
- Queue rates
- # of clients (by IP and by connection count)
- # of pending requests
- average response rate
- throughput