LogMicroscope:boost performance for logging system by 43%

Recently,I have rewritten the logging engine for LogMicroscope,using circular-buffer in log writing threads,and WriteFileGather in file writing thread to gathers up the data from these discrete buffers in memory and transfers them "in place" as a single operation.

with WriteFIleGather, the disk is always keep busy without entering and leaving from kernel mode. log data can be written to disk at a rate that approaches the limits of the physical characteristics of the hardware device.that’s really boost the I/O performance.

because the CPU is mostly idle during write operation,to maximum the performance,I have compressed the data before writing to the disk to reduce the amount of data to be written,the compress is always faster than the I/O operation,so that I get the compression for “free”.

after these changes,the performance for logging system has increased by over 43%.

Related posts:

1. Boost your WordPress performance on Windows IIS 6 with FastCGI and eAccelerator in 5 minutes
2. A fast memory Pool used by LogMicroscope@35
3. Happy birthday to LogMicroscope

• Boost your WordPress performance on Windows IIS 6 with FastCGI and eAccelerator in 5 minutes
• A fast memory Pool used by LogMicroscope@35
• Happy birthday to LogMicroscope
• apt-get … Segmentation Faulty Tree
• Sorting Algorithms Source Code and Performance

TAGS: logging, logmicroscope, performance

Posted on September 2nd, 2009 in Programming