DEAN LEE:/DEV/BLOG » logging http://www.deanlee.cn mount /dev/brain || tail -f /var/log/thoughts >> /pub/www Tue, 27 Jul 2010 05:21:25 +0000 en hourly 1 http://wordpress.org/?v=3.0 LogMicroscope:boost performance for logging system by 43% http://www.deanlee.cn/programming/logmicroscope-boost-logging-performance/ http://www.deanlee.cn/programming/logmicroscope-boost-logging-performance/#comments Wed, 02 Sep 2009 08:56:38 +0000 Dean Lee http://www.deanlee.cn/programming/logmicroscope-boost-logging-performance/
  • Boost your WordPress performance on Windows IIS 6 with FastCGI and eAccelerator in 5 minutes
  • A fast memory Pool used by LogMicroscope@35
  • Happy birthday to LogMicroscope
    • ]]>     Recently,I have rewritten the logging engine for LogMicroscope,using circular-buffer in log writing threads,and WriteFileGather in file writing thread to gathers up the data from these discrete buffers in memory and transfers them "in place" as a single operation.

    with WriteFIleGather, the disk is always keep busy without entering and leaving from kernel mode. log data can be written to disk at a rate that approaches the limits of the physical characteristics of the hardware device.that’s really boost the I/O performance.

    because the CPU is mostly idle during write operation,to maximum the performance,I have compressed the data before writing to the disk to reduce the amount of data to be written,the compress is always faster than the I/O operation,so that I get the compression for “free”.

    after these changes,the performance for logging system has increased by over 43%.

    Related posts:

    1. Boost your WordPress performance on Windows IIS 6 with FastCGI and eAccelerator in 5 minutes
    2. A fast memory Pool used by LogMicroscope@35
    3. Happy birthday to LogMicroscope

    ]]>     http://www.deanlee.cn/programming/logmicroscope-boost-logging-performance/feed/ 0