Monday, January 3, 2011

Parallel Disk IO

I've added an article on Parallel Disk IO Subsystem:
http://www.1024cores.net/home/scalable-architecture/parallel-disk-io
It's based on my Wide Finder 2 entry, but it's quite general and describes common aspects and patterns and anti-patterns. It shows how not to under-subscribe nor over-subscribe CPUs and disks, how to keep data hot in caches and memory, how to automatically adapt to various external conditions, etc.

Here is also a brief write-up on the Wide Finder 2 entry itself:
http://www.1024cores.net/home/scalable-architecture/wide-finder-2

2 comments: