Fault tolerant programming for network based parallel computing

Methods and tools for fault tolerance in network based parallel computing are analyzed. Different communications libraries are now available which make it possible to use a local area network as a parallel computer. These libraries provide different services, however only little attention is devoted to the problem of fault tolerance. Using the fact that most of parallel applications exhibit a regular structure it is shown that to provide fault tolerance to this type of computation is much more simple than to provide fault tolerance in a general concurrent program. The primitives which are necessary to support the proposed design, and general implementation problems with respect to shared virtual memory and message passing communications models are briefly considered.