Abstract

Approaches to Web services discovery, matchmaking, composition, and execution monitoring need a collection of descriptions of test services. Semantic Web services help attain better accuracy in these approaches by clarifying service descriptions. In the semantic Web service research area, there are some test collections. These test collections have some information-providing services. However, there is not a proper test collection that contains a reasonable number of both information-providing and world-altering services. This paper intends to investigate current available test collections, as well as other sources of service description. Their features (such as their description and expression languages) and a number of world-altering services, preconditions, and effects are compared, and their usage in current contests and challenges are discussed. Finally, a road map for standard test collections for world-altering semantic Web services is provided.