Call for support in building SAWSDL Service Test Collection

Previous Topic Next Topic
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Call for support in building SAWSDL Service Test Collection

Matthias Klusch-2

Dear colleagues,

I would like to kindly ask for your support in collecting SAWSDL
services for an initial test collection.
We aim to use this collection for measuring retrieval performance
and scalability of SAWSDL matchmakers (for example in the upcoming S3
Semantic Service Selection contest).

So far, we have an initial retrieval test collection SAWSDL-TC1 beta
deduced from the collection OWLS-TC2 (by help of conversion tools and
manual work) and collected SAWSDL services from different sources
in the Web we came across. This beta version contains
actually more than 800 services and 28 queries (formulated as desired
SAWSDL services).

But for sure there is a lot more somewhere, especially in hidden project
repositories. So, this is a desparate call for your help in finding
and collecting SAWSDL services of all degrees of complexity.
Even if the incentive to do so is low in terms of money and time,
means actually zero, i know :-( - we nevertheless could do at least
such initial steps together in building such a test collection over

We would therefore appreciate any help in this matter: You can send us
- SAWSDL services, and/or
- one or more queries formulated as a desired SAWSDL service
   together with binary relevance set (= set of SAWSDL services
   you think are relevant)
in a zip-file.

Depending on the feedback, we will then put the first version of
the collection SAWSDL-TC1 online such that we then can jointly add and
modify it continuously online and/or at the next S3 contest at the SMR2
workshop of the International Semantic Web Conference in Karlsruhe by
end of October.

Thanks for your very idealistic support and effort in advance!

Best regards,

PS: We beg for your understanding that we do *not* publish
our SAWSDL-TC1 beta right now.

Dr. Matthias Klusch
German Research Center for Artificial Intelligence (DFKI)
Stuhlsatzenhausweg 3, 66123 Saarbruecken, Germany
Phone: +49-681-302-5297, Fax: +49-681-302-2235
Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
Dr. Walter Olthoff
Vorsitzender des Aufsichtsrats:
Prof. Dr. h.c. Hans A. Aukes
Amtsgericht Kaiserslautern, HRB 2313