{"id":809,"date":"2007-05-17T16:36:41","date_gmt":"2007-05-17T20:36:41","guid":{"rendered":"http:\/\/fgiasson.com\/blog\/index.php\/2007\/05\/17\/free-text-search-on-musicbrainz-literals-using-virtuoso-rdf-views\/"},"modified":"2007-05-17T16:36:41","modified_gmt":"2007-05-17T20:36:41","slug":"free-text-search-on-musicbrainz-literals-using-virtuoso-rdf-views","status":"publish","type":"post","link":"https:\/\/fgiasson.com\/blog\/index.php\/2007\/05\/17\/free-text-search-on-musicbrainz-literals-using-virtuoso-rdf-views\/","title":{"rendered":"Free text search on Musicbrainz literals using Virtuoso RDF Views"},"content":{"rendered":"

I introduced a Virtuoso RDF View<\/a> that maps the Musicbrainz<\/a> relational database into RDF using the Music Ontology<\/a> a couple of weeks ago. Now I will show some query examples evolving a special feature of these Virtuoso<\/a> RDF Views: full text search on literals.<\/p>\n

How RDF Views work<\/h2>\n

A Virtuoso RDF View<\/a> can be seen as a layer between a relational database schemas and its conceptualization in RDF. The role of this layer is to convert relation data in its RDF conceptualization.<\/p>\n

That is it. You can see it as a conversion tool or as a sort of lens to see RDF data out of relation data.<\/p>\n

How full text search over literals works<\/h2>\n

Recently OpenLink Software introduced the full text feature of their Virtuoso’s SPARQL processor with the usage of the “bif:contains” operator (it is introduced into the SPARQL syntax like a FILTER).<\/p>\n

When a user sends a SPARQL query using the bif:contains operator against a Virtuoso triple store, the parser will use the triple store’s full text index to perform the full text search over the queried literal.<\/p>\n

With Virtuoso RDF View, instead of using the triple store’s full text index, it will use the relational database’s full text index (if the relational database is supporting full text indexes, naturally).<\/p>\n

Some queries examples<\/h2>\n

In this section I will show you how the full text feature of the Virtuoso RDF Views can be used to increase the performance of a query against the Musicbrainz RDF View modeled using the Music Ontology<\/p>\n

Note: if the system asks you for a login and a password to see the page, use the login name “demo” and the password “demo” to see the results of these SPARQL queries.<\/em><\/p>\n

Example #1<\/h3>\n

A user remember that first name of the music artist is Paul<\/strong>, and he remember that one of the albums composed by this artists is Press Play<\/strong>. So this user wants to get the full name of this artist with the following SPARQL query:<\/p>\n

sparql
\ndefine input:storage virtrdf:MBZROOT
\nPREFIX rdf: <http:\/\/www.w3.org\/1999\/02\/22-rdf-syntax-ns#>
\nPREFIX foaf: <http:\/\/xmlns.com\/foaf\/0.1\/>
\nPREFIX mo: <http:\/\/purl.org\/ontology\/mo\/>
\nPREFIX dc: <http:\/\/purl.org\/dc\/elements\/1.1\/>
\nSELECT ?artist_name ?album_title
\nFROM <http:\/\/musicbrainz.org\/>
\nWHERE
\n{
\n?artist rdf:type mo:SoloMusicArtist .
\n?artist foaf:name ?artist_name .
\n?artist mo:creatorOf ?album .<\/p>\n

?album rdf:type mo:Record .
\n?album dc:title ?album_title .<\/p>\n

FILTER bif:contains(?artist_name, “Paul”) .
\nFILTER bif:contains(?album_title, “Press and Play”) .
\n};<\/p><\/blockquote>\n

Results of this query against the musicbrainz virtuoso rdf view<\/a><\/p>\n

As you can notice with that query, the user will use the full text capabilities of Virtuoso over two different literals: the objects of these two properties foaf:name and dc:title.<\/p>\n

Example #2<\/h3>\n

In this example, the user wants to know the name of the albums published by Madonna<\/strong> between 1990 and 2000<\/strong>. The answer to this question is returned by the following SPARQL query:<\/p>\n

sparql
\ndefine input:storage virtrdf:MBZROOT
\nPREFIX rdf: <http:\/\/www.w3.org\/1999\/02\/22-rdf-syntax-ns#>
\nPREFIX foaf: <http:\/\/xmlns.com\/foaf\/0.1\/>
\nPREFIX mo: <http:\/\/purl.org\/ontology\/mo\/>
\nPREFIX dcterms: <http:\/\/purl.org\/dc\/terms\/>
\nprefix dc: <http:\/\/purl.org\/dc\/elements\/1.1\/>
\nSELECT DISTINCT ?albums_titles ?creation_date
\nFROM <http:\/\/musicbrainz.org\/>
\nWHERE
\n{
\n?madonna rdf:type mo:SoloMusicArtist .
\n?madonna foaf:name ?madonna_name .
\nFILTER bif:contains(?madonna_name, “Madonna”) .<\/p>\n

?madonna mo:creatorOf ?albums .
\n?albums rdf:type mo:Record .
\n?albums dcterms:created ?creation_date .
\nFILTER ( xsd:dateTime(?creation_date) > “1990-01-01T00:00:00Z”^^xsd:dateTime ) .
\nFILTER ( xsd:dateTime(?creation_date) < “2000-01-01T00:00:00Z”^^xsd:dateTime ) .
\n?albums dc:title ?albums_titles .
\n};<\/p><\/blockquote>\n

Results of this query against the musicbrainz virtuoso rdf view<\/a><\/p>\n

Here the user will use the full text capabilities of the Virtuoso RDF Views to find artists with the name Madonna and he uses two filters on xsd:dateTime objects to find the albums that have been created between 1990 and 2000.<\/p>\n

Examples #3<\/h3>\n

In this last example, the user wants to know the name of the members of the music group U2<\/strong>.<\/p>\n

sparql
\ndefine input:storage virtrdf:MBZROOT
\nPREFIX rdf: <http:\/\/www.w3.org\/1999\/02\/22-rdf-syntax-ns#>
\nPREFIX foaf: <http:\/\/xmlns.com\/foaf\/0.1\/>
\nPREFIX mo: <http:\/\/purl.org\/ontology\/mo\/>
\nSELECT ?band_name ?member_name
\nFROM <http:\/\/musicbrainz.org\/>
\nWHERE
\n{
\n?band rdf:type mo:MusicGroup .
\n?band foaf:name ?band_name .
\n?band_name bif:contains ‘”U2″‘ .
\n?band foaf:member ?members .
\n?members rdf:type mo:SoloMusicArtist .
\n?members foaf:name ?member_name .
\n};<\/p><\/blockquote>\n

Results of this query against the musicbrainz virtuoso rdf view<\/a><\/p>\n

Here the user will use the full text feature to get the name of the music group, then the name of the members related to this (these) music group(s) will be returned as well.<\/p>\n

Special operators of a full text search<\/h2>\n

Some full texts operators can be used in the literal parameter of the bif:contains clause. The operators are the same used in the full text feature of Virtuoso’s relational database. A list and a description of the operators can be found on that page<\/a>.<\/p>\n

I would only add that the near<\/strong> operator is defined as +\/- 100 chars from the searched literal. And the wildcard ‘*’<\/strong> operator should at least be placed after the third character of the literal. So, “tes*t” or “tes*” or “test*” are legal usages of the wildcard operator, but “*test”, “t*” or “te*st” are illegal usages of the operator.<\/p>\n

Conclusion<\/h2>\n

Finally, as you can see, the full text feature available with the Virtuoso RDF Views is a more than essential feature that people should use to increase the performance of their SPARQL queries. The only two other options they have are: (1) using a normal “literal” that as to be well written and with the good cases; in one word this option render such queries useless and (2) they can use a FILTER with a regular expression with the “I” parameter that is far too slow for normal usages.<\/p>\n","protected":false},"excerpt":{"rendered":"

I introduced a Virtuoso RDF View that maps the Musicbrainz relational database into RDF using the Music Ontology a couple of weeks ago. Now I will show some query examples evolving a special feature of these Virtuoso RDF Views: full text search on literals. How RDF Views work A Virtuoso RDF View can be seen […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[149,84],"tags":[],"class_list":["post-809","post","type-post","status-publish","format-standard","hentry","category-musicontology","category-semantic-web"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/809","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=809"}],"version-history":[{"count":0,"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/809\/revisions"}],"wp:attachment":[{"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=809"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=809"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fgiasson.com\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=809"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}