Bases de Données / Databases

Site Web de l'équipe BD du LIP6 / LIP6 DB Web Site

User Tools

Site Tools


en:site:recherche:logiciels:sparqlwithspark

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
en:site:recherche:logiciels:sparqlwithspark [15/09/2016 16:13] – [Snowflake queries] huberten:site:recherche:logiciels:sparqlwithspark [26/04/2017 11:14] (current) amann
Line 1: Line 1:
 {{indexmenu_n>2}} {{indexmenu_n>2}}
- 
  
  
 ====== SPARQL query processing with Apache Spark ====== ====== SPARQL query processing with Apache Spark ======
-This wiki is a companion to the //SPARQL query processing with Apache Spark// paper submitted at EDBT 2017.+This wiki is a companion to the following publications: 
 +  * [[https://hal.archives-ouvertes.fr/hal-01502519|SPARQL Graph Pattern Processing with Apache Spark]] 
 +  * [[https://arxiv.org/abs/1604.08903|SPARQL query processing with Apache Spark]] 
 +  * [[https://hal.archives-ouvertes.fr/hal-01214900|HAQWA: a Hash-based and Query Workload Aware Distributed RDF Store]] 
 +  * [[https://hal.archives-ouvertes.fr/hal-01214902|On the Evaluation of RDF Distribution Algorithms Implemented over Apache Spark]]
  
-It provides access to some resources related to the evaluation section.+It provides access to the resources related to the evaluation section of [[https://arxiv.org/abs/1604.08903|SPARQL query processing with Apache Spark]]. 
 + 
 +See also [[en:site:recherche:logiciels:rdfdist]] concerning RDF distribution approaches using Spark
  
 ===== Data sets ===== ===== Data sets =====
Line 16: Line 21:
  
 ===== Query processing ===== ===== Query processing =====
 +
 +==== WatDiv queries ====
 +
 +
 +=== Query S1 ===
 +<code sparql>
 +SELECT ?v0 ?v1 ?v3 ?v4 ?v5 ?v6 ?v7 ?v8 ?v9 WHERE {
 +?v0 gr:includes ?v1 . %v2% gr:offers ?v0 .
 +?v0 gr:price ?v3 . ?v0 gr:serialNumber ?v4 .
 +?v0 gr:validFrom ?v5 . ?v0 gr:validThrough ?v6 .
 +?v0 sorg:eligibleQuantity ?v7 .
 +?v0 sorg:eligibleRegion ?v8 .
 +?v0 sorg:priceValidUntil ?v9 . }
 +</code>
 +
 +See [[en:site:recherche:logiciels:sparqlwithspark:watDivS1]]
 +
 +=== Query F5 ===
 +<code sparql>
 +SELECT ?v0 ?v1 ?v3 ?v4 ?v5 ?v6 WHERE {
 +?v0 gr:includes ?v1 . %v2% gr:offers ?v0 .
 +?v0 gr:price ?v3 . ?v0 gr:validThrough ?v4 .
 +?v1 og:title ?v5 . ?v1 rdf:type ?v6 . }
 +</code>
 +
 +See [[en:site:recherche:logiciels:sparqlwithspark:watDivF5]]
 +== Execution reports for F5 ==
 +
 +^Plan  ^  Execution report  ^
 +|SPARQL DF  |  {{:en:site:recherche:logiciels:f5_plan_sparql_df.png?300|SPARQL DF}}  |
 +|SPARQL Hybrid|  {{:en:site:recherche:logiciels:f5_plan_sparql_hybrid.png?300|SPARQL Hybrid}}  |
 +|S2RDF        |  {{:en:site:recherche:logiciels:f5_plan_s2rdf.png?300|S2RDF}}  |
 +|S2RDF+Hybrid        |  {{:en:site:recherche:logiciels:f5_plan_s2rdf_hybrid.png?300|S2RDF+Hybrid}}  |
 +
 +
 +=== Query C3 ===
 +<code sparql>
 +SELECT ?v0 WHERE {
 +?v0 wsdbm:likes ?v1 . ?v0 wsdbm:friendOf ?v2 .
 +?v0 dc:Location ?v3 . ?v0 foaf:age ?v4 .
 +?v0 wsdbm:gender ?v5 . ?v0 foaf:givenName ?v6 . }
 +</code>
 +
 +See [[en:site:recherche:logiciels:sparqlwithspark:watDivC3]]
 +
  
 ==== Star queries ==== ==== Star queries ====
Line 22: Line 72:
 Star with 3 branches Star with 3 branches
  
-<code>+<code sparql>
 SELECT ?x ?a ?b SELECT ?x ?a ?b
 WHERE { WHERE {
Line 31: Line 81:
  
 Star with 5 branches Star with 5 branches
-<code>+<code sparql>
 SELECT ?x ?a ?b ?c ?d SELECT ?x ?a ?b ?c ?d
 WHERE { WHERE {
Line 43: Line 93:
  
 Star with 10 branches Star with 10 branches
-<code>+<code sparql>
 SELECT ?x ?a ?b ?c ?d ?g ?h ?i SELECT ?x ?a ?b ?c ?d ?g ?h ?i
 WHERE { WHERE {
Line 51: Line 101:
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggDrugId> ?c .  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggDrugId> ?c .
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggCompoundId> ?d .  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggCompoundId> ?d .
- ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/pharmacology> "?e.+ ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/pharmacology> ?e.
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/mechanismOfAction> ?f  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/mechanismOfAction> ?f
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/predictedLogs> ?g .  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/predictedLogs> ?g .
Line 60: Line 110:
  
 Star with 15 branches Star with 15 branches
-<code>+<code sparql>
 SELECT ?x ?a ?b ?c ?d ?g ?h ?i ?j ?k ?l SELECT ?x ?a ?b ?c ?d ?g ?h ?i ?j ?k ?l
 WHERE { WHERE {
Line 68: Line 118:
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggDrugId> ?c .  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggDrugId> ?c .
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggCompoundId> ?d .  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/keggCompoundId> ?d .
- ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/pharmacology> "?e.+ ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/pharmacology> ?e.
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/mechanismOfAction> ?f  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/mechanismOfAction> ?f
  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/predictedLogs> ?g .  ?x <http://www4.wiwiss.fu-berlin.de/drugbank/resource/drugbank/predictedLogs> ?g .
Line 87: Line 137:
 === Chain4 query === === Chain4 query ===
 Chain4 is  Chain4 is 
-<code>+<code sparql>
 SELECT ?x1, ?x2, ?x3, ?x4, ?x5  WHERE { ?x1 P1 ?x2 . ?x2 P2 ?x3 . ?x3 P3 ?x4 . ?x4 P4 ?x5 } SELECT ?x1, ?x2, ?x3, ?x4, ?x5  WHERE { ?x1 P1 ?x2 . ?x2 P2 ?x3 . ?x3 P3 ?x4 . ?x4 P4 ?x5 }
 </code> </code>
 with properties with properties
-<code>+<code scala>
 val P1 = 1389363200 val P1 = 1389363200
 val P2 = 52239 val P2 = 52239
Line 100: Line 150:
  
 === Chain6 query === === Chain6 query ===
-<code>+<code sparql>
 SELECT ?x1, ?x2, ?x3, ?x4, ?x5, ?x6, ?x7   WHERE { ?x1 P1 ?x2 . ?x2 P2 ?x3 . ?x3 P3 ?x4 . ?x4 P4 ?x5 . ?x5 P5 ?x6 . ?x6 P6 ?x7 } SELECT ?x1, ?x2, ?x3, ?x4, ?x5, ?x6, ?x7   WHERE { ?x1 P1 ?x2 . ?x2 P2 ?x3 . ?x3 P3 ?x4 . ?x4 P4 ?x5 . ?x5 P5 ?x6 . ?x6 P6 ?x7 }
 </code> </code>
 with properties with properties
-<code>+<code scala>
 val P1 = 18843 val P1 = 18843
 val P2 = 5540 val P2 = 5540
Line 117: Line 167:
  
 SPARQL for Q8 from LUBM test suite SPARQL for Q8 from LUBM test suite
-<code>+<code sparql>
 PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
 PREFIX ub: <http://www.lehigh.edu/~zhp2/2004/0401/univ-bench.owl#> PREFIX ub: <http://www.lehigh.edu/~zhp2/2004/0401/univ-bench.owl#>
Line 131: Line 181:
 See [[en:site:recherche:logiciels:sparqlwithspark:snowflakeQ8]]  See [[en:site:recherche:logiciels:sparqlwithspark:snowflakeQ8]] 
  
-==== WatDiv queries ==== 
  
 +===== Misc =====
 + [[en:site:recherche:logiciels:sparqlwithspark:utility| Utility tools]]
  
-=== Query S1 === 
-<code> 
-SELECT ?v0 ?v1 ?v3 ?v4 ?v5 ?v6 ?v7 ?v8 ?v9 WHERE { 
-?v0 gr:includes ?v1 . %v2% gr:offers ?v0 . 
-?v0 gr:price ?v3 . ?v0 gr:serialNumber ?v4 . 
-?v0 gr:validFrom ?v5 . ?v0 gr:validThrough ?v6 . 
-?v0 sorg:eligibleQuantity ?v7 . 
-?v0 sorg:eligibleRegion ?v8 . 
-?v0 sorg:priceValidUntil ?v9 . } 
-</code> 
  
-See [[en:site:recherche:logiciels:sparqlwithspark:watDivS1]] 
  
-=== Query F5 === 
-<code> 
-SELECT ?v0 ?v1 ?v3 ?v4 ?v5 ?v6 WHERE { 
-?v0 gr:includes ?v1 . %v2% gr:offers ?v0 . 
-?v0 gr:price ?v3 . ?v0 gr:validThrough ?v4 . 
-?v1 og:title ?v5 . ?v1 rdf:type ?v6 . } 
-</code> 
  
-Graphical reports for plan S2RDF+Hybrid{{:en:site:recherche:logiciels:f5_plan_s2rdf_hybrid.png?200|}} and for plan S2RDF 
-{{:en:site:recherche:logiciels:f5_plan_s2rdf.png?200|}} 
  
-See [[en:site:recherche:logiciels:sparqlwithspark:watDivF5]] 
- 
-=== Query C3 === 
-<code> 
-SELECT ?v0 WHERE { 
-?v0 wsdbm:likes ?v1 . ?v0 wsdbm:friendOf ?v2 . 
-?v0 dc:Location ?v3 . ?v0 foaf:age ?v4 . 
-?v0 wsdbm:gender ?v5 . ?v0 foaf:givenName ?v6 . } 
-</code> 
- 
-See [[en:site:recherche:logiciels:sparqlwithspark:watDivC3]] 
- 
-===== Misc ===== 
- [[en:site:recherche:logiciels:sparqlwithspark:utility| Utility tools]] 
en/site/recherche/logiciels/sparqlwithspark.1473948782.txt.gz · Last modified: by hubert