New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable SPARQL query of HDT storage. #1

Open

donpellegrino opened this issue Oct 3, 2023 · 1 comment

Assignees

Labels

donpellegrino commented Oct 3, 2023

Add the capability to perform SPARQL queries of RDF data stored in HDT files.

donpellegrino added the enhancement label

donpellegrino self-assigned this

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added upstream hdt-cpp as a Git submodule.

2cb194c

donpellegrino added a commit that referenced this issue


          Issue #1 WIP Converted DatasetView to a trait having a Key-Value-base…

6a29065

…d implementation. Converted functions to use generics for the DatasetView trait. Code compiles.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP Added blanket implementations for &T and Rc<T> reference…

866b641

…s to the new traits to avoid the use of ugly &(*dataset) versus simple &dataset parameters to function calls.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP Replaced use of ugly &(*self.dataset) versus simple &sel…

629db00

…f.dataset parameters to function calls.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Compiles and runs three test SPARQL SELECT queries on …

81f847d

…an HDT file successfully.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Used a macro to elminiate duplicate code for trait bla…

11ceefc

…nket implementations of &T and Rc<T>. Updated the HDT test driver to open the HDT only once and reuse the dataset instance via Rc<HDTDatasetView>.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Updated the SPARQL tests in the HDT driver (main.rs) t…

fb5d394

…o output CSV. Updated the HDT/OxRDF transformations to use NamedNode.into_string() and Term::from_str() where possible.

donpellegrino added a commit that referenced this issue


          Fix for Issue #2 to perform DevCloud builds on compute node local sto…

6f335fd

…rage. WIP for Issue #1 to compile with upstream changes from main.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP Added oxhdt-sys crate with unit tests.

c4095d1

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Moved hdt_driver main into oxhdt-sys crate and removed…

6d1d050

… the hdt_driver crate. Moved test resources into a dedicated directory. Updated build-devcloud.sh to use a removable subdirectory to support the cargo clean command. Updated path to test resources to use a relative path to the new locations.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added prototype functions to run W3C SPARQL tests. The…

3f3b461

…se need to be generalized to make use of the manifest files from the W3C test suite.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Ran to clean up the formatting. Excluded HDT index fil…

…es from Git for the test cases since those are generated as needed. Fixed W3C SPARQL Basic data-3 HDT test data file. Verified W3C SPARQL 1.0 Basic tests all pass.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Now runs and passes W3C SPARQL 1.0 'triple-match' tests.

c02b5a0

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added W3C SPARQL 1.0 Query testing for the open-world …

b8af5bd

…set with two tests excluded per their exclusion in Oxigraph.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added algebra tests with the exception of join-combo-2…

ac42e7f

…. Additional implementation is needed to load and query from multiple HDT files at once.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added bnode-coreference and option test sets from the …

bed5211

…W3C SPARQL 1.0 Query Test suite.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added type-promotion tests from the W3C SPARQL 1.0 que…

1421dfa

…ry test suite. Added ignored graph tests due to lack of named graphs support in HDT. Added placeholder for dataset tests.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added additional W3C SPARQL 1.0 Query Test cases.

9cfc9f5

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Added W3C SPARQL 1.0 Query bound and expr-builtin test…

708db1b

… cases.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - Updated the error message generated when the HDT file …

caf3a2a

…is not found to clarify that it is the HDT file rather than another file. Added additional W3C SPARQL 1.0 Query test cases. Updated the SPARQL query of the test metadata to output strings close to what the Rust test macro expects.

donpellegrino added a commit that referenced this issue


          Issue #1 WIP - All W3C SPARQL 1.0 Query tests that use data passing e…

3529b21

…xcluding 'dataset', use of named graphs, and tests already excluded by Oxigraph.

donpellegrino added a commit that referenced this issue


          Issue #1 Fixed path for test file in CLI driver.

ceb3a28

GregHanson mentioned this issue

First pass multiple hdt files #5

Merged

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added upstream hdt-cpp as a Git submodule.

af8b0d3

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP Converted DatasetView to a trait having a Key-Value-base…

6caa4e4

…d implementation. Converted functions to use generics for the DatasetView trait. Code compiles.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP Added blanket implementations for &T and Rc<T> reference…

efb0a80

…s to the new traits to avoid the use of ugly &(*dataset) versus simple &dataset parameters to function calls.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP Replaced use of ugly &(*self.dataset) versus simple &sel…

b879194

…f.dataset parameters to function calls.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Compiles and runs three test SPARQL SELECT queries on …

0c0f5f1

…an HDT file successfully.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added bnode-coreference and option test sets from the …

2cc29b7

…W3C SPARQL 1.0 Query Test suite.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added type-promotion tests from the W3C SPARQL 1.0 que…

af63974

…ry test suite. Added ignored graph tests due to lack of named graphs support in HDT. Added placeholder for dataset tests.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added additional W3C SPARQL 1.0 Query Test cases.

46db09c

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added W3C SPARQL 1.0 Query bound and expr-builtin test…

59db1d0

… cases.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Updated the error message generated when the HDT file …

d77b92c

…is not found to clarify that it is the HDT file rather than another file. Added additional W3C SPARQL 1.0 Query test cases. Updated the SPARQL query of the test metadata to output strings close to what the Rust test macro expects.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - All W3C SPARQL 1.0 Query tests that use data passing e…

b91ecef

…xcluding 'dataset', use of named graphs, and tests already excluded by Oxigraph.

GregHanson pushed a commit that referenced this issue


          Issue #1 Fixed path for test file in CLI driver.

7b47412

Author

donpellegrino commented Apr 29, 2024

Updated to use the latest release of the HDT crate.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added upstream hdt-cpp as a Git submodule.

e822817

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP Converted DatasetView to a trait having a Key-Value-base…

8a3caa1

…d implementation. Converted functions to use generics for the DatasetView trait. Code compiles.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP Added blanket implementations for &T and Rc<T> reference…

6a45a94

…s to the new traits to avoid the use of ugly &(*dataset) versus simple &dataset parameters to function calls.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP Replaced use of ugly &(*self.dataset) versus simple &sel…

563f8b7

…f.dataset parameters to function calls.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Compiles and runs three test SPARQL SELECT queries on …

c6acf21

…an HDT file successfully.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Used a macro to elminiate duplicate code for trait bla…

eeab2ff

…nket implementations of &T and Rc<T>. Updated the HDT test driver to open the HDT only once and reuse the dataset instance via Rc<HDTDatasetView>.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Updated the SPARQL tests in the HDT driver (main.rs) t…

b22a5eb

…o output CSV. Updated the HDT/OxRDF transformations to use NamedNode.into_string() and Term::from_str() where possible.

GregHanson pushed a commit that referenced this issue


          Fix for Issue #2 to perform DevCloud builds on compute node local sto…

2d6fd6f

…rage. WIP for Issue #1 to compile with upstream changes from main.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP Added oxhdt-sys crate with unit tests.

9c2f831

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Moved hdt_driver main into oxhdt-sys crate and removed…

5f9d365

… the hdt_driver crate. Moved test resources into a dedicated directory. Updated build-devcloud.sh to use a removable subdirectory to support the cargo clean command. Updated path to test resources to use a relative path to the new locations.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added prototype functions to run W3C SPARQL tests. The…

181798f

…se need to be generalized to make use of the manifest files from the W3C test suite.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Ran to clean up the formatting. Excluded HDT index fil…

f141594

…es from Git for the test cases since those are generated as needed. Fixed W3C SPARQL Basic data-3 HDT test data file. Verified W3C SPARQL 1.0 Basic tests all pass.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Now runs and passes W3C SPARQL 1.0 'triple-match' tests.

987864e

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added W3C SPARQL 1.0 Query testing for the open-world …

e4c890d

…set with two tests excluded per their exclusion in Oxigraph.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added algebra tests with the exception of join-combo-2…

7980db9

…. Additional implementation is needed to load and query from multiple HDT files at once.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added bnode-coreference and option test sets from the …

8cf9286

…W3C SPARQL 1.0 Query Test suite.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added type-promotion tests from the W3C SPARQL 1.0 que…

faf3116

…ry test suite. Added ignored graph tests due to lack of named graphs support in HDT. Added placeholder for dataset tests.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added additional W3C SPARQL 1.0 Query Test cases.

d2ac8f7

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Added W3C SPARQL 1.0 Query bound and expr-builtin test…

d323500

… cases.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - Updated the error message generated when the HDT file …

32213aa

…is not found to clarify that it is the HDT file rather than another file. Added additional W3C SPARQL 1.0 Query test cases. Updated the SPARQL query of the test metadata to output strings close to what the Rust test macro expects.

GregHanson pushed a commit that referenced this issue


          Issue #1 WIP - All W3C SPARQL 1.0 Query tests that use data passing e…

…xcluding 'dataset', use of named graphs, and tests already excluded by Oxigraph.

GregHanson pushed a commit that referenced this issue


          Issue #1 Fixed path for test file in CLI driver.

77db597

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment