-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add forge methods to acces/query datasets from external sources #367
base: master
Are you sure you want to change the base?
Commits on Dec 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for cc8b557 - Browse repository at this point
Copy the full SHA cc8b557View commit details
Commits on Dec 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f6f853e - Browse repository at this point
Copy the full SHA f6f853eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 47e8464 - Browse repository at this point
Copy the full SHA 47e8464View commit details
Commits on Dec 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2ff9d7d - Browse repository at this point
Copy the full SHA 2ff9d7dView commit details
Commits on Jul 5, 2024
-
Load local configuration when configuration tests (#370)
* load local configuration when configuration tests * keep commons imports together * fix duplicate keyword argument issue * use context path from default config in test_to_resource test * rm extra store_config.pop * refactor store config
Configuration menu - View commit details
-
Copy full SHA for 380eb07 - Browse repository at this point
Copy the full SHA 380eb07View commit details -
Pass view when forge.sparql, forge.elastic, forge.search call (#373)
* pass view when sparql, elastic call, todo search * rm unless constants from store * turn view to endpoint * endpoint to view param * rename param * rename param2 * keyword param from forge call * missing underscore * git status * make endpoint refac * edit querying notebook to showcase feature, todo set up better view * refac notebook edit * change view creation mapping * check filters not provided as keyword arg * fix querying notebook, retrieve using resource url * test make endpoint function * use *filters for the store interface and implementations
Configuration menu - View commit details
-
Copy full SHA for b173780 - Browse repository at this point
Copy the full SHA b173780View commit details -
Configuration menu - View commit details
-
Copy full SHA for 16e1d94 - Browse repository at this point
Copy the full SHA 16e1d94View commit details -
added timeouts to every requests. call (#368)
* added timeouts to every requests. call * centralise default request timeout * rm import * use constant in file get
Configuration menu - View commit details
-
Copy full SHA for 5fc964c - Browse repository at this point
Copy the full SHA 5fc964cView commit details -
Configuration menu - View commit details
-
Copy full SHA for caab280 - Browse repository at this point
Copy the full SHA caab280View commit details -
deflatten is independent of order of items. If both prop and prop.som…
…ething it raises an error
Configuration menu - View commit details
-
Copy full SHA for d6388b8 - Browse repository at this point
Copy the full SHA d6388b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for e358acf - Browse repository at this point
Copy the full SHA e358acfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9ca0398 - Browse repository at this point
Copy the full SHA 9ca0398View commit details -
Configuration menu - View commit details
-
Copy full SHA for 922bfd3 - Browse repository at this point
Copy the full SHA 922bfd3View commit details -
* change signatures to allow for boolean change_schema on update * change_schema implemented for single resource update * refactor batch actions * lint * began batch update schema * change schema many * progress * rm / join * rm useless change * fix * change schema to update schema * update instead of change * example notebook for schema method, todo update * notebook example with update * lint * improve notebook * fix one test * keep unconstrained schema only for update endpoint else _ * same url building in one and many * add timeout * schema id optional in update * rename local parse * rename keep_unconstrained to use_unconstrained_id * rm extra docstring param
Configuration menu - View commit details
-
Copy full SHA for 659bc1d - Browse repository at this point
Copy the full SHA 659bc1dView commit details -
Rm metadata fetch when forge.retrieve (#376)
* change signatures to allow for boolean change_schema on update * change_schema implemented for single resource update * refactor batch actions * lint * began batch update schema * change schema many * progress * rm / join * rm useless change * fix * change schema to update schema * update instead of change * example notebook for schema method, todo update * notebook example with update * lint * improve notebook * fix one test * keep unconstrained schema only for update endpoint else _ * same url building in one and many * add timeout * schema id optional in update * rename local parse * rm second request for metadata * add query param annotate only if retrieve source is true * retrieval error if issue creating resource from response * rm cross bucket check with source * add todo * separate metadata call if cross bucket and source * refac * fixes and notebook update * check deployment endpoint self, may need to be checking multiple values * revert to self.endpoint * updated notebook to show retrieval * fix response name * add query param annotate only if retrieve source is true * separate metadata call if cross bucket and source * rename keep_unconstrained to use_unconstrained_id * rm extra docstring * better comments * clarify comment * comment fix * improve markdown
Configuration menu - View commit details
-
Copy full SHA for 76e2f7e - Browse repository at this point
Copy the full SHA 76e2f7eView commit details -
re-do metadata fetch until endpoint is fixed (#381)
* re-do metadata fetch until endpoint is fixed * better notebook * rename variables * code style * fix replace in comments * update comments
Configuration menu - View commit details
-
Copy full SHA for 41503dc - Browse repository at this point
Copy the full SHA 41503dcView commit details -
return resources as dictionaries when forge.elastic if as_resource = …
…False (#382) * return resource as_json optionally when forge.elastic * as_resource instead of as_json, default True * skeleton to enable building resources from different values in the es response payload * example of forge.elastic as_resource = False in getting started Querying notebook
Configuration menu - View commit details
-
Copy full SHA for 647912a - Browse repository at this point
Copy the full SHA 647912aView commit details -
Set jsonld context version to 1.1 (#387)
* Set jsonld context version to 1.1 * this enables non IRI-delimiting character not present in rdflib.plugins.shared.jsonld.context.URI_GEN_DELIMS (e.g '_' in "NCBITaxon": "http://purl.obolibrary.org/obo/NCBITaxon_") to be used when defining jsonld context prefix
Configuration menu - View commit details
-
Copy full SHA for c38b3c4 - Browse repository at this point
Copy the full SHA c38b3c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for a050dc0 - Browse repository at this point
Copy the full SHA a050dc0View commit details -
Configuration menu - View commit details
-
Copy full SHA for d6f38de - Browse repository at this point
Copy the full SHA d6f38deView commit details -
Fixes pyshacl deep nodeshape path eval error (#393)
Currently the pySHACL throws a ReportableRuntimeError("Evaluation path too deep!\n{}".format(path_str)) exception when evaluating a shape if the length of its transitive closure of the sh:node property is bigger or equal to 30. Give a node shape, this PR addresses this by: * Fixes pyshacl deep nodeshape path eval error by first recursively collecting all the property shapes directly defined (through sh:property) by the node shape or inherited from the node shape parents then link those collected property shapes to the node shape through sh:property and finally remove the node shape <-> parent shape relatioinships * Aligned the expected data model for a shacl shape between the RDF StoreService and DirectoryService:
Configuration menu - View commit details
-
Copy full SHA for ede675a - Browse repository at this point
Copy the full SHA ede675aView commit details -
Fixed coupled of issues (#394)
* Fixed coupled of issues: * forge.prefixes() was raising pandas.Dataframe error "if using all scalar values, you must pass an index" * fixed forge.types() to properly collect types from rdfsercice.class_to_shape * fixed forge.template() when using an rdf model based on a store service: Unable to generate template:'tuple' object has no attribute 'traverse'
Configuration menu - View commit details
-
Copy full SHA for 6b666f1 - Browse repository at this point
Copy the full SHA 6b666f1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 85d6c6f - Browse repository at this point
Copy the full SHA 85d6c6fView commit details -
Configuration menu - View commit details
-
Copy full SHA for a36f42c - Browse repository at this point
Copy the full SHA a36f42cView commit details -
Validation with ontology (#396)
* Added support for inference when using the RdfModel: * support for importing ontologies from schemas using owl:imports * use forge.validate(resource, inference="inference_value", type_='AType') with inference_value as in https://github.com/RDFLib/pySHACL/blob/v0.25.0/pyshacl/validate.py#L81. inference_value="rdfs" seems to be enough to extend the resource with the transitive closures of type subClassOf and/or property subPropertyOf relations as per the RDFS entailment rules (https://www.w3.org/TR/rdf-mt/). * Validation now fails when a type not in the resource is provided as value of the type_ argument unless inference is enabled (with inference='rdfs' for example) and the resource type is a subClassOf of type_
Configuration menu - View commit details
-
Copy full SHA for baf26f0 - Browse repository at this point
Copy the full SHA baf26f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for f12b465 - Browse repository at this point
Copy the full SHA f12b465View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7342b58 - Browse repository at this point
Copy the full SHA 7342b58View commit details -
Configuration menu - View commit details
-
Copy full SHA for f31e6cc - Browse repository at this point
Copy the full SHA f31e6ccView commit details -
Added AttributeError exception when a None resolver is provided to re…
…cursive_resolve when resolving a str jsonld context (#402)
Configuration menu - View commit details
-
Copy full SHA for 8106ed8 - Browse repository at this point
Copy the full SHA 8106ed8View commit details -
Add alternateName to agent resolver (#404)
* Add alternateName to agent resolver * Added property also to the agent-to-resource mapping
Configuration menu - View commit details
-
Copy full SHA for 29280b6 - Browse repository at this point
Copy the full SHA 29280b6View commit details -
Add
add_image
method toDataset
entity (#389)* Make add_image method of a Dataset, and not of KnowledgeGraphForge * Update notebooks with example of dataset.add_image method
Configuration menu - View commit details
-
Copy full SHA for 3d8a37c - Browse repository at this point
Copy the full SHA 3d8a37cView commit details -
resolve with target species returns only species and strain returns strains
Configuration menu - View commit details
-
Copy full SHA for 8db6ae8 - Browse repository at this point
Copy the full SHA 8db6ae8View commit details -
Configuration menu - View commit details
-
Copy full SHA for eb6a56d - Browse repository at this point
Copy the full SHA eb6a56dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 89634dd - Browse repository at this point
Copy the full SHA 89634ddView commit details -
Add method when initializing forge to export pyshacl environment vari…
…able (#406) * Add method when initializing forge to export environment variable * Remove addition in setup.py and try os.environ instead of os.system
Configuration menu - View commit details
-
Copy full SHA for c5538fe - Browse repository at this point
Copy the full SHA c5538feView commit details -
Remove nexus_sdk from nexus store when uploading files and add `x-nxs…
…-file-content-length` to header (#403) * Remove nexus_sdk from nexus store when uploading files * Change content length header to be
Configuration menu - View commit details
-
Copy full SHA for c895b7c - Browse repository at this point
Copy the full SHA c895b7cView commit details -
* split file get call and property access * split prepare download one * lint --------- Co-authored-by: Leonardo Cristella <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 9476d95 - Browse repository at this point
Copy the full SHA 9476d95View commit details -
rm nexus sdk usage and dependency (#407)
* rm sdk usage from bluebrainexus store file * rm sdk usage from utils * rm sdk usage from service * rm nexussdk from test * lint * fix patch * change usage of project_fetch function for successful patching in tests * rename module of sdk methods * remove leftover image from store * missing file * restore config * remove s from file name * missing the file, again --------- Co-authored-by: Cristina E. González-Espinoza <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 536995b - Browse repository at this point
Copy the full SHA 536995bView commit details -
Configuration menu - View commit details
-
Copy full SHA for c198389 - Browse repository at this point
Copy the full SHA c198389View commit details -
Configuration menu - View commit details
-
Copy full SHA for 559e3bd - Browse repository at this point
Copy the full SHA 559e3bdView commit details -
Configuration menu - View commit details
-
Copy full SHA for aa0cb9a - Browse repository at this point
Copy the full SHA aa0cb9aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 50130ec - Browse repository at this point
Copy the full SHA 50130ecView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0b3b91f - Browse repository at this point
Copy the full SHA 0b3b91fView commit details -
Refactor batch request mechanism (#383)
* Added batched retrieval
Configuration menu - View commit details
-
Copy full SHA for 7e3844b - Browse repository at this point
Copy the full SHA 7e3844bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7848a54 - Browse repository at this point
Copy the full SHA 7848a54View commit details -
Check for schema id to use schema endpoint (#415)
* Check for schema id to use schema endpoint * Add example in unit test * Add missing parameter inside _register_one. Add notebook example of schema handling * check if resource_id is given
Configuration menu - View commit details
-
Copy full SHA for 42b6f8c - Browse repository at this point
Copy the full SHA 42b6f8cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6777f70 - Browse repository at this point
Copy the full SHA 6777f70View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e26c2e - Browse repository at this point
Copy the full SHA 3e26c2eView commit details -
Configuration menu - View commit details
-
Copy full SHA for e5fcf75 - Browse repository at this point
Copy the full SHA e5fcf75View commit details
Commits on Jul 9, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b1f8d09 - Browse repository at this point
Copy the full SHA b1f8d09View commit details