Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for recursive node deletes (CADC-12558) #536

Closed
wants to merge 80 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
80 commits
Select commit Hold shift + click to select a range
2556e70
incomplete exploratory dev
pdowler Mar 29, 2023
ce8a371
comment out old row lock code
pdowler Mar 29, 2023
9321705
Merge branch 'master' into vos2
pdowler Apr 4, 2023
b2d8b2c
NodeDAO work
pdowler Apr 5, 2023
c6c8416
Merge branch 'master' into vos2
pdowler Apr 5, 2023
d244f50
basic function of NodeDAO: put, get, update, delete
pdowler Apr 6, 2023
7156929
unit test code for postgresql array parsing
pdowler Apr 6, 2023
2cdd2de
incomplete node iterator
pdowler Apr 13, 2023
7905cc0
working node child iterator
pdowler Apr 14, 2023
283fb18
Merge branch 'master' of https://github.com/opencadc/storage-inventor…
pdowler Apr 19, 2023
d47e896
fix and test use of Node.parentID
pdowler Apr 19, 2023
59e86b1
vault: add init database, update README with additional config
pdowler Apr 21, 2023
34bfcd8
vault: implement more NodePersistenceImpl methods
pdowler Apr 21, 2023
8082aab
NodeDAO: remove assign parentID in put
pdowler Apr 21, 2023
87c68bb
cadc-inventory-db: nominally assign version as 0.15
pdowler Apr 21, 2023
41dc8dc
update TODO
pdowler Apr 21, 2023
0af5c9c
Merge branch 'master' of https://github.com/opencadc/storage-inventor…
pdowler Apr 27, 2023
89b0908
Merge pull request #502 from pdowler/vos2
pdowler Apr 27, 2023
2512aa3
vault: TODO updates
pdowler Apr 28, 2023
39f51ea
vault: update README
pdowler May 2, 2023
83381d9
add vault to repo README
pdowler May 2, 2023
c842e42
Merge pull request #503 from pdowler/vos2
pdowler May 2, 2023
c542400
update for Node API changes
pdowler May 31, 2023
4af6232
Merge pull request #511 from pdowler/vos2
pdowler May 31, 2023
c1e0240
vault: NodePersistenceImpl implements extracted interface
pdowler Jun 1, 2023
dc1e726
Checkpoint
Jun 16, 2023
805cea2
Merge branch 'master' of https://github.com/opencadc/storage-inventor…
pdowler Jun 29, 2023
6a8e354
vault: add cadc-registry link to README
pdowler Jun 29, 2023
8c892f7
Merge branch 'master' of https://github.com/opencadc/storage-inventor…
pdowler Jul 10, 2023
642c4b7
Merge branch 'master' into vos2
pdowler Jul 10, 2023
ebc861c
Merge branch 'vos2' of https://github.com/opencadc/storage-inventory …
pdowler Jul 10, 2023
5403a9a
cadc-inventory-db: node iterator bug fix
pdowler Jul 10, 2023
5092f91
typo
pdowler Jul 10, 2023
e1f47b5
Intermidiate commit
Jul 11, 2023
09e351f
Merge branch 'vos2' of https://github.com/pdowler/storage-inventory i…
Jul 11, 2023
a576479
cadc-inventory-db: improve txn close in catch to avoid leak
pdowler Jul 11, 2023
0478212
Merge branch 'vos2' of https://github.com/pdowler/storage-inventory i…
Jul 12, 2023
fa011e0
Fixed small issues
Jul 12, 2023
3fb9201
cadc-inventory-db: add connection.close() calls in NodeIterator to re…
pdowler Jul 12, 2023
ed3fa61
debug->info in test code
pdowler Jul 12, 2023
bf26dde
raven: limit cadc-inventory-db version to avoid cadc-vos-2.0 until re…
pdowler Jul 12, 2023
8099661
Merge branch 'vos2' of https://github.com/pdowler/storage-inventory i…
Jul 12, 2023
ce0898f
Re-factored the library
Jul 12, 2023
d310158
Merge pull request #522 from pdowler/vos2
pdowler Jul 12, 2023
5b4e272
Small fixes
Jul 13, 2023
1c885d7
Small fixes
Jul 13, 2023
a2c63e8
Renamed cadc-vos-server dependency
Jul 13, 2023
d364005
Fixed bug
Jul 13, 2023
8eef18b
Merge pull request #523 from andamian/CADC-12179
pdowler Aug 4, 2023
e6ca6ec
vault: added NodesTest integration test using cadc-test-vos-2.0
pdowler Aug 4, 2023
2b45eaa
vault: comment out unimplemented endpoints from capabilities
pdowler Aug 4, 2023
3efead8
vault: tweak root and trash node settings in NodePersistenceImpl
pdowler Aug 4, 2023
60651cb
vault: update dependencies
pdowler Aug 4, 2023
0531edc
vault: cleanup in NodePersistenceImpl
pdowler Aug 4, 2023
a79673b
move assign of owner and parent details to NodePersistenceImpl
pdowler Aug 8, 2023
4f455a8
vault: formatting
pdowler Aug 9, 2023
d4eab62
Merge pull request #525 from pdowler/vos2
pdowler Aug 10, 2023
679b3ee
cadc-inventory-db: adapt to ContainerNode api change
pdowler Aug 11, 2023
62645da
vault: quick hack fix for delete(Node) to allow repeated create/delet…
pdowler Aug 11, 2023
fcaa3d1
Merge pull request #526 from pdowler/vos2
pdowler Aug 15, 2023
8962bde
vault: fix imports
pdowler Aug 15, 2023
e59dde2
Merge branch 'vos2' of https://github.com/opencadc/storage-inventory …
pdowler Aug 15, 2023
f875645
Merge branch 'master' of https://github.com/opencadc/storage-inventor…
pdowler Aug 23, 2023
5544cc1
Merge pull request #530 from pdowler/vos2
pdowler Aug 23, 2023
0420a6b
vault: added indentity cache to child iterator
pdowler Aug 23, 2023
1c26961
vault: fix class cast issue with ident cache in iterator
pdowler Aug 23, 2023
e6ef466
Changed type of group sets in Node to GroupURI
Sep 6, 2023
c6dc837
Merge pull request #531 from andamian/CADC-12708
pdowler Sep 7, 2023
f68e859
Merge branch 'vos2' of https://github.com/opencadc/storage-inventory …
pdowler Sep 7, 2023
ddde9d9
cadc-inventory-db: fix NodeDAO.lock for subclass support
pdowler Sep 7, 2023
b3f51aa
vault: reject deletion of non-empty containers, perform delete action…
pdowler Sep 7, 2023
dc55e9a
Merge pull request #532 from pdowler/vos2
pdowler Sep 8, 2023
2911e7b
vault-quota: README and design doc
pdowler Sep 8, 2023
39df738
Merge pull request #533 from pdowler/vos2
pdowler Sep 8, 2023
e15cbd0
Update Design.md
pdowler Sep 11, 2023
07d759f
Update Design.md
pdowler Sep 11, 2023
5336389
vault-quota: update design doc with some validate ideas
pdowler Sep 12, 2023
1f2a51b
Merge pull request #534 from pdowler/vos2
pdowler Sep 12, 2023
dec5ed8
Support for recursive deletes
Oct 6, 2023
31d4b33
Merge branch 'master' into CADC-12558
andamian Oct 6, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,10 @@ local artifact selection policy. This is used if the new fenwick policy excludes
This is an implementation of the **file-validate** process that compares the inventory database against
the back end storage at a storage site.

## vault
UNDER DEVELOPMENT: This is an implementation of an <a href="https://www.ivoa.net/documents/TAP/">IVOA VOSpace</a>
service that uses storage-inventory as the back end storage mechanism.

## cadc-*
These are libraries used in multiple services and applications.

Expand Down
4 changes: 3 additions & 1 deletion cadc-inventory-db/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ sourceCompatibility = 1.8

group = 'org.opencadc'

version = '0.14.6'
version = '0.15.0'

description = 'OpenCADC Storage Inventory database library'
def git_url = 'https://github.com/opencadc/storage-inventory'
Expand All @@ -26,7 +26,9 @@ mainClassName = 'org.opencadc.inventory.db.version.Main'

dependencies {
compile 'org.opencadc:cadc-util:[1.9.5,2.0)'
compile 'org.opencadc:cadc-gms:[1.0.0,)'
compile 'org.opencadc:cadc-inventory:[0.9.4,)'
compile 'org.opencadc:cadc-vos:[2.0,3.0)'

testCompile 'junit:junit:[4.0,)'

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -79,10 +79,11 @@
public class TestUtil {
private static final Logger log = Logger.getLogger(TestUtil.class);

static String SERVER = "INVENTORY_TEST";
static String DATABASE = "cadctest";
static String SCHEMA = "inventory";
static String TABLE_PREFIX = null;
public static String SERVER = "INVENTORY_TEST";
public static String DATABASE = "cadctest";
public static String SCHEMA = "inventory";
public static String VOS_SCHEMA = "vospace";
public static String TABLE_PREFIX = null;

static {
try {
Expand All @@ -102,12 +103,17 @@ public class TestUtil {
if (s != null) {
SCHEMA = s.trim();
}
s = props.getProperty("vos_schema");
if (s != null) {
VOS_SCHEMA = s.trim();
}
s = props.getProperty("tablePrefix");
if (s != null) {
TABLE_PREFIX = s.trim();
}
}
log.info("intTest database config: " + SERVER + " " + DATABASE + " " + SCHEMA + " " + TABLE_PREFIX);
log.info("intTest database config: " + SERVER + " " + DATABASE + " " + SCHEMA + " " + VOS_SCHEMA
+ " tablePrefix=" + TABLE_PREFIX);
} catch (Exception oops) {
log.debug("failed to load/read optional db config", oops);
}
Expand Down
Loading
Loading