Tobie Morgan Hitchcock
a1b6d24772
Remove support for write-only streaming storage
2019-06-16 08:12:41 +01:00
Tobie Morgan Hitchcock
bf4659d8f9
Add SQL export functionality
2018-08-20 07:53:11 +01:00
Tobie Morgan Hitchcock
48df950be5
Remove mysql kvs storage backend
2018-08-08 08:21:42 +01:00
Tobie Morgan Hitchcock
e3bea0a897
Use context.Context on all kvs requests
2018-05-02 03:05:03 +01:00
Tobie Morgan Hitchcock
9f0ea3ee61
Improve database query logging
2018-05-02 02:32:06 +01:00
Tobie Morgan Hitchcock
f1fa311d3b
Specify connection limits for mysql kv store backend
2018-05-01 23:08:15 +01:00
Tobie Morgan Hitchcock
55ece805e4
Don’t include empty/deleted values from KV storage
...
When looping over a range of KV items, it should ignore items which have been set to NULL and whose latest version has therefore been deleted.
2018-04-15 01:37:23 +01:00
Tobie Morgan Hitchcock
fd0712398d
Enable mysql tls and remove cloudsqlproxy
2018-04-06 01:15:19 +01:00
Tobie Morgan Hitchcock
82ffd9ef31
Fix bug in putC/delC for mysql storage backend
...
When using encryption, the expected value (once encrypted) would never be the same as the encrypted value in the storage layer. As a result, it would never be possible to putC or delC a KV item.
Now the mysql package first gets the key from the storage layer, and then checks it’s decrypted value, before attempting to overwirte the value in the storage layer.
2018-04-04 19:11:59 +01:00
Tobie Morgan Hitchcock
bb8c623f88
Don’t use readonly transactions for mysql
2018-02-11 16:43:59 +00:00
Tobie Morgan Hitchcock
5c18ee20a7
Log errors which occur on the kvs layer
2018-02-11 16:43:49 +00:00
Tobie Morgan Hitchcock
8b508b09c6
Don’t use non-default isolation level for mysql
2018-02-11 16:14:42 +00:00
Tobie Morgan Hitchcock
ccf57df085
Add support for mysql as a backend kv store
2018-02-11 00:16:28 +00:00
Tobie Morgan Hitchcock
84b72e25d2
Don’t use of ClrL, GetL, DelL, PutL methods on KV store
...
Remove the need to query a particular KV level, and instead use slightly different encoded keys, and use prefix based iteration. This means we can use different KV stores to give the same functionality, without needing to use hierarchical KV stores.
2018-02-09 15:08:27 +00:00
Tobie Morgan Hitchcock
dc6a357e26
Enable passing context when beginning a transaction
2018-02-06 17:07:42 +00:00
Tobie Morgan Hitchcock
7a3355bff0
Enable customisable file size policies for storage backends
2018-01-12 11:10:11 +00:00
Tobie Morgan Hitchcock
19604e589b
Buffer changes if data storage layer is shrinking
2018-01-11 15:14:50 +00:00
Tobie Morgan Hitchcock
62a1a38449
Add cli option to specify db shrink policy
2018-01-11 14:57:10 +00:00
Tobie Morgan Hitchcock
c0110b8af9
Implement updated rixxdb api interface
2017-11-16 19:54:54 +00:00
Tobie Morgan Hitchcock
2c23ee3ffb
Simplify cli start command arguments
2017-02-20 16:19:18 +00:00
Tobie Morgan Hitchcock
6a719d815b
Improve errors throught codebase
2017-02-20 01:44:13 +00:00
Tobie Morgan Hitchcock
e86857bdf7
Enable import / export of database transaction log
2017-02-20 01:44:12 +00:00
Tobie Morgan Hitchcock
58ac9d9424
Add code comments to kvs package
2017-02-20 01:44:12 +00:00
Tobie Morgan Hitchcock
a3b9362adb
Switch underlying KV store to rixxdb/dendrodb
2017-02-09 11:16:59 +00:00
Tobie Morgan Hitchcock
7728c5b398
Use keyed fields for ‘go vet’
2016-12-08 22:03:42 +00:00
Tobie Morgan Hitchcock
f931341a95
Add ability to check if db transaction is closed
2016-11-26 16:52:43 +00:00
Tobie Morgan Hitchcock
a57c2733fa
Use uint64 as limit in mysql backend connector
2016-11-17 14:18:11 +00:00
Tobie Morgan Hitchcock
efa641e175
Fix pgsql backend connection issues
2016-11-17 13:55:54 +00:00
Tobie Morgan Hitchcock
c997f89a2a
Remove fullstop from error message
2016-10-26 22:24:01 +01:00
Tobie Morgan Hitchcock
7556a77df0
Improve transactions
2016-10-18 13:49:46 +01:00
Tobie Morgan Hitchcock
a3672d28b3
Return CKError instead of custom error when encryption fails
2016-09-06 14:32:21 +01:00
Tobie Morgan Hitchcock
a06263d738
Disable individual encryption per transaction
2016-07-19 17:38:32 +01:00
Tobie Morgan Hitchcock
7b03d6f05e
Add remote data store connections with SSL
2016-07-19 12:05:11 +01:00
Tobie Morgan Hitchcock
14b14b8f21
Detect problems with connecting to data stores
2016-07-19 10:24:55 +01:00
Tobie Morgan Hitchcock
f26c4862a5
Return if any errors when initialising data stores
2016-07-19 10:22:22 +01:00
Tobie Morgan Hitchcock
26fb5c5684
Simplify public error messages
2016-07-18 23:01:45 +01:00
Tobie Morgan Hitchcock
e23473cfa9
Ensure correct encryption key is provided if using populated data store
2016-07-18 23:01:28 +01:00
Tobie Morgan Hitchcock
e1f1031cc7
Add global datastore encryption
2016-07-18 23:00:01 +01:00
Tobie Morgan Hitchcock
fd09bebedc
Add Str convenience method for KV items
2016-07-18 22:59:08 +01:00
Tobie Morgan Hitchcock
a556096cee
Pass full configuration data into data store packages
2016-07-18 13:33:26 +01:00
Tobie Morgan Hitchcock
a9bff47026
Add golang code comments
2016-07-17 11:39:43 +01:00
Tobie Morgan Hitchcock
ef839dfa22
Enable more verbose error logging
2016-07-17 00:29:59 +01:00
Tobie Morgan Hitchcock
2334d9f7a1
Update errors and error messages
2016-07-16 14:44:48 +01:00
Tobie Morgan Hitchcock
8a0849d6da
Enable multiple database backends
2016-07-16 14:43:53 +01:00
Tobie Morgan Hitchcock
51a2cb3415
Enable specifying database file path
2016-06-15 13:38:55 +01:00
Tobie Morgan Hitchcock
698a25b8e2
Fix bug with RDel prefix deleting in KV store
...
When a key is deleted in a for loop, calling cursor.next() jumps a key. As a result we must seek to the prefix again, until all keys with the prefix are deleted.
2016-05-31 13:34:54 +01:00
Tobie Morgan Hitchcock
c3fe3ef2c7
Log more error information
2016-05-30 10:59:05 +01:00
Tobie Morgan Hitchcock
4fbe1a6b58
FIx bug with PDel prefix deleting in KV store
...
When a key is deleted in a for loop, calling cursor.next() jumps a key. As a result we must seek to the prefix again, until all keys with the prefix are deleted.
2016-05-27 16:24:58 +01:00
Tobie Morgan Hitchcock
8d0d405ce0
Improve error output for encryption errors
2016-05-24 10:29:37 +01:00
Tobie Morgan Hitchcock
7960515114
Add compression and encryption to key value store
2016-05-21 18:07:51 +01:00
