06ed66f640
Update al lURLEncoder.encode calls to use StandardCharsets.UTF_8 (some were Charset.defaultCharset, some were deprecated single-arg)
2025-07-14 20:19:54 -05:00
80e1d8143c
Replace QProcessMetaData.addStep and addOptionalStep with .withStep and .withOptionalStep
2025-07-14 20:03:29 -05:00
fc4b34306f
Remove duplicated sshd-sftp dep
2025-07-14 17:07:30 -05:00
6f1e9413f6
Update for use-case of Get - listing a single file - to pass that file name in, to avoid listing huge directory when not needed
2025-04-08 13:35:08 -05:00
2fa829658f
Merged feature/s3-table-set-content-type-on-insert into dev
2025-04-03 14:24:37 -05:00
942134b4b0
it didn't like default as part of a case, so, moved
2025-04-01 16:52:35 -05:00
aca8436c56
Checkstyle
2025-04-01 16:45:25 -05:00
94631585ee
Update for s3 tables, to allow setting content-type in aws when inserting records (files) based on file name, hard-coded value, or another field.
...
this involved adding table & record params to writeFile method - a @Deprecated wrapper w/o those args is provided for backward compatibility
2025-04-01 15:50:16 -05:00
235cf9e16c
Bugfix for s3 utils listObjectsInBucketMatchingGlob, for file names with chars that need URL Encoding (since we're using a pathMatcher class and file:/// URIs...) update test setup to have a file that triggered this error before the fix.
2025-04-01 11:09:35 -05:00
3a8bfe5f48
Minor cleanup from code review (comments, fixed a few exceptions);
2025-03-03 09:01:08 -06:00
92f0bd3846
Try to bubble more useful exceptions out
2025-02-26 15:15:26 -06:00
4b585cde45
convert paths starting with / to be ./ instead
2025-02-25 11:47:09 -06:00
eae24e3eba
Add method pemStringToDecodedBytes
2025-02-25 08:45:48 -06:00
21c4434831
Add support for public-key based authentication
2025-02-24 19:57:07 -06:00
cddc42db5b
add testSimpleQueryForOneFile
2025-02-21 16:27:17 -06:00
2b9181b22e
Remove block that was adding fileName to requestedPath, idk, wasn't good
2025-02-21 16:26:54 -06:00
d401cc9ae1
Implement and test DeleteAction functionality
...
- Unified `deleteFile` API across storage modules by removing unused `QInstance` parameter.
- Added implementations for S3, SFTP, and local filesystem deleteAction.
2025-02-20 14:29:08 -06:00
44236f4309
change to not include createDate field for s3 (where it's not supported); changed file-name field used on the download adornment to be baseName by default, but configurable
2025-02-20 11:42:23 -06:00
d25eb6ee48
Simplify file listing by replacing filters with requested paths
...
Refactor file listing mechanisms to replace the use of complex query filters with simpler, path-based requests. Updated module-specific implementations and removed unused filtering logic. Updated tests (zombie'ing some)
2025-02-20 11:41:29 -06:00
be4f3c68f0
Update expected error message
2025-02-19 20:17:56 -06:00
2502d102d9
Better version (i hope) of using ssh & sftp client objects
2025-02-19 20:17:32 -06:00
dcf7218abf
add basename field
2025-02-19 20:17:31 -06:00
bb1a43f11f
Initial checkin
2025-02-19 20:02:05 -06:00
e5bdf8cd5e
Move makeConnection to its own method (for use by test process); add postAction to try to close the things; add looking for 'path' criteria and adding it to readDir call
2025-02-19 20:01:30 -06:00
31a586f23e
Move stripLeadingSlash up to base class
2025-02-19 19:54:58 -06:00
91aa8faca2
Add baseNameFieldName
2025-02-19 19:54:47 -06:00
154c5442af
Add postAction(); move variants stuff to new BackendVariantsUtil; add baseName to ONE records; remove path criteria when filtering (assuming the listFiles method did it)
2025-02-19 19:54:37 -06:00
b93114a9ba
Initial add of sftp filesystem module
2025-02-14 20:26:44 -06:00
5a7199495d
Basic support for variants; more fields on ONE type file records (size, dates); apply skip, limit, filter, sort on listings/queries for ONE-type files; treat contents as heavy-field if so set; more try-catch (e.g., upon write file)
2025-02-14 20:24:10 -06:00
6ef0a89533
CE-1772: fix aws expecting content type if object metadata is given
2024-11-03 21:53:50 -06:00
ce50120234
CE-1772: s3 updates to allow content type specifications among other things
2024-11-03 21:34:50 -06:00
ab5af234af
Merged feature/checkstyle-updates into dev
2024-08-05 13:35:21 -05:00
840e1aada3
Applying checkstyle updates to test sources
2024-07-19 16:16:51 -05:00
912e40fe0b
Eliminated all warnings.
2024-07-19 16:16:27 -05:00
f9af2ba983
Remove all calls to actionInput.getInstance and getSesssion, in favor of the equivallent methods from QContext
2024-07-19 16:16:16 -05:00
65fe6a002c
Upgrade checkstyle; remove supressed indentation markers for new-style switches
2024-05-17 16:38:28 -05:00
9281d07e96
CE-1068: changes from review: allow multiple email address entry, fixed download urls, fixed localhost to use inbucket/filesystem
2024-04-24 17:11:48 -05:00
5e4305d1d5
CE-1068: checkpoint commit of SES support
2024-04-23 20:55:58 -05:00
a90f244c7f
Merge pull request #85 from Kingsrook/feature/backend-module-self-registration
...
Feature/backend module self registration
2024-04-18 09:07:30 -05:00
32021fc36e
Merged dev into feature/CE-881-create-basic-saved-reports
2024-04-12 19:55:15 -05:00
731d1e266a
Remove withBackendType(String), to encourage usage instead of with/set method that takes the module class, so the module will be init'ed and registered
2024-04-10 09:05:43 -05:00
1eae1d6dc4
Remove hard-coded registration of known backend-modules from QBackendModuleDispatcher, in favor of all modules self-registering in static-init block
2024-04-10 08:51:44 -05:00
3440d45060
Remove usages of log4j's placeholders-based log formatting calls (some of which were accidental and wrong anyway)
2024-04-09 18:52:43 -05:00
8da05b9ab9
CE-881 - Feedback from code review & continued QA testing
2024-04-04 08:56:13 -05:00
4dadff7fc2
CE-881 - Cleanups - string aggregates; json field names; excel sheet name cleansing; excel size limits; counts, etc
2024-04-02 15:43:59 -05:00
fb8257d34a
CE-881 - Updated to actually run in CI (e.g., w/ localstack)
2024-04-01 15:54:09 -05:00
1ff2bc60ae
CE-881 - Tests for storage action
2024-04-01 15:39:01 -05:00
6fffe3036c
CE-881 - Add new StorageAction to backends - e.g., for streaming data into a backend's data store. implemented for in-memory, filesystem, and s3
2024-04-01 12:52:00 -05:00
5f72978528
Refactor table customizers to follow a common interface (point being, so you can have 1 class instead of many for a table's closely-related actions)
2024-03-14 11:24:21 -05:00
52d7d0e8ae
Merge pull request #73 from Kingsrook/hotfix/file-importer
...
Increasing logging for s3 importer archive errors
2024-03-04 11:00:11 -06:00
