Commit Graph

8 Commits

Author SHA1 Message Date
Alan Davis
63ace3abd8 REPO-4334 Move metadata extraction into T-Engines (#1015)
* ContentMetadataExtracter (the Action service Executer):
        * Code refactored so that post processing of extracted properties can be called after a
          transform has taken place in an async call. Previously done in the same Thread.
        * The source size is passed to the metadataExtracterRegistry as this is needed to select
          the transform.
        * Passes the source nodeRef to the metadataExtractor, so that it is possible to update
          the correct node after the async transform call.
    * AbstractMappingMetadataExtracter (the base class for all extractors):
        * Post extract processing extracted into separate methods.
        * NodeRef made available to sub classes.
    * AsynchronousExtractor (new metadata extractor and embedder) that will use
      a T-Engine.
    * Set targetExtension in transform for metadata extract and embed requests to T-Engines
      in both LocalTransforms (community) and RenditionEventProducer (enterprise).
    * RenditionService2Impl (used to request and respond to async transform requests).
        * Add consumeExtractedMetadata and consumeEmbeddedMetadata methods, which
          handle the response, normally be calling AsynchronousExtractor.
    * Discovered that the JodConverterMetadataExtracter was superseded by the
    * TikaPoweredMetadataExtracter for all the types that it support in 6.0.1 and could have been
      deprecated at that time as part of REPO-2910. It will now be deprecated so that it can be
      removed in 7.0.0.

Additional tests are being added to AsynchronousExtractorTest for overwritePolicy, enableStringTagging and carryAspectProperties in a separate PR, as these will cover tests at a likely to be removed when delete local extractors.
2020-06-16 18:12:30 +01:00
Alan Davis
79698488cd MNT-21398 Unable to override standard rendition definitions (#913)
Relaxed the checks so that it is possible to override rendition definitions. DEBUG is logged in this case.
2020-04-01 15:48:39 +01:00
NITHIN NAMBIAR
efffc843b1 Fix/repo 4061 mockito (#629)
* repo-4061 update mockito library

* repo-4061 update mockito library

* repo-4061 updated test cases

* repo-4061-mockito

* repo-4061 fix test

* repo-4061 fix tests

* repo-4061 fix test case

* repo-4061 fix test case
2019-12-12 14:39:29 +00:00
alandavis
56b6371302 REPO-4697/REPO-4701 Async transforms for Solr (#643)
* REPO-4698 Add asynchronous transform method to RenditionService2
* remove extra method transformXX
* Remove extra tmp code
* comment update
* Added tests to RenditionService2Test for transform
* sync client for Solr api (#646)
* Added SynchronousTransformClient so both local and legacy transforms can be used in deprecated code like the V0 Solr rest api
* Refactor TransformClients so they look similar
* Added SynchronousTransformClient so both local and legacy transforms can be used in deprecated code like the V0 Solr rest api
* Refactor TransformClients so they look similar
* Undo trial removal of disable transform registry in a test class
transform method needs to access the selected transform in the same Thread.
* Switching should check return value rather than for an exception.
* remove extra code that does nothing from test.
* Use contentService.transform(reader, writer, options) to allow for failover to a lower priority legacy transform
* Add tests for SynchronousTransformClients
* Added TransformRequest model, TransformRequestConsumer, TransformRequestProcessor
* Added StubTransformReplyProvider to implement TransformReplyProvider.
* Admin Console 'Support' Transform Test operations broken
* Switched over to using synchronousTransformClient as the error was on the reply from the ATS as it did not know what to do with the rendition as the test source node was deleted by that time. Not really that much of a bug after all. Fixed anyway.
* Admin Console 'Support' Transform Test operations broken
  Consistent use of synchronousTransformClient rather than transformClient sometimes
2019-11-07 15:04:55 +02:00
Alan Davis
ca0d3d9a98 REPO-4712 AIS default AI rendition definitions (via XML) are lost after startup (at **:30) (#639)
- Remember 'static' renditions created via spring beans.

(cherry picked from commit 535fd9d1d5) 7.N (ACS 6.2)
2019-10-15 14:03:23 +01:00
CezarLeahu
3225f63f94 REPO-4639 Content conversion failed using Tika (#587)
The Tika T-Engine was not being called by the Transform Service or Local transforms, because the sub-transform name was required.

Moved common classes (with repo) to alfresco-transform-model so that it can be used by the T-Engines to work out which sub transformer to use. InT also performed a refactor on these classes (alfresco-transform-model 1.0.2.7). Also includes changes to legacy transformers so that they don't pass the sub transformer name any more.
2019-09-12 21:49:17 +01:00
alandavis
bebd04f49e REPO-4329 Configure Custom Renditions (#537)
Break done of changes:
-    Removed rendition definition spring beans and created 0100-baseRenditions.json. Changes are picked up periodically by the running system.
-    Refactored TransformServiceRegistryImpl to extract ConfigFileFinder to reads json from resources, files or directories.
 -   Refactored TransformServiceRegistryImpl to extract ConfigScheduler to periodically reads config data.
 -   Used ConfigFileFinder and ConfigScheduler in RenditionDefinition2Impl to read rendition defs.
 -   Removed the need for a current 'Data' parameter to be passed to register methods when adding transforms or renditions.
 -   Changes in test classes of AbstractRenditionIntegrationTests to force the config to be read once before each test, as tests were sometimes not getting the correct config due to scheduling.
2019-08-02 17:46:33 +01:00
alandavis
e62aaa7165 REPO-3766 Renditions: Simplified Async Rendition Service 2018-09-25 17:59:57 +01:00