Commit Graph

483 Commits

Author SHA1 Message Date
Cristian Turlica
b7828c0c6c MNT-22186: propTablesCleanupJobDetail v2 can cause Out of Memory erro… (#507)
- updated to use limit for queries and not iterate through all
2021-06-02 10:26:22 +03:00
Nana Insaidoo
cb636d1140 MNT-22385 Cmis query GetTotalNumItems is returning wrong value (#504)
* Changes made to correct the value of totalItems when performing a TMDQ

* Fixes after review

- Slight change was made to NodePermissionAssessor to log when permission
  limits are exceeded

* Now pre-computing maxPermissionChecks value as per review suggestion
2021-05-28 09:16:38 +01:00
Nana Insaidoo
457c3d39d4 REPO-5631 Investigate different types of results for optional patches difference detection (#472)
* Now supporting other Result implementations when detecting optional patches problems
2021-05-27 16:41:06 +01:00
Nana Insaidoo
16be403a41 REPO-5632 Investigate intermittent failing tests in AppContext05TestSuite (#499)
* Increased test data to stop intermittent test failures in FixedAclUpdaterTest
2021-05-26 09:26:59 +01:00
Bruno Bossola
3648c98e4b [REPO-5592] Support for PostgreSQL and MySQL, batch size is now configurable (#485)
* Initial support for PosgreSQL, MySQL plus batchSize is now configurable

* Changes post review
2021-05-24 11:46:00 +01:00
Denis Ungureanu
00b0b21668 ACS-1600 : Error when running propTablesCleanupJob on an env with 100 million records in alf_prop_value (#473)
- commit changes to db anytime `deleteBatchSize` of deleted data is reached
2021-05-21 14:26:01 +03:00
alandavis
d88f8f7bbf MNT-22409 Legacy transformer fails to generate multi-page TIFF preview
Originally fixed on 6.2.N. A couple of the Legacy classes no longer exist so changes are not on master. Changes to the renditions, default page limit and test still apply.

(cherry picked from commit 9d276aed7081e0078ed3f7f01dabdec20c599bfe)
(cherry picked from commit ddb299ab03)
2021-05-21 07:14:57 +01:00
Stefan Kopf
4baf6661a4 ACS-895 User email should not be necessary for joining a site (#471)
Fixed the first approach. No longer catching the Exception and instead preventing to invoke the email action if the invited user does not have an email address
2021-05-19 16:33:09 +02:00
Nana Insaidoo
954c946474 ACS-1587 Postsql DB Test Schema Differences Are Reported Fails (#464)
* Now only considering instances of a Difference.
2021-05-17 12:19:30 +01:00
Gloria Camino
5ecb620dfc LOC-303 Fix for this ticket - Fully updated and localised iptc-model.… (#449)
* LOC-303 Fix for this ticket - Fully updated and localised iptc-model.properties file in 15 languages
* LOC-303 Resubmitted - Fully updated and localised iptc-model.properties file in 15 languages
* Adding iptc-model.properties to be pulled for localisation
2021-05-13 17:26:36 +01:00
tiagosalvado10
83ca2878a5 [MNT-20006] Obtaining the site as system in order to allow the activity record when an user is not member of a site (#317)
[MNT-20006] Obtaining the site as system in order to allow the activity record when an user is not member
2021-05-13 11:29:18 +01:00
Stefan Kopf
0742c8efbd ACS-895 - User email should not be necessary for joining a site (#387)
This behaviour has been inconsistent anyway: It failed and prevented the user from being added to the site if there was no email address. But it proceeded if the email could not be sent for other reasons, like an invalid server name or non existing account on that server.
2021-05-11 19:24:27 +02:00
Alan Davis
5de64aefa9 MNT-21694 transform option converter (#444)
* MNT-21694 500 error on new logo upload with Legacy transforms (#284)

The TransformationOptionsConverter class did not convert the newer transform option format a Map<String, String> to the legacy ImageTransformationOptions class that contains the commandOption (OPT_COMMAND_OPTIONS) property. As a result no legacy transformer is asked if it can do the transform.

Originally not fixed on ACS 7 as Legacy transformers were removed, however the fix was just in the converter class and it is helpful to have identical code on branches if possible.
2021-05-11 13:48:09 +01:00
Bruno Bossola
7d56ac28ea Bugfix/ACS-1319 fix long running patch (#425)
* REPO-1319 - Migration to remove alf_server table

* Updated test schema reference

* Renamed test env. schema bootstrap configuration file

 This is done to avoid test failing due to special spring configuration overrides

* [skip ci] Better output from test errors, fixed table patterns for MSSQL support

* Now message patterns for migration are case insensitive

* Fixed NPE in SchemaDifferenceHelperUnitTest

* Fixed path to special test spring configuration

* Changes after review

* Changes after review

Co-authored-by: Nana Insaidoo <insaidoo.nana@yahoo.it>
2021-05-07 15:52:47 +01:00
Nana Insaidoo
45952e8e40 REPO-5624 Reimplement SchemaBootstrapTest (#435) 2021-05-06 16:26:10 +01:00
Sara
bdecc02ed8 Fix/acs 1425 fix community sql (#433)
* ACS-1425 Fix non-accelerated SQL

* ACS-1425 Fix non-accelerated SQL
2021-05-06 10:01:32 +01:00
montgolfiere
46f6d5829e ATS-892 / ATS-909: Add IPTC model (#429)
- fix previous blatant typo (thanks Stefan)
- https://github.com/Alfresco/alfresco-community-repo/pull/427
2021-05-04 16:01:25 +01:00
montgolfiere
099a444bf0 ATS-892: Add IPTC model (#427)
- add existing IPTC model (& message files) alongside other core models, eg. Exif & DublinCore
- see also ATS-909
2021-05-04 12:25:43 +01:00
Sara
96ef362d6d ACS-1425 Get stores at start of query (#421)
* ACS-1425 Get stores at start of query

* ACS-1425 Get stores at start of query

* ACS-1425 Get stores at start of accelerated query

* ACS-1425 Tidy up
2021-04-29 10:25:41 +01:00
Sara
ab6c831447 Feature/acs 1425 long running tmdq (#417)
* ACS-1425 Add store info to result

* ACS-1425 Fix unit tests
2021-04-28 11:07:02 +01:00
Nana Insaidoo
5ce179f209 [ACS-1455] Schema validation report expansion with patch specific problems told apart (#386)
* Update schema validation report

- Introduced changes to tell apart problems due to optional unapplied
  patches within schema validation report

* Update SchemaDifferenceHelper

- Now populating optionalUpgradePatches list during the schema bootstrap
  registration to conform with patch registration mechanising already in use
- Added tests

* Make minor corrections

Co-authored-by: Nana Insaidoo <nana.insaidoo@meterian.com>
2021-04-27 09:57:47 +01:00
Cristian Turlica
f201f35ec1 MNT-22186: propTablesCleanupJobDetail v2 can cause Out of Memory erro… (#402)
-  MySQLDeleteNotExistsExecutor (by extending DeleteNotExistsExecutor) to cope with MySQLspecific fetch size limitation and restrictions
- updated tests
- moved tests to AllDBTestsTestSuite from AppContextExtraTestSuite
2021-04-23 11:20:48 +03:00
Cristian Turlica
a7d8789ff4 Revert "MNT-22186: propTablesCleanupJobDetail v2 can cause Out of Memory errors (CleanAlfPropTablesV2.sql ) (#390)" (#394)
This reverts commit 5e38be6f7d.
2021-04-21 10:22:16 +03:00
Davide
9d711213cc SEARCH-2782 commit time as event time (#377) 2021-04-20 16:32:41 +02:00
Cristian Turlica
5e38be6f7d MNT-22186: propTablesCleanupJobDetail v2 can cause Out of Memory errors (CleanAlfPropTablesV2.sql ) (#390)
- added dialect check to set MySQL specific fetch size limitation (Integer.MIN_VALUE). fetchSize activates result set streaming.
- updated tests
2021-04-19 18:02:19 +03:00
Tom Page
b9e4557973 Add unit test to look for unreferenced test classes. (#368)
* Add unit test to look for unreferenced test classes.

It's very unusual that we write a test class which should not also be added to a test suite.

* Utilise the hierarchy of NonBuildTests markers to help exclude false positives.

* Update all omitted tests.

Either add the test to AllUnitTestsSuite if it passes and runs quickly, mark the test with the appropriate NonBuildTests interface or mark the class as abstract (if appropriate).

Mark one test (RemoteTransformerClientTest) as a NeverRunTest even though it passes because it takes 12 seconds to run and is marked as deprecated.

* Mark two Camel tests as 'never run' because they failed on the CI.
2021-04-15 11:23:26 +01:00
Angel Borroy
20dd0efc6f Feature/search 2802 shared secret auth (#382)
* SEARCH-2802: Filter HTTP requests (now "none" and "secret" communication methods are available) from X509 Web Filter.

* SEARCH-2802: HttpClientFactory (for Repository and Search Services clients) support for Shared Secret communication.

* SEARCH-2802: Fix HttpClientFactory base unit tests.
2021-04-14 10:25:45 +02:00
Nana Insaidoo
046116ddf0 Bugfix/repo 5610 events are not actually sent to activemq (#360)
* Add events tests

* Polished put test: connects to JMS via TCP and validate that the event sent is also received back

* Now the tests provides a simple main() that listens on the topic, useful for quick debug sessions

* Now the user name is collected in the calling thread, so that the sendEvent does not silently fails

* Apply changes following review

* Now using queue system to guarantee events order

* Add license

* Updated logs and corrected comments

* Remove empty methods

* Now catering for spurious events at startup when database is bootstrapped

* Now preserving the txn-id in all events

* Moved up definitions in events2.xml after PR feedback

Co-authored-by: Bruno Bossola <bruno@meterian.com>
2021-04-09 13:34:05 +01:00
Davide
65675b9a1d Revert "SEARCH-2782 use current transaction timestamp instead of current time as event time (#371)" (#376)
This reverts commit 28f1429a
2021-04-08 15:02:06 +02:00
Davide
28f1429a13 SEARCH-2782 use current transaction timestamp instead of current time as event time (#371) 2021-04-07 15:59:24 +02:00
Alan Davis
b4455f7d60 version.schema=15000 as we will use a 1000 gap for minor versions rather than just 100 2021-04-06 10:25:53 +01:00
Nicolas Barithel
34f360211f Externalize the nodeServiceCleanup CRON expression (#326) 2021-03-31 10:17:58 +03:00
Tom Page
562479bde4 SEARCH-2768 Add callback feature for asynchronous ACL updates. (#357)
* SEARCH-2768 Add callback feature for asynchronous ACL updates.

Change default for user filter to empty, as changes from all users could affect metadata
or permissions which might need to be indexing by the enterprise Elasticsearch Connector.

* SEARCH-2768 Add unit test for new listeners.

* SEARCH-2768 Rename listener callback function.

* SEARCH-2768 Add unit test to test suite.
2021-03-29 11:31:36 +01:00
alandavis
b772205539 Switch master to support ACS 7.1.0
* incremented pom versions to 11.0 so that 9 may be used by 7.0.1 and 10 for 7.0.2
* version.schema not changed this time as it had already been incremented by 100 to 14100
2021-03-27 09:45:27 +00:00
evasques
3a495f7b3f MNT-22295 - FixedACLJob not processing all nodes due to unordered results (#359)
* Added method selectNodesWithAspects that accepts a boolean as param to order values
* Added param ordered to IdsEntity class
* Added optional ordered param to the query template that orderes the results by node id in asc order
* Added method getNodesWithAspects that accepts a boolean as param to order values in nodeDAO
* FixedACLUpdater Job calls the new getNodesWithAspects, with the ordered param as true
2021-03-26 13:11:32 +00:00
Denis Ungureanu
d91a552925 ACS-1252 : Add tests for the JMS/ActiveMQ/Camel configuration in *alfresco-community-repo* (#356)
- fix messaging context for tests by adding missing mocked beans and properties
   - add tests for amqp, jms, activemq protocols
   - add travis job to run messaging tests
2021-03-24 14:13:37 +02:00
Bruno Bossola
8c91145b39 Revert "[ACS-1291] Asynchronous mechanism to send events (#351)" as no events are sent to AMQ with this change
This reverts commit f446031069.
2021-03-24 11:53:12 +00:00
Bruno Bossola
f446031069 [ACS-1291] Asynchronous mechanism to send events (#351)
* Performance optimisation spike

* Event2 is now sending event asynchronously

* Now forcing synchronous calls in tests for events2

* Now qualifying the event service used in tests

Co-authored-by: Nana Insaidoo <insaidoo.nana@yahoo.it>
2021-03-19 11:08:13 +00:00
evasques
ace87c9c3b MNT-21898 Unexpected ACLs when job runs Fix (#344)
* On move node, verify if parent has pending acl aspect applied and consider the pending shared ACL to update inheritance to avoid ending up with mixed permissions as children of pending acl nodes do not have the correct acls and when moved, keep their wrong acl.
* Add public method setInheritanceForChildren that receives an additional param: forceSharedACL. If an unexpected ACL occurs in a child, it can be overridden by setting it.
* Implement method setInheritanceForChildren that receives an additional parameter: forceSharedACL
* Add method setFixedAcls that receives an additional parameter: forceSharedACL - When a child node has an unexpected ACL, setting this parameter to true will force it to assume the new shared ACL instead of throwing a concurrency exception. When the shared ACL is forces, a warning is thrown in the log informing on what node exactly are we forcing the ACL. This is only possible when the child ACL is type SHARED and when it has an unexpected ACL
* All methods that called setFixedAcls without the new parameter will continue to operate as normal, as having forceSharedACL=false
* Added property forceSharedACL to the FixedACLUpdaterJob. If set to true it will force shared ACL to propagate through children even if there is an unexpected ACL
* When there is a exception detected when doing setInheritanceForChildren on the job, catch and log the error, but do not rollback the entire batch
* On copy/move unit tests I changed the ACL of the target folders on copy and move tests so that the old shared ACL accessed was never the same for origin and target folders as happens when performing these operations between sites
* Added unit test to verify fix for MNT-21898 - testAsyncWithNodeMoveChildToChildPendingFolder
* Added unit test to verify system property for the job: forceSharedACL - testAsyncWithErrorsForceSharedACL
2021-03-12 14:25:58 +00:00
alandavis
d4bae73b86 Use master for ACS 7.0.1
* version.schema=14100 (100 more than used for ACS 7.0.0 originally)
* Reset pom.xml version to next major number (9), as 8.x will be used for 7.0.0 HFs
2021-03-10 21:15:34 +00:00
Denis Ungureanu
f485581d5e ACS-855 : Long running patch in ACS 7.0.0.A2 upgrade (#338)
- revert  changes (sql and schema reference files) done in REPO-4547
2021-03-08 09:49:38 +02:00
Alan Davis
d60cd5ed1c ACS-1180 ACS 7 Stacks: MySQL 8 (#336) 2021-03-05 11:37:47 +00:00
Ancuta Morarasu
2b03e2bbf0 ACS-1201: Model integrity violation saving properties (#332)
- Fix the name property persistence in ContentModelFormProcessor to only save when the property value is actually changed. This prevents the FilenameFilteringInterceptor to be called when there are no changes to the file name.
2021-03-05 12:32:10 +02:00
Stefan Kopf
fef8cc9256 ACS-1217 Additional option for SOLR to authenticate with a shared secret (#334)
Co-authored-by: Alex Mukha <alex.mukha@alfresco.com>
2021-03-04 18:49:49 +01:00
alandavis
2294a87908 REPO-5376 Query Accelerator add simple timings, having remove temporary timing code 2021-02-27 09:10:58 +00:00
CezarLeahu
4e50446c4e ACS-1253 Remove ignored JMX namespace argument on Camel context (#314) 2021-02-26 09:33:05 +02:00
Andreea Nechifor
1a5aa34d3d APPS-692: after properties removed. (#315) 2021-02-25 20:45:46 +02:00
Alan Davis
e88aab47f7 REPO-5376 Query Accelerator Remove all temporary code (#308)
* REPO-5376 Remove all temporary code

* Remove DBStats, SingleTaskRestartableWatch
* Remove propertiesCache and aspectsCache from DBQueryEngine as they were marked as temporary

* Remove further temporary code

Co-authored-by: Nana Insaidoo <insaidoo.nana@yahoo.it>
2021-02-23 16:54:58 +00:00
Lucian Tuca
fd7adefe27 REPO-5571 : Change the tempFileCleanerTrigger to work at scale (#293)
* REPO-5571 : Change the tempFileCleanerTrigger to work at scale
    - added nr of files and time limits
2021-02-23 15:41:06 +02:00
CezarLeahu
bb19c61253 ACS-1253 Enable Camel JMX management (#295)
- enable Camel JMX management
- disable JMS connection idle timeout
- update ActiveMQ broker URLs to use NIO
2021-02-19 14:52:28 +02:00