100 Commits
Author SHA1 Message Date
Angel Borroy 230e5f7f6c MNT-22338 Changed transactionDocsBatchSize to support Oracle databases
Cherry picked from 1b608c0
2021-06-25 16:48:48 +02:00
Angel Borroy 7adef88799 MNT-22394 Remove Bouncy Castle library dependency
This dependency is injected by "org.apache.solr.solr-langid", but it's not used by SOLR and Search Services source code.
Cherry picked from 1bc1c71
2021-06-21 17:57:44 +02:00
Angel Borroy 0c3eae0c58 MNT-22393 Update to Solr 6.6.5-patched.6 to avoid using "xmlbeans" library
Cherry picked from 4f7955a
2021-06-21 09:41:19 +02:00
Angel Borroy a3ce67fa3e MNT-22377 Fix search exact term queries using tokenised properties
Cherry picked from 1b68a63
2021-06-18 12:50:15 +02:00
Angel Borroy e5cb9dba5b SEARCH-2888: Expose tuning parameters for Merge Policy and Merge Scheduler SOLR processes.
Cherry picked from d36a330
2021-05-31 11:32:24 +02:00
Angel Borroy 48683f9285 SEARCH-2548 Query perfomance degradation
Cherry picked from 059f732
2021-05-18 17:41:52 +02:00
Angel Borroy c27b1aa14b SEARCH-2887 Disable FINGERPRINT and Document Cache by default
Cherry pick from eb4ab98
2021-05-18 15:57:10 +02:00
Angel Borroy 576522fba2 SEARCH-2802: Update license information. 2021-04-27 09:27:52 +02:00
Angel Borroy 057a3b86fd SEARCH-2802: Search Services to support for Shared Secret communication. 2021-04-26 16:56:14 +02:00
Angel Borroy ae00b1d286 MNT-22158: Index multivalued fields as identifiers
This change requires re-indexing SOLR Core
Cherry picked from 251ca00
2021-04-07 12:29:39 +02:00
Angel Borroy b8f53c868b SEARCH-2415: Improve MetadataTracker performance
Fix parallelism default names in property template file

(cherry picked from commit 3c7b197216d6ea8779aff9ffbeb455755410a35a)
2020-12-03 14:27:22 +00:00
Angel Borroy 24c5f76dbe SEARCH-2537: Remove unused dependency xml-apis-1.4.01.jar from notice file
(cherry picked from commit 1a04d264d4460ab26882d6a4d5ee699dc86af63a)
2020-12-03 13:33:32 +00:00
Angel Borroy b9e47cd4b9 SEARCH-2407: Skip Content Model Validation in Search Services side
Cherry picked from fe81236
2020-11-25 18:52:16 +01:00
Angel Borroy 87e7ba6f24 SEARCH-2460: Correct validation of "isIndexed" property.
Index "unidexed" nodes only when global property to ignore them is not set.
Cherry picked from c2bc8a8
2020-11-13 10:12:40 +01:00
Angel Borroy 261ed4a30d SEARCH-2415: Performance tuning for MetadataTracker and ContentTracker.
Cherry picked from 7fbb361
2020-11-03 12:36:13 +01:00
Angel Borroy 82e56411bf SEARCH-2529: Allows configuration for getting the path information for a node in batches or as single nodes
New solrcore.properties available: alfresco.metadata.getPathsInNodeBatches=true
2020-11-03 10:41:38 +01:00
Angel Borroy 2b683b055c SEARCH-2390: Skip getting nodes from repository when no transactions left
Cherry picked from 2141634
2020-08-19 12:32:21 +02:00
Angel Borroy 5080c58198 SEARCH-2379: Update the whole ASPECT list when updating a Document, that allows removing removed aspects
Cherry picked from 7135403
2020-08-18 12:09:17 +02:00
Angel Borroy 8ffef842db SEARCH-2378: Update the whole PARENT list when updating a Document
Cherry picked from 84bb8db
2020-08-18 12:06:11 +02:00
Angel Borroy 1e52cb4758 SEARCH-1915: Generating again crypto stores with the new way of working. 2020-06-30 11:38:23 +02:00
Angel Borroy 0c17b81d6f SEARCH-2041: Move project from Git to GitHub
Change Maven Git protocol from https to ssh
2020-06-25 13:18:53 +02:00
Angel Borroy d925801768 SEARCH-2041: Move project from Git to GitHub 2020-06-23 10:11:39 +02:00
Angel Borroy 4798e55884 SEARCH-1915: Use JAVA_TOOL_OPTIONS to pass SOLR SSL password values.
SOLR_SSL_TRUST_STORE_PASSWORD >> solr.jetty.truststore.password
SOLR_SSL_KEY_STORE_PASSWORD >> solr.jetty.keystore.password
SOLR_SSL_CLIENT_KEY_STORE_PASSWORD >> javax.net.ssl.keyStorePassword
SOLR_SSL_CLIENT_TRUST_STORE_PASSWORD >> javax.net.ssl.trustStorePassword
2020-06-19 16:27:30 +02:00
Angel Borroy 9b1f2407d1 SEARCH-2277: Restore Apache License header: modifications copyright. 2020-06-18 15:19:41 +02:00
Angel Borroy 4b723d5da1 SEARCH-2277: Restore Apache License header to source code modified from Lucene Solr project. 2020-06-18 15:03:03 +02:00
Angel Borroy da6566b4a8 SEARCH-1915: Hide Java Environment values from external process like 'ps'
When using the JAVA_TOOL_OPTIONS environment variable, values are not passed as arguments to the Java Process
2020-06-18 12:43:52 +02:00
Angel Borroy 8dc8dbf010 Bump Spring Libraries version for notice.txt 2020-06-16 12:11:58 +02:00
Angel Borroy c3641bf91b SEARCH-2296: Bump alfresco-data-model version 2020-06-16 10:35:18 +02:00
Angel Borroy dc494362ea SEARCH-2296: Testing for the new "_unit_of_time_quarter" date part field. 2020-06-15 16:22:24 +02:00
Angel Borroy 07cc6af3f3 SEARCH-2296: Add new "_unit_of_time_quarter" date part field. 2020-06-15 16:21:53 +02:00
Angel Borroy 78a801fea7 SEARCH-2118: Removing OpenSSL program from SS/IE Docker Images. 2020-06-15 11:04:57 +02:00
Angel Borroy e6d3511101 SEARCH-1915: Cherry-picking selected changes from https://git.alfresco.com/search_discovery/insightengine/tree/fix/search-1915 2020-06-10 11:24:36 +02:00
Angel Borroy cdd90e0c37 SEARCH-2238: Avoid setting the core name in Floc properties, as this provokes the Flocs belonging a group being different and, hence, not being grouped by ShardRegistry logic. 2020-06-08 10:36:23 +02:00
Angel Borroy 18a7d5af3b SEARCH-1915: Support for ACS 7.x (named temporary as "latest")
Created the new env var password specification for cryptographic stores when using mTLS in latest.
Added new cryptographic stores set according to ACS 7.x criteria
2020-06-02 16:38:27 +02:00
Angel Borroy 3debea0e11 SEARCH-1915: Fix 6.2.x latest versions for Enterprise and Community 2020-06-02 13:39:24 +02:00
Angel Borroy 05962b1cd6 SEARCH-2252: Remove unused tests. 2020-05-20 15:35:58 +02:00
Angel Borroy 7e9602b67f SEARCH-2252: Avoid indexing fields without property definition information. 2020-05-20 10:36:06 +02:00
Angel Borroy 2fd8af7261 SEARCH-2252: Avoid to add fields declared as not indexed to SOLR Schema and to SOLR Index. 2020-05-19 11:20:41 +02:00
Angel Borroy 2cad933652 SEARCH-2227: Upgraded schema to 1.6, useDocValuesAsStored defaults to true. 2020-05-11 15:38:00 +02:00
Angel Borroy 6e4125ef88 SEARCH-2227: Changed dynamic fields to stored="false" when having stored="true" and docValues="true" in order to save storage space. 2020-05-08 11:49:20 +02:00
Angel Borroy 8d4f5e357d SEARCH-950: Moved utility functions to Abstract Class.
Model modified to test both TRUE and BOTH tokenization values.
2020-04-20 09:18:28 +02:00
Angel Borroy 78af6df57c SEARCH-950: Test field identifiers containing hyphens (-) for SQL Select queries 2020-04-15 12:41:57 +02:00
Angel Borroy 45ba419c15 SEARCH-2169: Add the new licenses required by Calcite 1.12.0 2020-04-13 17:19:40 +02:00
Angel Borroy 61063468d3 SEARCH-2169: Upgrading Calcite to 1.12.0 to fix some Date Fields issues existing in provided SOLR 6.6.x version (1.11.0)
Tests are implemented only for constants values, as currently Alfresco SOLR Dates are returned as String.
2020-04-13 16:14:39 +02:00
Angel Borroy 79c0fe6262 SEARCH-2087: YourKit Java Profiler server side software has been added to Search Services and Insight Engine Docker Images by default.
In order to enable this YourKit Agent, additional SOLR_OPTS value is required when running the Docker Image. Also mapping the Docker Image exposed port (10001) is required.
2020-03-20 15:54:21 +01:00
Angel Borroy bdf8063caa SEARCH-2029: Add compress option to solr6secondary 2020-03-19 10:34:07 +01:00
Angel Borroy 50734519b5 SEARCH-2029: Apply content compression options to Enterprise Docker Compose template 2020-03-18 11:56:46 +01:00
Angel Borroy 7e91e77eae SEARCH-2097: Consolidating log messages 2020-03-09 11:39:59 +01:00
Angel Borroy 700d86ca8e SEARCH-2097: Adding verbose log (INFO, DEBUG and TRACE levels) for AclTracker.
Adding detailed information for rollback operations, dumping the Exception that caused that rollback.
2020-02-27 15:13:23 +01:00
Angel Borroy 50effd5f3c SEARCH-2096: Using SolrQueryRequest to find existing nodes instead of current searcher. 2020-02-25 11:37:21 +01:00
Angel Borroy 29b53b55bd SEARCH-2096: Remove SEARCH-2027 approach to delete SOLR Documents only when they existed, as it has been detected some race conditions that lead to duplicating documents in the index. 2020-02-25 09:28:13 +01:00
Angel Borroy 56143aee74 SEARCH-2117: Declaring "DistributedAlfrescoSolrTrackerLargeTxnTest" as Test Id. 2020-02-24 14:24:02 +01:00
Angel Borroy c92bffab9c SEARCH-2117: Added a new configuration parameter "solr.initial.transaction.range" with default value 0-2000. This can be used when database initial transaction Id is greater than 2000. 2020-02-24 12:29:03 +01:00
Angel Borroy a043c474d2 SEARCH-2112: When using Shard DB_ID_RANGE method, check firstTransaction only when Shard is not empty. 2020-02-24 09:41:38 +01:00
Angel Borroy 92edfc5999 SEARCH-2117: Fix integration test approach, setting explicitly a [1..2000] txnId when checkCore is required. 2020-02-19 14:50:41 +01:00
Angel Borroy f93e979ed9 SEARCH-2117: Revert limit to 2000l for checking first transactions in database when checking the index and fix Integration Test. 2020-02-19 11:43:11 +01:00
Angel Borroy 61faf9ab2d Describe skip transactions feature for logging. 2020-02-18 15:55:13 +01:00
Angel Borroy bf17b980da SEARCH-2112: On Shards configured with DB_ID_RANGE, the first indexed transaction can be different from the first transaction in the repository 2020-02-18 11:55:55 +01:00
Angel Borroy d33e5834c3 SEARCH-2112: When transactions are out of Shard range, only the latest transaction needs to be indexed in order to preserve the state up-to-date of the MetadataTracker 2020-02-18 10:57:42 +01:00
Angel Borroy 223da01b6b Remove unnecessary code from unit test. 2020-02-13 19:43:34 +01:00
Angel Borroy ab1636980e Fix unit tests. 2020-02-13 18:37:58 +01:00
Angel Borroy 37242ac1bb As some other tests have been run before SOLR Admin ones, the expected transactions and ACLs to reindex can't be predicted. Enough to check that a list is returned by fix methods, but ignoring the size of this list. 2020-02-13 18:29:31 +01:00
Angel Borroy 7f31fc41b7 Added detailed messages to describe errors when testing. 2020-02-13 17:34:19 +01:00
Angel Borroy fe315ca710 Avoid coding useless conditions. 2020-02-13 11:31:35 +01:00
Angel Borroy e4ba6c6d2c Adding detailed asserts in order to check parameter values inside the JSON Response. 2020-02-13 11:31:08 +01:00
Angel Borroy 087ab1734e Add missing parameter messages to responses instead of throwing Exceptions.
Extended test coverage.
2020-02-12 10:59:08 +01:00
Angel Borroy 943fafcca3 Child associations are not indexed as well. 2020-01-24 14:59:50 +01:00
Angel Borroy 8eaf47f923 Skip getting Child Ids when indexing metadata. 2020-01-24 10:45:11 +01:00
Angel Borroy 3854bf2060 Avoid checking repo services when using MetadataTracker from Integration Tests (locally using JUnit) 2020-01-22 18:19:32 +01:00
Angel Borroy 2882b8edc2 Add Get Content compress option to Yeoman Generator. 2020-01-22 10:37:37 +01:00
Angel Borroy 37e612047b Skipping transactions for DB_ID_RANGE Shard method. 2020-01-21 16:13:59 +01:00
Angel Borroy 641bb26dcc Fix null pointer comparison 2020-01-20 10:18:19 +01:00
Angel Borroy ee21af7b27 Fix changes from review. 2020-01-17 14:25:59 +01:00
Angel Borroy 9ff35e7807 Add this feature to SOLR Core properties, in order to allow the user to switch on the compression depending on his environment and use case. 2020-01-16 11:00:25 +01:00
Angel Borroy d28f05b19b Use gzipped compressed streams to recover content text from repository.
This modification will also require Tomcat / NGINX configuration in order to accept HTTP GZIP requests.
2020-01-14 16:50:16 +01:00
Angel Borroy 8e3ed43abe Use Searcher from Request instead of from Core. 2020-01-09 16:59:55 +01:00
Angel Borroy c1ed26602d Use LongPoint for query related with DBID, as using String was producing empty results. 2020-01-09 12:58:18 +01:00
Angel Borroy 2ff2c47041 Add specific exception when Repository Service is not available to provide deeper information in the logs. 2020-01-09 09:39:59 +01:00
Angel Borroy c3ab1fc817 Use the feature only when nextTxCommitTime Web Script is available in the repository. 2020-01-08 14:45:49 +01:00
Angel Borroy f29e3250fd Skip long periods of time where repository is not ingesting new content. 2020-01-07 11:18:18 +01:00
Angel Borroy d6faa32dec Delete nodes only if they exist 2019-12-27 13:26:55 +01:00
Angel Borroy 10c4eff30c Bump Docker Image release numbers to ACS 6.2 2019-12-04 13:26:53 +01:00
Angel Borroy 1bae63d3ca Clarify that certificates, truststores and keystores are provided only for testing purposes. 2019-10-08 13:30:14 +02:00
Angel Borroy 4493c6729b Add support for WebProxy with SSL
Add support to disable WebProxy protection for SOLR REST API
2019-10-07 16:31:55 +02:00
Angel Borroy e9a3a0dd35 Clarify condition. 2019-09-02 09:15:57 +02:00
Angel Borroy 2cb1bed475 Remove FindBugs annotations from WEB-INF/lib, as it's only used to produce FindBugs reports with SonarQube 2019-08-29 11:08:18 +02:00
Angel Borroy 6e70029ae1 Add FindBugs license 2019-08-29 09:53:51 +02:00
Angel Borroy 5b33719575 Add instructions to build Docker Image from Windows computers. 2019-08-28 17:12:31 +02:00
Angel Borroy 4ef2befdcb Fixes from review comments. 2019-08-28 16:34:32 +02:00
Angel Borroy eba5581355 Remove class to use local AtomicInteger property. 2019-08-28 15:15:41 +02:00
Angel Borroy fed32bdf73 Every D Ranked bug is fixed. 2019-08-26 16:37:51 +02:00
Angel Borroy 3b990f5246 Removed additional properties from documentation. 2019-08-13 15:40:22 +02:00
Angel Borroy ed603af738 Support for ACS 5.2.6-RC2 2019-08-12 17:10:22 +02:00
Angel Borroy c294e9b3e7 Including proxy to 6.1 CE to server both alfresco and share web apps in port 8080 2019-08-08 16:14:05 +02:00
Angel Borroy b2068a36ff Adding "-a" parameter to documentation 2019-08-08 15:08:04 +02:00
Angel Borroy 8d2488873b Describing what "empty" file does. 2019-08-07 11:35:31 +02:00
Angel Borroy d130d05252 Enable custom model deployments for repository and custom forms deployments to Share. 2019-08-06 16:57:26 +02:00
Angel Borroy 7d65a61e4e Support for AGS latest (based in ACS 6.1) 2019-08-06 12:34:59 +02:00
Angel Borroy 081c1b4290 Update README 2019-07-31 13:42:47 +02:00
Angel Borroy 75e5ab949a Moving from "latest" to "6.2" to identify the current ACS version.
Created "images" folder to store Docker Images for Alfresco, Search and Zeppelin
Skipping "shard.count" setting for DB_ID_RANGE and EXPLICIT_ID_FALLBACK_LRIS
2019-07-31 13:40:49 +02:00