- addition of index control aspect to surf-config objects - config xml files no longer indexed at all
- refactoring of My Profile user contents fts-alfresco queries to search specific known containers only rather than all
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31288 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
o performance improvements: disable/enable auditing behaviour per-transaction rather than per-node
o add "disable rules" checkbox to GUI and support disabling of rules during import
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31243 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
- Bulk Filesystem Importer
- Adapted from work by Peter Monks (see http://code.google.com/p/alfresco-bulk-filesystem-import) and Romain Guinot
- Refactored to limit repeated code
- Refactored to use the Bulk Processor
- Currently limited to one bulk import at a time (enforced by lock service)
- Unit tests added
- Some fixes applied
- Performance tests; tried different filesystem "walking" strategies
- Still to do: yui dependencies - are these necessary?
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31100 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
30947: ALF-10619: Merged PATCHES/V3.1.2 to V3.4-BUG-FIX
30884: ALF-10588: Another possible race condition resulting in out of sync transactions - found on SQL Server and JBoss in 3.1.2
- FTS could process updated and deleted nodes in the same transaction before the tracker got to them, leaving behind the correct transaction ID and deleted nodes but undeleted container docs!
- We now have to validate all deletions have been honoured when index tracking
30890: ALF-10588: Temporarily disable FTS during IndexCheckServiceImplTest
- Otherwise can get confused by intermediate FTS state of its own nodes!
30894: ALF-10588: Correction to deletion checking
- Only search for deleted nodes, not updated ones too!
30948: ALF-10619: Fixed merge issue
30982: - ALF-10503 60k Site Performance: Admin Console | Groups: search with a value that matches all 60 groups: maxClasuesCount=10000
- ALF-10511 60k Site Performance: Admin Console | Users | Edit User | Group Search with a value that matches all 60 groups: maxClauseCount=10000
- ALF-10608 60k Site Performance: Searching for a group to add to a site with a value that matches all 60 groups: maxClauseCount=10000
- ALF-10515 60k Site Performance: Edit Group Display Name: The first time, nothing appears to happen for 10 seconds after pressing [Save]
- ALF-10514 60k Site Performance: Admin Console | Groups | Search | Delete Group: no feedback to user for 20 seconds after clicking delete icon
30985: Increases in node, property and aspect caches.
30987: Merged DEV/TEMPORARY to V3.4-BUG-FIX
30984: ALF-9880 : ContentGet web script throws NullPointerException for nodes missing cm:modified property
The check for null was added for cm:modified property (similar to BaseDownloadContentServlet).
30995: Fix for ALF-9021
30996: ALF-10324 Cannot disable Home Folder Creation
- Bug introduced into V3.1 on the 8 March 2010
- ChainingUserRegistrySynchronizerTest enhanced to check for this
- Fix to PersonService: Home folder was not being created for 'missing' persons
- PersonService: Changed autoCreate parameters to more descriptive names (okay long) and updated Javadoc
30998: ALF-10512 60k Site Performance: Clicking on Sites (left hand side) in the Repository browser causes transactional limit to be reached
- Changed node, aspect, property and parentAssoc cache sizes (based on Derek's Skype message)
31006: ALF-10512 60k Site Performance: Clicking on Sites (left hand side) in the Repository browser causes a transactional limit to be reached
- Having changed cache sizes in previous commit, the nodeOwner and acl transactional caches were then blown with test case for ALF-10512
Changed to 20k from 10k. Tried 15k but it still had a problem.
31052: Fix for ALF-10520
Merged HEAD to V3.4-BUG-FIX
31051: Performance improvements for Share Repository browser queries.
DB with ~50,000 nodes under Company Home:
Before:
- I'm Editing - 16 secs, Favorites - 17 secs, Tag - 14 secs
After:
- I'm Editing - 1.5 secs, Favorites - 1.2 secs, Tag - 1.25 secs
31058: ALF-10324 Cannot disable Home Folder Creation
- ChainingUserRegistrySynchronizerTest check using personService with both eager and non eager home folder creation
31064: ALF-9360: Merged PATCHES/V3.4.4 to V3.4-BUG-FIX
30244: Merged DEV/DAVEW/IMAP_NEW to PATCHES/V3.4.4
29635: Rework of IMAP to use lightweight caching and correctly set UIDVALIDITY, NEXTUID and Marked / Unmarked state
29668: 1. Changed get AlfrescoImapFolder.getFullNameInternal to be dynamic for cache support
29692: 1. Reverts changed in AlfrescoImapServer to allow ImapHostManager to be a session key for folder.
2. getFlags relies on FileInfo.getProperties()
29741: 1. Changed AbstractMimeMessage.updateMessageId() to follow RFC2822 (3.6.4. Identification fields)
2. Changed ImapServiceImpl to handle absent folders and return "NO" reply to a client.
3. Changed ImapServiceImpl that behaviours don't fail when Alfresco is being first time bootstrapped with IMAP enabled.
4. Cleared AlfrescoImapFolder constructor.
5. Fixed SelectCommand's response to adhere RFC3501 (6.3.1. SELECT Command)
6. Fixed CommandParser to be able parse the flag which is not surrounded by braces (STORE 2:4 +FLAGS \Deleted)
30235: Completion of IMAP rework
- Scalable caching
- Proper transactional cache for assembled messages
- No more assumption that EHcache will always hold entire folder set at once (and perhaps it can't)
- Per session (TCP connection) cache of accessed folders
- Session cache validation via a 'change token' that is incremented on all significant events
- Folder status attributes evaluated once and reused until the change token changes
- Now only changed folders need to be queried on an IMAP sync and the server doesn't have to hold all folders in memory
- User's view is consistent with their security permissions
- Simplification / overhaul of ImapServiceImpl including efficient recursive path building and matching
- AlfrescoImapFolder immutable as it should be
- Greenmail fixes
- Fixed quoting of mailbox names
- Fixed hanging problem in ImapRequestLineReader - regression caused by our 8 bit encoding fix. Avoid using an InputStreamReader to read ISO-8859-1 bytes as it has an internal buffer.
30275: Fix failing IMAP tests broken by my recent refactor!
- Fixed greenmail conversion of ISO-8859-1 bytes to chars
- Transaction read write attributes on service
- Read only commands on AbstractImapFolder
- Imap aspect properties must be managed as SYSTEM user
- Restored persistence of new mail messages
- Avoid unit test txn rollback woes by making it possible to check for existence of a path with FileFolderService
30487: ALF-10268: Merged V3.4-BUG-FIX to PATCHES/V3.4.4
30264: ALF-10187: Merged V3.3 to V3.4-BUG-FIX
30003: ALF-9898: More defensive exception handling to avoid packet pool leaks and extra logging on packet pool exhaustion
30540: ALF-10257: Fixed logic error introduced into Greenmail ImapRequestLineReader
30988: ALF-9361: Merged DEV/DAVEW/IMAP_NEW to PATCHES/V3.4.4 (by Arseny)
30419: Remote test for generic client request sequence.
30547: 1. A bug with FetchCommand particularly with FETCH (BODY.PEEK[1]) with an error
1315912197.789640 1.5 NO FETCH failed. java.lang.String cannot be cast to javax.mail.internet.MimeMultipart
This happened while message content is being proceeded like MimeMultipart mp = (MimeMultipart) mimeMessage.getContent();, but javadoc of mimeMessage.getContent() says that this content can be a String in case of non-multipart message. Fixed FetchCommand accordingly to mimeMessage.getContent() javadoc.
2. A bug with RFC822MetadataExtracter
When mimeMessage.getHeader("received"); is used with the message with following header
Received: with ECARTIS (v1.0.0; list dovecot); Tue, 06 Aug 2002 13:01:17 +0300 (EEST)
It doesn't extract a date, because it uses lastReceived.indexOf(';') which returns the position IN the ECARTIS (v1.0.0; list dovecot) after v1.0.0,
So it should use lastReceived.lastIndexOf(';') to get the position after ECARTIS (v1.0.0; list dovecot).
31025: ALF-9361: IMAP Performance
- Introduced folder status MRU cache
- Keyed by user ID and change token so no need to cluster
- Now means we should get reuse across IMAP sessions
- Also fixed isMarked() implementation to only return true if there are recent or unseen mails
31038: ALF-9361: Prevent the starting of unnecessary transactions in AlfrescoImapFolder interface
- getFolderStatus regulates its own transaction
- Dropped all those *Internal methods from the abstract class
- getUnqualifiedMailboxPattern moved to AlfrescoImapHostManager
- Fixes to session folder cache validation / reuse
31039: ALF-9361: Repository tuning for IMAP performance
- Backed out ALF-5575 60 second timeout on node caches - Should be covered by ALF-8607 fix
- Also made TransactionalCache.NewCacheBucket save new values to the shared cache for 'mutable' caches. Previously it was only possibly to load into the node caches in a read only transaction!
- Also added fix to make AbstractNodeDAOImpl bulk load empty node aspect sets
- Result is a drastic speedup of full sync times as most items can be served from the cache`
31042: ALF-9361: Fix ImapServiceImplTest
31048: ALF-9361: Make ConcurrentNodeServiceTest work again, after relaxation of 'mutable' transactional caches
- aspect and property caches validated by node transaction ID, as per parent assocs in ALF-8607
31050: ALF-9361: Caching correction
Always use the cached mailbox reference if it is equivalent (because the session remembers the last selected mailbox)
31060: ALF-9361: Fix CacheTest, following back out of ALF-5575 behaviour
31061: ALF-9361: More caching fixes
31062: ALF-9361: Undo accidental changes to ConcurrentNodeServiceTest
31063: ALF-9361: Build fix: replaced assertSame with assertEquals
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31079 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
30744: ALF-9524: WCM: Defining a complex type with 'abstract' attribute to true does not allow other complex types to define elements with the same name
- Fix by Pavel
30804: ALF-9524: Fix to NPE by Pavel
30812: ALF-718: Rules Fire Emails before Transaction Commit/Rollback
Added tests and moved email sending into a post commit callback.
30820: Fix for ALF-10516 - 'My Sites' dashlet should indicate it is loading rather than say 'No sites'
30824: Fixed ALF-10470: DeclaritiveRegistry is looping continuously and re-initializing
- Only replicate removals for the cache. The reset always does a remove first.
<cache
name="org.alfresco.cache.webScriptsRegistryCache"
...
replicateUpdates = false,
...
</cache>
30827: ALF-10513 60k Site Performance: Unable to delete user + request not acknowledged for 2 minutes
Now about 3 to 4 seconds
30828: Andy H recommended change to lucene indexer values
30831: ALF-718: Fix for InvitationServiceImplTest
Fixes behaviour broken by original fix for ALF-718: the send-after-commit does NOT work for the invitation service, so it was necessary
to change the code to only send-after-commit in the context of a rule.
30843: Fixed ALF-7698 "Defects in tags picker in SHARE." according to feedback provided in ALF-9953 "Decide order where new items shall appear in the object finder."
30844: ALF-9544 - Inbound email restricts file name to 86 characters or less.
used QName.createQNameWithValidLocalName() as suggested.
added new EmailServiceImplTest
30849: Fixed ALF-8776 "Rule details dialog handling of apostrophes"
30862: Merged DEV/TEMPORARY to V3.4-BUG-FIX (with improvements)
30856: ALF-10288: Regression of ALF-1997: non domain users cannot bypass SSO in Share using /share/page?pt=login
In SSOAuthenticationFilter.doFilter() method added check (PAGE_SERVLET_PATH.equals(req.getServletPath()) && LOGIN_PATH_INFORMATION.equals(req.getPathInfo()).
30864: SMTP Server, To and From address format.
- Out standards for from and to address were stuck in the 1980s!
30867: ALF-10517 - 'My Content' slow
- performance improvements by reworking Lucene queries used to retrieve recently modified and recently created content for a user
- converted queries to fts-alfresco
- improvements from 3.5sec per page render down to 1.1 secs
30874: MERGE DEV to V3.4-BUG-FIX
30851 : ALF-9558 - Unchecked Return Value
30882: - ScriptGroup.isRootGroup() now stops if it finds a single parent rather than doing a size on all parent groups.
Not sure the logic (not changed by me) is correct as it includes parents that are site groups.
- SiteServiceImpl now only gets the specified number of sites. Sometimes it would have return more if AuthorityDAOImpl
switched approach used to get containing authorities.
- Overloaded getContainingAuthorities to take a size parameter, deprecated other and switched calling code
Done for isRootGroup activity.
30910: - Fix build error
- Found a better way to use filter in AuthorityDAOImpl.getContainingAuthoritiesInZone
so that we don't need to reset the filter, by using the +ve hits from first approach
if we switch to second approach.
30925: - ALF-10501 60k Site Performance: Searching for a group to add to a site with a value that matches a few sites takes 2 minutes
ALF-10502 60k Site Performance: Admin Console | Groups: search with a value that matches a few sites takes 70 seconds
ALF-10504 60k Site Performance: Admin Console | Groups | Browse Groups page appears corrupt as it never finishes loading
- All the above were slow as a result of ScriptGroup.isRootGroup()
- ScriptGroup.isRootGroup() and ScriptGroup.isAdminGroup() removed - Checked with KevinR that these are not needed any more.
- Removed code added on 30 Sep 11 to support isRootGroup (the size parameter to AuthorityDAO.getContainingAuthorities)
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@30935 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
Publishing: Remove some operations from the Channel and ChannelType interface that really shouldn't be exposed. Also removed the PublishingQueue interface - the two operations it had are now on the PublishingService.
WQS: Removed obsolete references to publishing channels.
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@30794 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
30270: ALF-9492 Can now update task properties through the Workflow JavaScript API. ALF-10087 Fixed failing Multi-tenancy tests.
30306: Fixed ALF-7384: Xam: XamArchiveCleaner can delete files before retention period has passed
- Keep the NOW upper limit to the query
- Add a double-check using Java code to precisely check (down to the ms) that the retention time has passed
30308: Merged V3.4 to V3.4-BUG-FIX
30307: ALF-10186: Fix up all code that expects it can cast a WebScriptRequest directly into a WebScriptServletRequest
30310: ALF-5830 show_audit.ftl template doesn't work any more
- Changes to support new audit api
- Works with high level content auditing
30337: Merge DEV to V3.4-BUG-FIX
30160 : ALF-9257 - Renaming web project cause no trigger of the autodeploy process
30362: ALF-10227 Add space after ''{0}'' in text
30395: Removed deep svn:mergeinfo
30433: Merged DEV/TEMPORARY to V3.4-BUG-FIX
30424: ALF-8941: WCM: Virtual server setting lazyDeployExperimentalOnly ="true" (as per si3 fix) fails to load library under WEB-INF/lib directory (for HTTP filter).
Walk up by hierarchy to the root and deploys a context if it wasn't deployed yet, through invocation of updateAllVirtualWebapps recursively.
30454: Fixed ALF-9158: Assignment of workflow task is not proper - out-of-the-box WCM workflow
30466: Merged DEV/TEMPORARY to V3.4-BUG-FIX
30460: ALF-9424 : Webform(XSD): xf:switch switch group does not work based on "complexContent with Base" element.
Schema2XForms and SchemaUtil were modified to allow correctly process elements with namespace that differ from "http://www.w3.org/2001/XMLSchema"
30476: Merged DEV to V3.4-BUG-FIX
30474: ALF-10021: Get the last node in the resultset outside the timing loop to force prefetch.
30483: Fixed ALF-9417: (pdf2swf) Share preview is blank with some pdf files.
30514: ALF-240: Unfriendly error appears when trying to view details for created discussion for multilingual content
Webdav URLs were not valid for non-ML or ML discussion items, but were only stopping the details page for the ML items from being shown. Utils.generateURL now returns null for such items.
30517: Fixed ALF-5526: Component-Generator for d:noteref and other "system" types always disabled => breaks extensibility
30519: FileFolderService moveFrom method was not supported by MLTranslationInterceptor
30527: ALF-240: added missing exception message.
30531: Fixed ALF-9599: Share forms do not allow edit of non-cm:content nodes
30541: ALF-9424: Missed change, causing compilation error
30552: Tests to accompany fix for ALF-240, ALF-10298: discussion topic webdav URLs causing error page in explorer.
30565: Fixed ALF-10336 "Drag and Drop item in Customize Site Dashboard - text of item reverts to default font style and size during drag operation"
30568: Fixed ALF-10342: ClassCastException on org.alfresco.repo.copy.AbstractCopyBehaviourCallback
30570: ALF-3332: (circa 2008) Pagination inks rewritten incorrectly by opensearch proxy
30574: ALF-9470: OwnableService cache not being updated for archived nodes - modified fix by Pavel
30579: ALF-5607: Cancelling of install. Some directories are not deleted from disk.
- Fixed provided by Bitrock for Mac and Windows
30583: Merged HEAD to V3.4-BUG-FIX (Back ported 2 fixes for included resource handling when running unit tests)
28711: Avoid a NPE on certain kinds missing included resources, and instead give a helpful error along the lines of other include issues
28716: When loading JS includes with a full classpath reference, handle the Eclipse classloader behaving slightly differently on absolute paths compared to the JVM one
30648: Fixed ALF-10401: No simple way to disable auto-versioning behaviour
- Added property: version.store.enableAutoVersioning=true
- When set to 'false', the VersionableAspect will not respond to any events;
even if the aspect is present, it will not create versions.
30657: Merged DEV/TEMPORARY to V3.4-BUG-FIX
30590: ALF-7105: pdfbox returns errors in the logs but one cannot understand what file is affected (PDFBox)
Level log4j.logger.org.apache.pdfbox.pdmodel.font.PDCIDFont=fatal was introduced in log4j.properties.
30669: Fixes: ALF-6470 (Updates FR translation)
30686: ALF-1017: Fixed compilation error in backport
30696: Fix for ALF-8176
30708: ALF-10040: Added missing ReferenceCountingReadOnlyIndexReaderFactory wrapper to IndexInfo.getMainIndexReferenceCountingReadOnlyIndexReader() to make it consistent with IndexInfo.getMainIndexReferenceCountingReadOnlyIndexReader(String, Set<String>, boolean) and allow SingleFieldSelectors to make it through from LeafScorer to the path caches! Affects ALL Lucene queries that run OUTSIDE of a transaction.
30722: Fixed ALF-9465: Share: We can add category in Share, but the selected value will not be shown in U.I.
30724: Merged BRANCHES/DEV/BELARUS/V3.4-BUG-FIX-2011_09_05 to BRANCHES/DEV/V3.4-BUG-FIX:
30603: ALF-10165: Unexpected behaviour when title duplicated between web forms
30754: Fix for ALF-9899 Huge share site migration, add group to site and user access site related performance issue.
- generic performance improvements for PATH queries ending "..../*" - specifically to improve listing calendar items for users in many share sites
30765: Fix for ALF-760 - import loses category association data
30779: Merged V3.4 to V3.4-BUG-FIX
30716: ALF-10452 It's impossible to edit existing user details
- Change for ALF-371 did not handle the simplest case - no change of home folder location
30549: Fixes ALF-9534 - Location API
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@30780 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
The de-lucening work has already moved to the required pattern where a check for container existence should be performed rather than just creating it, this allows GET requests to be declared to use a 'readonly' transaction which in turn provides performance benefits as more caching can be done. These webscripts have therefore been marked as 'readonly' in their descriptor, a few doclib scripts also work without code changes so have been marked as readonly too.
I've added a new unit test (org.alfresco.repo.web.scripts.ReadOnlyTransactionInGetRestApiTest) that calls all scripts mentioned in the JIRA issue immediately after creating a site (meaning there are no containers present) as we identify more scripts that need the same treatment they can be added to this test.
To help identify other GET webscripts using 'readwrite' transactions i've added a log WARN to RepositoryContainer which will output the following in the server console:
2011-09-21 08:57:46,431 WARN [web.scripts.RepositoryContainer] [main] Webscript with URL '/alfresco/service/slingshot/doclib/treenode/site/readOnlyTestSite/documentLibrary' is a GET request but it's descriptor has declared a readwrite transaction is required
I'll suggest that QA raise new bugs when they see these and we can prioritise individually, we can disable this warning before release if necessary.
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@30664 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
