- nodePropertiesCache is now keyed by the nodes' Id-VERSION keys
- prevents old transactions from writing stale properties over latest cache properties
- TODO: Still need to make the cache immutable, but waiting for aspects and parent assocs to be done
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31140 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
- Perform basic node version check when reading properties and aspects from DB
- This is just the start. Next step is to change the key of the cache itself.
- Includes fix for rev 31109: Use setNodeAclId() to set ACL IDs
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31121 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
- Bulk Filesystem Importer
- Adapted from work by Peter Monks (see http://code.google.com/p/alfresco-bulk-filesystem-import) and Romain Guinot
- Refactored to limit repeated code
- Refactored to use the Bulk Processor
- Currently limited to one bulk import at a time (enforced by lock service)
- Unit tests added
- Some fixes applied
- Performance tests; tried different filesystem "walking" strategies
- Still to do: yui dependencies - are these necessary?
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31100 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
30947: ALF-10619: Merged PATCHES/V3.1.2 to V3.4-BUG-FIX
30884: ALF-10588: Another possible race condition resulting in out of sync transactions - found on SQL Server and JBoss in 3.1.2
- FTS could process updated and deleted nodes in the same transaction before the tracker got to them, leaving behind the correct transaction ID and deleted nodes but undeleted container docs!
- We now have to validate all deletions have been honoured when index tracking
30890: ALF-10588: Temporarily disable FTS during IndexCheckServiceImplTest
- Otherwise can get confused by intermediate FTS state of its own nodes!
30894: ALF-10588: Correction to deletion checking
- Only search for deleted nodes, not updated ones too!
30948: ALF-10619: Fixed merge issue
30982: - ALF-10503 60k Site Performance: Admin Console | Groups: search with a value that matches all 60 groups: maxClasuesCount=10000
- ALF-10511 60k Site Performance: Admin Console | Users | Edit User | Group Search with a value that matches all 60 groups: maxClauseCount=10000
- ALF-10608 60k Site Performance: Searching for a group to add to a site with a value that matches all 60 groups: maxClauseCount=10000
- ALF-10515 60k Site Performance: Edit Group Display Name: The first time, nothing appears to happen for 10 seconds after pressing [Save]
- ALF-10514 60k Site Performance: Admin Console | Groups | Search | Delete Group: no feedback to user for 20 seconds after clicking delete icon
30985: Increases in node, property and aspect caches.
30987: Merged DEV/TEMPORARY to V3.4-BUG-FIX
30984: ALF-9880 : ContentGet web script throws NullPointerException for nodes missing cm:modified property
The check for null was added for cm:modified property (similar to BaseDownloadContentServlet).
30995: Fix for ALF-9021
30996: ALF-10324 Cannot disable Home Folder Creation
- Bug introduced into V3.1 on the 8 March 2010
- ChainingUserRegistrySynchronizerTest enhanced to check for this
- Fix to PersonService: Home folder was not being created for 'missing' persons
- PersonService: Changed autoCreate parameters to more descriptive names (okay long) and updated Javadoc
30998: ALF-10512 60k Site Performance: Clicking on Sites (left hand side) in the Repository browser causes transactional limit to be reached
- Changed node, aspect, property and parentAssoc cache sizes (based on Derek's Skype message)
31006: ALF-10512 60k Site Performance: Clicking on Sites (left hand side) in the Repository browser causes a transactional limit to be reached
- Having changed cache sizes in previous commit, the nodeOwner and acl transactional caches were then blown with test case for ALF-10512
Changed to 20k from 10k. Tried 15k but it still had a problem.
31052: Fix for ALF-10520
Merged HEAD to V3.4-BUG-FIX
31051: Performance improvements for Share Repository browser queries.
DB with ~50,000 nodes under Company Home:
Before:
- I'm Editing - 16 secs, Favorites - 17 secs, Tag - 14 secs
After:
- I'm Editing - 1.5 secs, Favorites - 1.2 secs, Tag - 1.25 secs
31058: ALF-10324 Cannot disable Home Folder Creation
- ChainingUserRegistrySynchronizerTest check using personService with both eager and non eager home folder creation
31064: ALF-9360: Merged PATCHES/V3.4.4 to V3.4-BUG-FIX
30244: Merged DEV/DAVEW/IMAP_NEW to PATCHES/V3.4.4
29635: Rework of IMAP to use lightweight caching and correctly set UIDVALIDITY, NEXTUID and Marked / Unmarked state
29668: 1. Changed get AlfrescoImapFolder.getFullNameInternal to be dynamic for cache support
29692: 1. Reverts changed in AlfrescoImapServer to allow ImapHostManager to be a session key for folder.
2. getFlags relies on FileInfo.getProperties()
29741: 1. Changed AbstractMimeMessage.updateMessageId() to follow RFC2822 (3.6.4. Identification fields)
2. Changed ImapServiceImpl to handle absent folders and return "NO" reply to a client.
3. Changed ImapServiceImpl that behaviours don't fail when Alfresco is being first time bootstrapped with IMAP enabled.
4. Cleared AlfrescoImapFolder constructor.
5. Fixed SelectCommand's response to adhere RFC3501 (6.3.1. SELECT Command)
6. Fixed CommandParser to be able parse the flag which is not surrounded by braces (STORE 2:4 +FLAGS \Deleted)
30235: Completion of IMAP rework
- Scalable caching
- Proper transactional cache for assembled messages
- No more assumption that EHcache will always hold entire folder set at once (and perhaps it can't)
- Per session (TCP connection) cache of accessed folders
- Session cache validation via a 'change token' that is incremented on all significant events
- Folder status attributes evaluated once and reused until the change token changes
- Now only changed folders need to be queried on an IMAP sync and the server doesn't have to hold all folders in memory
- User's view is consistent with their security permissions
- Simplification / overhaul of ImapServiceImpl including efficient recursive path building and matching
- AlfrescoImapFolder immutable as it should be
- Greenmail fixes
- Fixed quoting of mailbox names
- Fixed hanging problem in ImapRequestLineReader - regression caused by our 8 bit encoding fix. Avoid using an InputStreamReader to read ISO-8859-1 bytes as it has an internal buffer.
30275: Fix failing IMAP tests broken by my recent refactor!
- Fixed greenmail conversion of ISO-8859-1 bytes to chars
- Transaction read write attributes on service
- Read only commands on AbstractImapFolder
- Imap aspect properties must be managed as SYSTEM user
- Restored persistence of new mail messages
- Avoid unit test txn rollback woes by making it possible to check for existence of a path with FileFolderService
30487: ALF-10268: Merged V3.4-BUG-FIX to PATCHES/V3.4.4
30264: ALF-10187: Merged V3.3 to V3.4-BUG-FIX
30003: ALF-9898: More defensive exception handling to avoid packet pool leaks and extra logging on packet pool exhaustion
30540: ALF-10257: Fixed logic error introduced into Greenmail ImapRequestLineReader
30988: ALF-9361: Merged DEV/DAVEW/IMAP_NEW to PATCHES/V3.4.4 (by Arseny)
30419: Remote test for generic client request sequence.
30547: 1. A bug with FetchCommand particularly with FETCH (BODY.PEEK[1]) with an error
1315912197.789640 1.5 NO FETCH failed. java.lang.String cannot be cast to javax.mail.internet.MimeMultipart
This happened while message content is being proceeded like MimeMultipart mp = (MimeMultipart) mimeMessage.getContent();, but javadoc of mimeMessage.getContent() says that this content can be a String in case of non-multipart message. Fixed FetchCommand accordingly to mimeMessage.getContent() javadoc.
2. A bug with RFC822MetadataExtracter
When mimeMessage.getHeader("received"); is used with the message with following header
Received: with ECARTIS (v1.0.0; list dovecot); Tue, 06 Aug 2002 13:01:17 +0300 (EEST)
It doesn't extract a date, because it uses lastReceived.indexOf(';') which returns the position IN the ECARTIS (v1.0.0; list dovecot) after v1.0.0,
So it should use lastReceived.lastIndexOf(';') to get the position after ECARTIS (v1.0.0; list dovecot).
31025: ALF-9361: IMAP Performance
- Introduced folder status MRU cache
- Keyed by user ID and change token so no need to cluster
- Now means we should get reuse across IMAP sessions
- Also fixed isMarked() implementation to only return true if there are recent or unseen mails
31038: ALF-9361: Prevent the starting of unnecessary transactions in AlfrescoImapFolder interface
- getFolderStatus regulates its own transaction
- Dropped all those *Internal methods from the abstract class
- getUnqualifiedMailboxPattern moved to AlfrescoImapHostManager
- Fixes to session folder cache validation / reuse
31039: ALF-9361: Repository tuning for IMAP performance
- Backed out ALF-5575 60 second timeout on node caches - Should be covered by ALF-8607 fix
- Also made TransactionalCache.NewCacheBucket save new values to the shared cache for 'mutable' caches. Previously it was only possibly to load into the node caches in a read only transaction!
- Also added fix to make AbstractNodeDAOImpl bulk load empty node aspect sets
- Result is a drastic speedup of full sync times as most items can be served from the cache`
31042: ALF-9361: Fix ImapServiceImplTest
31048: ALF-9361: Make ConcurrentNodeServiceTest work again, after relaxation of 'mutable' transactional caches
- aspect and property caches validated by node transaction ID, as per parent assocs in ALF-8607
31050: ALF-9361: Caching correction
Always use the cached mailbox reference if it is equivalent (because the session remembers the last selected mailbox)
31060: ALF-9361: Fix CacheTest, following back out of ALF-5575 behaviour
31061: ALF-9361: More caching fixes
31062: ALF-9361: Undo accidental changes to ConcurrentNodeServiceTest
31063: ALF-9361: Build fix: replaced assertSame with assertEquals
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@31079 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
30458: ALF-10100: need to be able to apply %age or abs disk space usage constraints on ${dir.cachedcontent}
30573: ALF-9613: Add min age of files checking to cached content cleaner
30594: ALF-10100: added more sensible default in sample config for quota size (4GB)
30695: ALF-10391, ALF-10392: Added MBeans and improved logging for monitoring purposes.
30850: THOR-202: CachingContentStore quota manager should reject large files
30901: Added warn-level logging about failure to cache content item
30951: THOR-217 - when the quota is met or exceeded, then next time the cleaner runs it must use some strategy to make some space.
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@30956 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
30744: ALF-9524: WCM: Defining a complex type with 'abstract' attribute to true does not allow other complex types to define elements with the same name
- Fix by Pavel
30804: ALF-9524: Fix to NPE by Pavel
30812: ALF-718: Rules Fire Emails before Transaction Commit/Rollback
Added tests and moved email sending into a post commit callback.
30820: Fix for ALF-10516 - 'My Sites' dashlet should indicate it is loading rather than say 'No sites'
30824: Fixed ALF-10470: DeclaritiveRegistry is looping continuously and re-initializing
- Only replicate removals for the cache. The reset always does a remove first.
<cache
name="org.alfresco.cache.webScriptsRegistryCache"
...
replicateUpdates = false,
...
</cache>
30827: ALF-10513 60k Site Performance: Unable to delete user + request not acknowledged for 2 minutes
Now about 3 to 4 seconds
30828: Andy H recommended change to lucene indexer values
30831: ALF-718: Fix for InvitationServiceImplTest
Fixes behaviour broken by original fix for ALF-718: the send-after-commit does NOT work for the invitation service, so it was necessary
to change the code to only send-after-commit in the context of a rule.
30843: Fixed ALF-7698 "Defects in tags picker in SHARE." according to feedback provided in ALF-9953 "Decide order where new items shall appear in the object finder."
30844: ALF-9544 - Inbound email restricts file name to 86 characters or less.
used QName.createQNameWithValidLocalName() as suggested.
added new EmailServiceImplTest
30849: Fixed ALF-8776 "Rule details dialog handling of apostrophes"
30862: Merged DEV/TEMPORARY to V3.4-BUG-FIX (with improvements)
30856: ALF-10288: Regression of ALF-1997: non domain users cannot bypass SSO in Share using /share/page?pt=login
In SSOAuthenticationFilter.doFilter() method added check (PAGE_SERVLET_PATH.equals(req.getServletPath()) && LOGIN_PATH_INFORMATION.equals(req.getPathInfo()).
30864: SMTP Server, To and From address format.
- Out standards for from and to address were stuck in the 1980s!
30867: ALF-10517 - 'My Content' slow
- performance improvements by reworking Lucene queries used to retrieve recently modified and recently created content for a user
- converted queries to fts-alfresco
- improvements from 3.5sec per page render down to 1.1 secs
30874: MERGE DEV to V3.4-BUG-FIX
30851 : ALF-9558 - Unchecked Return Value
30882: - ScriptGroup.isRootGroup() now stops if it finds a single parent rather than doing a size on all parent groups.
Not sure the logic (not changed by me) is correct as it includes parents that are site groups.
- SiteServiceImpl now only gets the specified number of sites. Sometimes it would have return more if AuthorityDAOImpl
switched approach used to get containing authorities.
- Overloaded getContainingAuthorities to take a size parameter, deprecated other and switched calling code
Done for isRootGroup activity.
30910: - Fix build error
- Found a better way to use filter in AuthorityDAOImpl.getContainingAuthoritiesInZone
so that we don't need to reset the filter, by using the +ve hits from first approach
if we switch to second approach.
30925: - ALF-10501 60k Site Performance: Searching for a group to add to a site with a value that matches a few sites takes 2 minutes
ALF-10502 60k Site Performance: Admin Console | Groups: search with a value that matches a few sites takes 70 seconds
ALF-10504 60k Site Performance: Admin Console | Groups | Browse Groups page appears corrupt as it never finishes loading
- All the above were slow as a result of ScriptGroup.isRootGroup()
- ScriptGroup.isRootGroup() and ScriptGroup.isAdminGroup() removed - Checked with KevinR that these are not needed any more.
- Removed code added on 30 Sep 11 to support isRootGroup (the size parameter to AuthorityDAO.getContainingAuthorities)
git-svn-id: https://svn.alfresco.com/repos/alfresco-enterprise/alfresco/HEAD/root@30935 c4b6b30b-aa2e-2d43-bbcb-ca4b014f7261
