DataStore garbage collection

Use garbage collection to remove any unused files in the Data Store. CRX supports the Jackrabbit data store, see http://wiki.apache.org/jackrabbit/DataStore. By default, CRX uses the FileDataStore, however the DbDataStore is also supported.

To run garbage collection:

• Log in as administrator
• In the CRX console, click Repository Configuration.
• Click Data Store Garbage Collection.
• Select one or more of the following options:

• Click Run.

Garbage Collection in a Clustered Environment

Shared Data Store

When using a CRX cluster, Data Store garbage collection can be run from any cluster node.

Cluster Data Store

When using the cluster data store (data store configuration option ClusterDataStore), run garbage collection on all cluster nodes separately.

Multi-Repository Data Store

If multiple distinct repositories use the same data store at the same time (such as author and publish instances), don't use the Delete option. Instead, the process is as follows:

• Back up your data store.
• Log in to CRX as administrator.
• Run data store garbage collection without any of the options checked (ensure that specially 'Delete unused items' is _not_ checked).
  
• Within five days, run it on _all_ repositories that share a data store. It is possible to set the delay to 0, however it increases the load on the file system. Also, running the process concurrently on all repositories is possible, but is increases the I/O on the file system that contains the data store. After this process finishes, the data store files have a new last modified date.
  
• If the process takes longer than five days, increase the day count when deleting (7 by default). Adobe recommends that you use a margin of two days.
• To list the files older than seven days using the following command line:
  find repository/datastore/* -mtime +7 -type f
• This command prints the number of bytes that can be saved:
  find repository/datastore/* -mtime +7 -type f -exec ls -l {} \; | awk '{ s+=$5 } END { print s }'
• Delete all files older than seven days using the following command line. WARNING: if the data store garbage collection was not run within the last days, it deletes files that are still needed.
  find repository/datastore/* -mtime +7 -type f -exec rm {} \;

Starting Garbage Collection within an Application

To run the garbage collection manually, use the following code:

GarbageCollector gc;

SessionImpl si = (SessionImpl)session;

gc = si.createDataStoreGarbageCollector();

// optional (if you want to implement a progress bar / output):

gc.setScanEventListener(this);

gc.scan();

gc.stopScan();


// could be a separate button, if multiple repositories use the same data store:

gc.deleteUnused();

Changes in Data Store Garbage Collection from CQ5.5 onwards(Applies to crx 2.3.15 or later)

From CQ 5.5 onwards the CRX that provides the repository is an OSGi service. The CRX is registered in the OSGi Service Registry as MBean service. This MBean is available in the JMX Console which exposes the datastore garbage collection attributes and operations.

• The ui to run datastore garbage collection is http://<host>:<port>/system/console/jmx/com.adobe.granite%3Atype%3DRepository
  
• The new ui has only one option "Delete unused items" which you can set to true or false based on the use case. A curl command example with option set to false is [1].
  
• The other options
  
  • "Run memory garbage collection first" is not part of datastore garbage collection ui and is available at http://<host>:<port>/system/console/memoryusage.
  • "Use a persistence manager scan" has been removed.
  • "Run memory garbage collection first" has been moved to http://<host>:<port>/system/console/memoryusage
  • The default time delay is set to 10.  For any change, modify a bean property dataStoreGarbageCollectionDelay. The curl command to set for 15 is shown at [2].

[1] curl -u admin:admin -X POST --data delete=false -H "Referer: http://<host>:<port>/system/console/jmx/com.adobe.granite%3Atype%3DRepository" http://<host>:<port>/system/console/jmx/com.adobe.granite%3Atype%3DRepository/op/runDataStoreGarbageCollection/java.lang.Boolean

[2] curl -u admin:admin -X POST --data value=15 -H "Referer: http://<host>:<port>/system/console/jmx/com.adobe.granite%3Atype%3DRepository" http://<host>:<port>/system/console/jmx/com.adobe.granite%3Atype%3DRepository/a/DataStoreGarbageCollectionDelay