Difference between revisions of "Granule Acceptance"

From DocDataFlow
Jump to: navigation, search
(Created page with "An important mechanism in Crawler is the granule acceptance by adapters. When a granule is presented to an adapter for processing, the adapter can accept or reject the granu...")
 
Line 1: Line 1:
An important mechanism in Crawler is the granule acceptance by adapters.  
+
An important mechanism in Crawler is the idea of 'granule acceptance' by adapters.  
  
When a granule is presented to an adapter for processing, the adapter can accept or reject the granule based on a number of criteria.
+
When a granule is presented to any adapter for processing, the adapter can accept or reject the granule based on a number of criteria.
  
 
Some of these criteria are part of the default infrastructure of Crawler, and are checked automatically. However, these automatic criteria can always be overruled by a particular type of adapter or adapter network.  
 
Some of these criteria are part of the default infrastructure of Crawler, and are checked automatically. However, these automatic criteria can always be overruled by a particular type of adapter or adapter network.  

Revision as of 22:38, 29 December 2013

An important mechanism in Crawler is the idea of 'granule acceptance' by adapters.

When a granule is presented to any adapter for processing, the adapter can accept or reject the granule based on a number of criteria.

Some of these criteria are part of the default infrastructure of Crawler, and are checked automatically. However, these automatic criteria can always be overruled by a particular type of adapter or adapter network.

The default criteria are only there for convenience: they will be 'the right thing' in most cases. They can be adjusted for the more uncommon cases where the acceptance criteria need to be different.

The first default criterium: granules are not normally accepted twice by the same adapter.