Difference between revisions of "Granule Acceptance"
From DocDataFlow
(Created page with "An important mechanism in Crawler is the granule acceptance by adapters. When a granule is presented to an adapter for processing, the adapter can accept or reject the granu...") |
|||
| Line 1: | Line 1: | ||
| − | An important mechanism in Crawler is the granule acceptance by adapters. | + | An important mechanism in Crawler is the idea of 'granule acceptance' by adapters. |
| − | When a granule is presented to | + | When a granule is presented to any adapter for processing, the adapter can accept or reject the granule based on a number of criteria. |
Some of these criteria are part of the default infrastructure of Crawler, and are checked automatically. However, these automatic criteria can always be overruled by a particular type of adapter or adapter network. | Some of these criteria are part of the default infrastructure of Crawler, and are checked automatically. However, these automatic criteria can always be overruled by a particular type of adapter or adapter network. | ||
Revision as of 22:38, 29 December 2013
An important mechanism in Crawler is the idea of 'granule acceptance' by adapters.
When a granule is presented to any adapter for processing, the adapter can accept or reject the granule based on a number of criteria.
Some of these criteria are part of the default infrastructure of Crawler, and are checked automatically. However, these automatic criteria can always be overruled by a particular type of adapter or adapter network.
The default criteria are only there for convenience: they will be 'the right thing' in most cases. They can be adjusted for the more uncommon cases where the acceptance criteria need to be different.
The first default criterium: granules are not normally accepted twice by the same adapter.
