Add-MapReduce
Note
This feature is only available in NCache Enterprise Edition.
Add-MapReduce cmdlet configures MapReduce tasks for processing and generating
large data sets with a parallel, distributed algorithm on a clustered cache.
This also queues any tasks if the server is busy. Task failure errors are logged
in the cache log after a specified limit of exceptions are avoided during task
execution.
Add-MapReduce [-CacheName] [-ChunkSize] [-MaxExceptions] [-MaxTasks] [-NoLogo] [-Password] [-Port] [-QueueSize] [-Server] [-UserId]
These properties are explained in detail in the Properties section.
Examples
- The following command configures MapReduce execution on demoCache with default options.
Add-MapReduce -CacheName demoCache
- The following command configures MapReduce on demoCache with 20 tasks to be executed in parallel with chunks of 100 elements each, 30 tasks to be enqueued and maximum 10 exceptions to be avoided.
Add-MapReduce demoCache -MaxTasks 10 -ChunkSize 100 -QueueSize 30 -MaxExceptions 10
Properties
Note: The parameters with asterisk (*) on their names are the required parameters and the rest are optional.
| Parameters | Data Types | Description | Default Value |
|---|---|---|---|
-CacheName* |
<String> |
Specifies the name of the cache for which MapReduce will be configured. | - |
-MaxTasks |
<Integer> |
Specifies the maximum number of tasks to be executed in parallel. | 0 (zero) |
-ChunkSize |
<Integer> |
Specifies the number of elements a chunk should contain before it is transmitted to combiner or reducer. | 0 (zero) |
-QueueSize |
<Integer> |
Specifies the maximum number of tasks that can be queued if the server is busy. | 0 (zero) |
-MaxExceptions |
<Integer> |
Specifies maximum avoidable exceptions while executing the task. | 0 (zero) |
-Server |
<String> |
Specifies a server name where the NCache service is running and a cache with the specified cache-name is registered. | IP of local machine |
-Port |
<Integer> |
Specifies the port on which NCache service is running. | 8250 |
-UserId |
<String> |
Specifies the user-id used to authorize the user for this operation. It is required in case security is enabled on Cache Server. This user-id must be the active directory user-id prefixed with the domain name. | - |
-Password |
<String> |
Specifies the password of the user that is used to authorize the user for this operation. It is required in case security is enabled on Cache Server. This password must be the same as the active directory user password. | - |
-NoLogo |
<SwitchParameter> |
Suppresses display of the logo banner. | - |