org.apache.tez.common.counters
Enum TaskCounter

java.lang.Object
  java.lang.Enum<TaskCounter>
      org.apache.tez.common.counters.TaskCounter

All Implemented Interfaces:

Serializable, Comparable<TaskCounter>

@InterfaceAudience.Private
public enum TaskCounter
extends Enum<TaskCounter>

Enum Constant Summary

ADDITIONAL_SPILL_COUNT
Actual number of unnecessary spills.

ADDITIONAL_SPILLS_BYTES_READ
Bytes read from disk due to previous spills (lac of adequate memory).

ADDITIONAL_SPILLS_BYTES_WRITTEN
Bytes written to disk due to unnecessary spills (lac of adequate memory).

COMBINE_INPUT_RECORDS

COMBINE_OUTPUT_RECORDS

COMMITTED_HEAP_BYTES

CPU_MILLISECONDS

GC_TIME_MILLIS

INPUT_GROUPS

INPUT_RECORDS_PROCESSED
Represents the number of Input Records that were actually processed.

MERGED_MAP_OUTPUTS

NUM_DISK_TO_DISK_MERGES
Number of disk to disk merges performed during the sort-merge

NUM_FAILED_SHUFFLE_INPUTS
Number of failed copy attempts (physical inputs)

NUM_MEM_TO_DISK_MERGES
Number of Memory to Disk merges performed during sort-merge.

NUM_SHUFFLED_INPUTS
Number of Inputs from which data is copied.

NUM_SKIPPED_INPUTS
Number of Inputs from which data was not copied - typically due to an empty Input

OUTPUT_BYTES
Represents the serialized output size (uncompressed) of data being written.

OUTPUT_BYTES_PHYSICAL
Represents the actual physical size of the Output generated.

OUTPUT_BYTES_WITH_OVERHEAD
Represents serialized output size (uncompressed) along with any overhead added by the format being used.

OUTPUT_RECORDS
Represents the number of actual output records.

PHYSICAL_MEMORY_BYTES

REDUCE_INPUT_GROUPS
Number of Input Groups seen by ShuffledMergedInput.

REDUCE_INPUT_RECORDS
Number of records (across all Groups) seen by ShuffledMergedInput Alternately number of records seen by a ReduceProcessor

REDUCE_OUTPUT_RECORDS

REDUCE_SKIPPED_GROUPS

REDUCE_SKIPPED_RECORDS

SHUFFLE_BYTES
Amount of physical data moved over the wire.

SHUFFLE_BYTES_DECOMPRESSED
Uncompressed size of the data being processed by the relevant Shuffle.

SHUFFLE_BYTES_TO_DISK
Number of bytes which were shuffled directly to disk

SHUFFLE_BYTES_TO_MEM
Number of bytes which were shuffled directly to memory.

SKIPPED_RECORDS

SPILLED_RECORDS
Number of records written to disk in case of OnFileSortedOutput.

SPLIT_RAW_BYTES

VIRTUAL_MEMORY_BYTES

Method Summary

static TaskCounter	valueOf(String name) Returns the enum constant of this type with the specified name.
static TaskCounter[]	values() Returns an array containing the constants of this enum type, in the order they are declared.

Methods inherited from class java.lang.Enum

clone, compareTo, equals, finalize, getDeclaringClass, hashCode, name, ordinal, toString, valueOf

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Enum Constant Detail

REDUCE_INPUT_GROUPS

public static final TaskCounter REDUCE_INPUT_GROUPS

Number of Input Groups seen by ShuffledMergedInput. Alternately the number of Input Groups seen by a Reduce task.

REDUCE_INPUT_RECORDS

public static final TaskCounter REDUCE_INPUT_RECORDS

Number of records (across all Groups) seen by ShuffledMergedInput Alternately number of records seen by a ReduceProcessor

REDUCE_OUTPUT_RECORDS

public static final TaskCounter REDUCE_OUTPUT_RECORDS

REDUCE_SKIPPED_GROUPS

public static final TaskCounter REDUCE_SKIPPED_GROUPS

REDUCE_SKIPPED_RECORDS

public static final TaskCounter REDUCE_SKIPPED_RECORDS

SPLIT_RAW_BYTES

public static final TaskCounter SPLIT_RAW_BYTES

COMBINE_INPUT_RECORDS

public static final TaskCounter COMBINE_INPUT_RECORDS

COMBINE_OUTPUT_RECORDS

public static final TaskCounter COMBINE_OUTPUT_RECORDS

SPILLED_RECORDS

public static final TaskCounter SPILLED_RECORDS

Number of records written to disk in case of OnFileSortedOutput. Number of additional records writtent out to disk in case of ShuffledMergedInput; this represents the number of unnecessary spills to disk caused by lac of memory.

NUM_SHUFFLED_INPUTS

public static final TaskCounter NUM_SHUFFLED_INPUTS

Number of Inputs from which data is copied. Represents physical Inputs.

NUM_SKIPPED_INPUTS

public static final TaskCounter NUM_SKIPPED_INPUTS

Number of Inputs from which data was not copied - typically due to an empty Input

NUM_FAILED_SHUFFLE_INPUTS

public static final TaskCounter NUM_FAILED_SHUFFLE_INPUTS

Number of failed copy attempts (physical inputs)

MERGED_MAP_OUTPUTS

public static final TaskCounter MERGED_MAP_OUTPUTS

GC_TIME_MILLIS

public static final TaskCounter GC_TIME_MILLIS

CPU_MILLISECONDS

public static final TaskCounter CPU_MILLISECONDS

PHYSICAL_MEMORY_BYTES

public static final TaskCounter PHYSICAL_MEMORY_BYTES

VIRTUAL_MEMORY_BYTES

public static final TaskCounter VIRTUAL_MEMORY_BYTES

COMMITTED_HEAP_BYTES

public static final TaskCounter COMMITTED_HEAP_BYTES

INPUT_RECORDS_PROCESSED

public static final TaskCounter INPUT_RECORDS_PROCESSED

Represents the number of Input Records that were actually processed. Used by MRInput and ShuffledUnorderedKVInput

OUTPUT_RECORDS

public static final TaskCounter OUTPUT_RECORDS

Represents the number of actual output records. Used by MROutput, OnFileSortedOutput, and OnFileUnorderedKVOutput

SKIPPED_RECORDS

public static final TaskCounter SKIPPED_RECORDS

OUTPUT_BYTES

public static final TaskCounter OUTPUT_BYTES

Represents the serialized output size (uncompressed) of data being written.

OUTPUT_BYTES_WITH_OVERHEAD

public static final TaskCounter OUTPUT_BYTES_WITH_OVERHEAD

Represents serialized output size (uncompressed) along with any overhead added by the format being used.

OUTPUT_BYTES_PHYSICAL

public static final TaskCounter OUTPUT_BYTES_PHYSICAL

Represents the actual physical size of the Output generated. This factors in Compression if it is enabled. (Will include actual serialized output size + overhead)

ADDITIONAL_SPILLS_BYTES_WRITTEN

public static final TaskCounter ADDITIONAL_SPILLS_BYTES_WRITTEN

Bytes written to disk due to unnecessary spills (lac of adequate memory). Used by OnFileSortedOutput and ShuffledMergedInput

ADDITIONAL_SPILLS_BYTES_READ

public static final TaskCounter ADDITIONAL_SPILLS_BYTES_READ

Bytes read from disk due to previous spills (lac of adequate memory). Used by OnFileSortedOutput and ShuffledMergedInput

ADDITIONAL_SPILL_COUNT

public static final TaskCounter ADDITIONAL_SPILL_COUNT

Actual number of unnecessary spills. (lac of adequate memory) Used by OnFileSortedOutput

INPUT_GROUPS

public static final TaskCounter INPUT_GROUPS

SHUFFLE_BYTES

public static final TaskCounter SHUFFLE_BYTES

Amount of physical data moved over the wire. Used by Shuffled*Input. Should be a combination of SHUFFLE_BYTES_TO_MEM and SHUFFLE_BYTES_TO_DISK

SHUFFLE_BYTES_DECOMPRESSED

public static final TaskCounter SHUFFLE_BYTES_DECOMPRESSED

Uncompressed size of the data being processed by the relevant Shuffle. Includes serialization, file format etc overheads.

SHUFFLE_BYTES_TO_MEM

public static final TaskCounter SHUFFLE_BYTES_TO_MEM

Number of bytes which were shuffled directly to memory.

SHUFFLE_BYTES_TO_DISK

public static final TaskCounter SHUFFLE_BYTES_TO_DISK

Number of bytes which were shuffled directly to disk

NUM_MEM_TO_DISK_MERGES

public static final TaskCounter NUM_MEM_TO_DISK_MERGES

Number of Memory to Disk merges performed during sort-merge. Used by ShuffledMergedInput

NUM_DISK_TO_DISK_MERGES

public static final TaskCounter NUM_DISK_TO_DISK_MERGES

Number of disk to disk merges performed during the sort-merge

Method Detail

values

public static TaskCounter[] values()

Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows:

for (TaskCounter c : TaskCounter.values())
    System.out.println(c);

Returns:

an array containing the constants of this enum type, in the order they are declared

valueOf

public static TaskCounter valueOf(String name)

Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)

Parameters:

name - the name of the enum constant to be returned.

Returns:

the enum constant with the specified name

Throws:

IllegalArgumentException - if this enum type has no constant with the specified name

NullPointerException - if the argument is null