B C E F G H I J M N O P R S T U V W

B

BroadcastAndOneToOneExample - Class in org.apache.tez.mapreduce.examples

BroadcastAndOneToOneExample() - Constructor for class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample

BroadcastAndOneToOneExample.InputProcessor - Class in org.apache.tez.mapreduce.examples

BroadcastAndOneToOneExample.InputProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample.InputProcessor

BroadcastAndOneToOneExample.OneToOneProcessor - Class in org.apache.tez.mapreduce.examples

BroadcastAndOneToOneExample.OneToOneProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample.OneToOneProcessor

BYTES_PER_MAP - Static variable in class org.apache.tez.mapreduce.examples.RandomTextWriter

BYTES_PER_MAP - Static variable in class org.apache.tez.mapreduce.examples.RandomWriter

C

checkOutputSpecs(JobContext) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraOutputFormat

cleanup(Mapper<LongWritable, NullWritable, Text, Text>.Context) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraGen.SortGenMapper

close() - Method in class org.apache.tez.mapreduce.examples.processor.FilterByWordInputProcessor

close() - Method in class org.apache.tez.mapreduce.examples.processor.FilterByWordOutputProcessor

compare(byte[], int, int, byte[], int, int) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.FirstGroupingComparator

compare(SecondarySort.IntPair, SecondarySort.IntPair) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.FirstGroupingComparator

compare(byte[], int, int, byte[], int, int) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair.Comparator

compareTo(SecondarySort.IntPair) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

createDAG(FileSystem, Configuration, Path, int, int, int, int, long, int, long, int, long, int, boolean, boolean) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob

createDAG(FileSystem, Configuration, Map<String, LocalResource>, Path, int, String, String, boolean) - Method in class org.apache.tez.mapreduce.examples.TestOrderedWordCount

createJob(int, int, int, int, long, int, long, int, long, int) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob

createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepInputFormat

createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraInputFormat

E

equals(Object) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

ExampleDriver - Class in org.apache.tez.mapreduce.examples

A description of an example program based on its class and a human-readable description.

ExampleDriver() - Constructor for class org.apache.tez.mapreduce.examples.ExampleDriver

F

FILTER_PARAM_NAME - Static variable in class org.apache.tez.mapreduce.examples.FilterLinesByWord

FILTER_PARAM_NAME - Static variable in class org.apache.tez.mapreduce.examples.FilterLinesByWordOneToOne

FilterByWordInputProcessor - Class in org.apache.tez.mapreduce.examples.processor

FilterByWordInputProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.examples.processor.FilterByWordInputProcessor

FilterByWordOutputProcessor - Class in org.apache.tez.mapreduce.examples.processor

FilterByWordOutputProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.examples.processor.FilterByWordOutputProcessor

FilterLinesByWord - Class in org.apache.tez.mapreduce.examples

FilterLinesByWord(boolean) - Constructor for class org.apache.tez.mapreduce.examples.FilterLinesByWord

FilterLinesByWord.TextLongPair - Class in org.apache.tez.mapreduce.examples

FilterLinesByWord.TextLongPair() - Constructor for class org.apache.tez.mapreduce.examples.FilterLinesByWord.TextLongPair

FilterLinesByWord.TextLongPair(Text, LongWritable) - Constructor for class org.apache.tez.mapreduce.examples.FilterLinesByWord.TextLongPair

FilterLinesByWordOneToOne - Class in org.apache.tez.mapreduce.examples

FilterLinesByWordOneToOne() - Constructor for class org.apache.tez.mapreduce.examples.FilterLinesByWordOneToOne

G

GenSort - Class in org.apache.tez.mapreduce.examples.terasort

A single process data generator for the terasort data.

GenSort() - Constructor for class org.apache.tez.mapreduce.examples.terasort.GenSort

getConf() - Method in class org.apache.tez.mapreduce.examples.terasort.TeraSort.SimplePartitioner

getFinalSync(JobContext) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraOutputFormat

Does the user want a final sync at close?

getFirst() - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

getLength() - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.EmptySplit

getLocations() - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.EmptySplit

getOutputCommitter(TaskAttemptContext) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraOutputFormat

getOutputReplication(JobContext) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraSort

getPartition(IntWritable, IntWritable, int) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.MRRSleepJobPartitioner

getPartition(SecondarySort.IntPair, IntWritable, int) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.FirstPartitioner

getPartition(Text, Text, int) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraSort.SimplePartitioner

getRecordWriter(TaskAttemptContext) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraOutputFormat

getRemainingArgs() - Method in class org.apache.tez.mapreduce.examples.helpers.SplitsInClientOptionParser

getResult() - Method in class org.apache.tez.mapreduce.examples.Sort

Get the last job that was run using this instance.

getSecond() - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

getSplits(JobContext) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepInputFormat

getSplits(JobContext) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraInputFormat

getUseSimplePartitioner(JobContext) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraSort

GroupByOrderByMRRTest - Class in org.apache.tez.mapreduce.examples

Simple example that does a GROUP BY ORDER BY in an MRR job Consider a query such as Select DeptName, COUNT(*) as cnt FROM EmployeeTable GROUP BY DeptName ORDER BY cnt; i.e.

GroupByOrderByMRRTest() - Constructor for class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest

GroupByOrderByMRRTest.MyGroupByReducer - Class in org.apache.tez.mapreduce.examples

Intermediate reducer aggregates the total count per department.

GroupByOrderByMRRTest.MyGroupByReducer() - Constructor for class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest.MyGroupByReducer

GroupByOrderByMRRTest.MyMapper - Class in org.apache.tez.mapreduce.examples

Mapper takes in a single line as input containing employee name and department name and then emits department name with count of 1

GroupByOrderByMRRTest.MyMapper() - Constructor for class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest.MyMapper

GroupByOrderByMRRTest.MyOrderByNoOpReducer - Class in org.apache.tez.mapreduce.examples

Shuffle ensures ordering based on count of employees per department hence the final reducer is a no-op and just emits the department name with the employee count per department.

GroupByOrderByMRRTest.MyOrderByNoOpReducer() - Constructor for class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest.MyOrderByNoOpReducer

H

handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.examples.processor.FilterByWordInputProcessor

handleEvents(List<Event>) - Method in class org.apache.tez.mapreduce.examples.processor.FilterByWordOutputProcessor

hashCode() - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

I

initialize() - Method in class org.apache.tez.mapreduce.examples.processor.FilterByWordInputProcessor

IREDUCE_SLEEP_COUNT - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

IREDUCE_SLEEP_TIME - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

IREDUCE_STAGES_COUNT - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

IREDUCE_TASKS_COUNT - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

J

Join - Class in org.apache.tez.mapreduce.examples

Given a set of sorted datasets keyed with the same class and yielding equal partitions, it is possible to effect a join of those datasets prior to the map.

Join() - Constructor for class org.apache.tez.mapreduce.examples.Join

M

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.ExampleDriver

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.FilterLinesByWord

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.FilterLinesByWordOneToOne

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.Join

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.MapredWordCount

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.MRRSleepJob

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.RandomTextWriter

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.RandomWriter

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.RPCLoadGen

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.SecondarySort

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.Sort

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.terasort.GenSort

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraChecksum

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraGen

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraSort

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraValidate

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.TestOrderedWordCount

main(String[]) - Static method in class org.apache.tez.mapreduce.examples.UnionExample

makeSplit(Path, long, long, String[]) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraInputFormat

map(Object, Text, Mapper<Object, Text, Text, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest.MyMapper

map(LongWritable, Text, OutputCollector<Text, IntWritable>, Reporter) - Method in class org.apache.tez.mapreduce.examples.MapredWordCount.MapClass

map(IntWritable, IntWritable, Mapper<IntWritable, IntWritable, IntWritable, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepMapper

map(LongWritable, Text, Mapper<LongWritable, Text, SecondarySort.IntPair, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.MapClass

map(LongWritable, NullWritable, Mapper<LongWritable, NullWritable, Text, Text>.Context) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraGen.SortGenMapper

map(Object, Text, Mapper<Object, Text, Text, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.TestOrderedWordCount.TokenizerMapper

MAP_ERROR_TASK_IDS - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

MAP_FATAL_ERROR - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

MAP_SLEEP_COUNT - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

MAP_SLEEP_TIME - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

MAP_THROW_ERROR - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

MapredWordCount - Class in org.apache.tez.mapreduce.examples

This is an example Hadoop Map/Reduce application using the mapred apis.

MapredWordCount() - Constructor for class org.apache.tez.mapreduce.examples.MapredWordCount

MapredWordCount.MapClass - Class in org.apache.tez.mapreduce.examples

Counts the words in each line.

MapredWordCount.MapClass() - Constructor for class org.apache.tez.mapreduce.examples.MapredWordCount.MapClass

MapredWordCount.Reduce - Class in org.apache.tez.mapreduce.examples

A reducer class that just emits the sum of the input values.

MapredWordCount.Reduce() - Constructor for class org.apache.tez.mapreduce.examples.MapredWordCount.Reduce

MAPS_PER_HOST - Static variable in class org.apache.tez.mapreduce.examples.RandomTextWriter

MAPS_PER_HOST - Static variable in class org.apache.tez.mapreduce.examples.RandomWriter

MAX_KEY - Static variable in class org.apache.tez.mapreduce.examples.RandomTextWriter

MAX_KEY - Static variable in class org.apache.tez.mapreduce.examples.RandomWriter

MAX_VALUE - Static variable in class org.apache.tez.mapreduce.examples.RandomTextWriter

MAX_VALUE - Static variable in class org.apache.tez.mapreduce.examples.RandomWriter

MIN_KEY - Static variable in class org.apache.tez.mapreduce.examples.RandomTextWriter

MIN_KEY - Static variable in class org.apache.tez.mapreduce.examples.RandomWriter

MIN_VALUE - Static variable in class org.apache.tez.mapreduce.examples.RandomTextWriter

MIN_VALUE - Static variable in class org.apache.tez.mapreduce.examples.RandomWriter

MRRSleepJob - Class in org.apache.tez.mapreduce.examples

Dummy class for testing MR framefork.

MRRSleepJob() - Constructor for class org.apache.tez.mapreduce.examples.MRRSleepJob

MRRSleepJob.EmptySplit - Class in org.apache.tez.mapreduce.examples

MRRSleepJob.EmptySplit() - Constructor for class org.apache.tez.mapreduce.examples.MRRSleepJob.EmptySplit

MRRSleepJob.ISleepReducer - Class in org.apache.tez.mapreduce.examples

MRRSleepJob.ISleepReducer() - Constructor for class org.apache.tez.mapreduce.examples.MRRSleepJob.ISleepReducer

MRRSleepJob.MRRSleepJobPartitioner - Class in org.apache.tez.mapreduce.examples

MRRSleepJob.MRRSleepJobPartitioner() - Constructor for class org.apache.tez.mapreduce.examples.MRRSleepJob.MRRSleepJobPartitioner

MRRSleepJob.SleepInputFormat - Class in org.apache.tez.mapreduce.examples

MRRSleepJob.SleepInputFormat() - Constructor for class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepInputFormat

MRRSleepJob.SleepMapper - Class in org.apache.tez.mapreduce.examples

MRRSleepJob.SleepMapper() - Constructor for class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepMapper

MRRSleepJob.SleepReducer - Class in org.apache.tez.mapreduce.examples

MRRSleepJob.SleepReducer() - Constructor for class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepReducer

N

NUM_ROWS - Static variable in class org.apache.tez.mapreduce.examples.terasort.TeraGen

O

org.apache.tez.mapreduce.examples - package org.apache.tez.mapreduce.examples

org.apache.tez.mapreduce.examples.helpers - package org.apache.tez.mapreduce.examples.helpers

org.apache.tez.mapreduce.examples.processor - package org.apache.tez.mapreduce.examples.processor

org.apache.tez.mapreduce.examples.terasort - package org.apache.tez.mapreduce.examples.terasort

outputRecords(OutputStream, boolean, Unsigned16, Unsigned16, Unsigned16) - Static method in class org.apache.tez.mapreduce.examples.terasort.GenSort

P

parse(String[], boolean) - Method in class org.apache.tez.mapreduce.examples.helpers.SplitsInClientOptionParser

printDAGStatus(DAGClient, String[]) - Static method in class org.apache.tez.mapreduce.examples.ExampleDriver

printDAGStatus(DAGClient, String[], boolean, boolean) - Static method in class org.apache.tez.mapreduce.examples.ExampleDriver

printUsage() - Method in class org.apache.tez.mapreduce.examples.RPCLoadGen

printUsage() - Method in class org.apache.tez.mapreduce.examples.TezExampleBase

Print usage instructions for this example

R

RandomTextWriter - Class in org.apache.tez.mapreduce.examples

This program uses map/reduce to just run a distributed job where there is no interaction between the tasks and each task writes a large unsorted random sequence of words.

RandomTextWriter() - Constructor for class org.apache.tez.mapreduce.examples.RandomTextWriter

RandomWriter - Class in org.apache.tez.mapreduce.examples

This program uses map/reduce to just run a distributed job where there is no interaction between the tasks and each task write a large unsorted random binary sequence file of BytesWritable.

RandomWriter() - Constructor for class org.apache.tez.mapreduce.examples.RandomWriter

readFields(DataInput) - Method in class org.apache.tez.mapreduce.examples.FilterLinesByWord.TextLongPair

readFields(DataInput) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.EmptySplit

readFields(DataInput) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

Read the two integers.

reduce(Text, Iterable<IntWritable>, Reducer<Text, IntWritable, IntWritable, Text>.Context) - Method in class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest.MyGroupByReducer

reduce(IntWritable, Iterable<Text>, Reducer<IntWritable, Text, Text, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest.MyOrderByNoOpReducer

reduce(Text, Iterator<IntWritable>, OutputCollector<Text, IntWritable>, Reporter) - Method in class org.apache.tez.mapreduce.examples.MapredWordCount.Reduce

reduce(IntWritable, Iterable<IntWritable>, Reducer<IntWritable, IntWritable, IntWritable, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.ISleepReducer

reduce(IntWritable, Iterable<IntWritable>, Reducer<IntWritable, IntWritable, NullWritable, NullWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepReducer

reduce(SecondarySort.IntPair, Iterable<IntWritable>, Reducer<SecondarySort.IntPair, IntWritable, Text, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.Reduce

reduce(Text, Iterable<IntWritable>, Reducer<Text, IntWritable, IntWritable, Text>.Context) - Method in class org.apache.tez.mapreduce.examples.TestOrderedWordCount.IntSumReducer

reduce(IntWritable, Iterable<Text>, Reducer<IntWritable, Text, Text, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.TestOrderedWordCount.MyOrderByNoOpReducer

REDUCE_SLEEP_COUNT - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

REDUCE_SLEEP_TIME - Static variable in class org.apache.tez.mapreduce.examples.MRRSleepJob

REDUCES_PER_HOST - Static variable in class org.apache.tez.mapreduce.examples.Join

REDUCES_PER_HOST - Static variable in class org.apache.tez.mapreduce.examples.Sort

RPCLoadGen - Class in org.apache.tez.mapreduce.examples

RPCLoadGen() - Constructor for class org.apache.tez.mapreduce.examples.RPCLoadGen

RPCLoadGen.RPCSleepProcessor - Class in org.apache.tez.mapreduce.examples

RPCLoadGen.RPCSleepProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.examples.RPCLoadGen.RPCSleepProcessor

run() - Method in class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample.InputProcessor

run() - Method in class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample.OneToOneProcessor

run(Configuration, boolean) - Method in class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample

run(String[]) - Method in class org.apache.tez.mapreduce.examples.BroadcastAndOneToOneExample

run(String[]) - Method in class org.apache.tez.mapreduce.examples.FilterLinesByWord

run(String[]) - Method in class org.apache.tez.mapreduce.examples.FilterLinesByWordOneToOne

run(String[]) - Method in class org.apache.tez.mapreduce.examples.GroupByOrderByMRRTest

run(String[]) - Method in class org.apache.tez.mapreduce.examples.Join

The main driver for sort program.

run(String[]) - Method in class org.apache.tez.mapreduce.examples.MapredWordCount

The main driver for word count map/reduce program.

run(String[]) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob

run(Map<String, LogicalInput>, Map<String, LogicalOutput>) - Method in class org.apache.tez.mapreduce.examples.processor.FilterByWordInputProcessor

run() - Method in class org.apache.tez.mapreduce.examples.processor.FilterByWordOutputProcessor

run(String[]) - Method in class org.apache.tez.mapreduce.examples.RandomTextWriter

This is the main routine for launching a distributed random write job.

run(String[]) - Method in class org.apache.tez.mapreduce.examples.RandomWriter

This is the main routine for launching a distributed random write job.

run() - Method in class org.apache.tez.mapreduce.examples.RPCLoadGen.RPCSleepProcessor

run(String[]) - Method in class org.apache.tez.mapreduce.examples.SecondarySort

run(String[]) - Method in class org.apache.tez.mapreduce.examples.Sort

The main driver for sort program.

run(String[]) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraChecksum

run(String[]) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraGen

run(String[]) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraSort

run(String[]) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraValidate

run(String[]) - Method in class org.apache.tez.mapreduce.examples.TestOrderedWordCount

run(String[]) - Method in class org.apache.tez.mapreduce.examples.TezExampleBase

run(TezConfiguration, String[], TezClient) - Method in class org.apache.tez.mapreduce.examples.TezExampleBase

Utility method to use the example from within code or a test.

run(String, String, Configuration) - Method in class org.apache.tez.mapreduce.examples.UnionExample

run() - Method in class org.apache.tez.mapreduce.examples.UnionExample.TokenProcessor

run() - Method in class org.apache.tez.mapreduce.examples.UnionExample.UnionProcessor

runDag(DAG, boolean, Log) - Method in class org.apache.tez.mapreduce.examples.TezExampleBase

runJob(String[], TezConfiguration, TezClient) - Method in class org.apache.tez.mapreduce.examples.RPCLoadGen

runJob(String[], TezConfiguration, TezClient) - Method in class org.apache.tez.mapreduce.examples.TezExampleBase

Create and execute the actual DAG for the example

S

SecondarySort - Class in org.apache.tez.mapreduce.examples

This is an example Hadoop Map/Reduce application.

SecondarySort() - Constructor for class org.apache.tez.mapreduce.examples.SecondarySort

SecondarySort.FirstGroupingComparator - Class in org.apache.tez.mapreduce.examples

Compare only the first part of the pair, so that reduce is called once for each value of the first part.

SecondarySort.FirstGroupingComparator() - Constructor for class org.apache.tez.mapreduce.examples.SecondarySort.FirstGroupingComparator

SecondarySort.FirstPartitioner - Class in org.apache.tez.mapreduce.examples

Partition based on the first part of the pair.

SecondarySort.FirstPartitioner() - Constructor for class org.apache.tez.mapreduce.examples.SecondarySort.FirstPartitioner

SecondarySort.IntPair - Class in org.apache.tez.mapreduce.examples

Define a pair of integers that are writable.

SecondarySort.IntPair() - Constructor for class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

SecondarySort.IntPair.Comparator - Class in org.apache.tez.mapreduce.examples

A Comparator that compares serialized IntPair.

SecondarySort.IntPair.Comparator() - Constructor for class org.apache.tez.mapreduce.examples.SecondarySort.IntPair.Comparator

SecondarySort.MapClass - Class in org.apache.tez.mapreduce.examples

Read two integers from each line and generate a key, value pair as ((left, right), right).

SecondarySort.MapClass() - Constructor for class org.apache.tez.mapreduce.examples.SecondarySort.MapClass

SecondarySort.Reduce - Class in org.apache.tez.mapreduce.examples

A reducer class that just emits the sum of the input values.

SecondarySort.Reduce() - Constructor for class org.apache.tez.mapreduce.examples.SecondarySort.Reduce

set(int, int) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

Set the left and right values.

setConf(Configuration) - Method in class org.apache.tez.mapreduce.examples.terasort.TeraSort.SimplePartitioner

setOutputReplication(Job, int) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraSort

setup(Reducer<IntWritable, IntWritable, IntWritable, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.ISleepReducer

setup(Mapper<IntWritable, IntWritable, IntWritable, IntWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepMapper

setup(Reducer<IntWritable, IntWritable, NullWritable, NullWritable>.Context) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.SleepReducer

setUseSimplePartitioner(Job, boolean) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraSort

Sort<K,V> - Class in org.apache.tez.mapreduce.examples

This is the trivial map/reduce program that does absolutely nothing other than use the framework to fragment and sort the input values.

Sort() - Constructor for class org.apache.tez.mapreduce.examples.Sort

SplitsInClientOptionParser - Class in org.apache.tez.mapreduce.examples.helpers

SplitsInClientOptionParser() - Constructor for class org.apache.tez.mapreduce.examples.helpers.SplitsInClientOptionParser

T

TeraChecksum - Class in org.apache.tez.mapreduce.examples.terasort

TeraChecksum() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraChecksum

TeraGen - Class in org.apache.tez.mapreduce.examples.terasort

Generate the official GraySort input data set.

TeraGen() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraGen

TeraGen.Counters - Enum in org.apache.tez.mapreduce.examples.terasort

TeraGen.SortGenMapper - Class in org.apache.tez.mapreduce.examples.terasort

The Mapper class that given a row number, will generate the appropriate output line.

TeraGen.SortGenMapper() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraGen.SortGenMapper

TeraInputFormat - Class in org.apache.tez.mapreduce.examples.terasort

An input format that reads the first 10 characters of each line as the key and the rest of the line as the value.

TeraInputFormat() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraInputFormat

TeraOutputFormat - Class in org.apache.tez.mapreduce.examples.terasort

An output format that writes the key and value appended together.

TeraOutputFormat() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraOutputFormat

TeraSort - Class in org.apache.tez.mapreduce.examples.terasort

Generates the sampled split points, launches the job, and waits for it to finish.

TeraSort() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraSort

TeraSort.SimplePartitioner - Class in org.apache.tez.mapreduce.examples.terasort

A total order partitioner that assigns keys based on their first PREFIX_LENGTH bytes, assuming a flat distribution.

TeraSort.SimplePartitioner() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraSort.SimplePartitioner

TeraValidate - Class in org.apache.tez.mapreduce.examples.terasort

Generate 1 mapper per a file that checks to make sure the keys are sorted within each file.

TeraValidate() - Constructor for class org.apache.tez.mapreduce.examples.terasort.TeraValidate

TestOrderedWordCount - Class in org.apache.tez.mapreduce.examples

An MRR job built on top of word count to return words sorted by their frequency of occurrence.

TestOrderedWordCount() - Constructor for class org.apache.tez.mapreduce.examples.TestOrderedWordCount

TestOrderedWordCount.IntSumReducer - Class in org.apache.tez.mapreduce.examples

TestOrderedWordCount.IntSumReducer() - Constructor for class org.apache.tez.mapreduce.examples.TestOrderedWordCount.IntSumReducer

TestOrderedWordCount.MyOrderByNoOpReducer - Class in org.apache.tez.mapreduce.examples

Shuffle ensures ordering based on count of employees per department hence the final reducer is a no-op and just emits the department name with the employee count per department.

TestOrderedWordCount.MyOrderByNoOpReducer() - Constructor for class org.apache.tez.mapreduce.examples.TestOrderedWordCount.MyOrderByNoOpReducer

TestOrderedWordCount.TokenizerMapper - Class in org.apache.tez.mapreduce.examples

TestOrderedWordCount.TokenizerMapper() - Constructor for class org.apache.tez.mapreduce.examples.TestOrderedWordCount.TokenizerMapper

TezExampleBase - Class in org.apache.tez.mapreduce.examples

TezExampleBase() - Constructor for class org.apache.tez.mapreduce.examples.TezExampleBase

toString() - Method in class org.apache.tez.mapreduce.examples.FilterLinesByWord.TextLongPair

TOTAL_BYTES - Static variable in class org.apache.tez.mapreduce.examples.RandomTextWriter

TOTAL_BYTES - Static variable in class org.apache.tez.mapreduce.examples.RandomWriter

U

UnionExample - Class in org.apache.tez.mapreduce.examples

UnionExample() - Constructor for class org.apache.tez.mapreduce.examples.UnionExample

UnionExample.TokenProcessor - Class in org.apache.tez.mapreduce.examples

UnionExample.TokenProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.examples.UnionExample.TokenProcessor

UnionExample.UnionProcessor - Class in org.apache.tez.mapreduce.examples

UnionExample.UnionProcessor(ProcessorContext) - Constructor for class org.apache.tez.mapreduce.examples.UnionExample.UnionProcessor

V

validateArgs(String[]) - Method in class org.apache.tez.mapreduce.examples.RPCLoadGen

validateArgs(String[]) - Method in class org.apache.tez.mapreduce.examples.TezExampleBase

Validate the arguments

valueOf(String) - Static method in enum org.apache.tez.mapreduce.examples.terasort.TeraGen.Counters

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.tez.mapreduce.examples.terasort.TeraGen.Counters

Returns an array containing the constants of this enum type, in the order they are declared.

W

write(DataOutput) - Method in class org.apache.tez.mapreduce.examples.FilterLinesByWord.TextLongPair

write(DataOutput) - Method in class org.apache.tez.mapreduce.examples.MRRSleepJob.EmptySplit

write(DataOutput) - Method in class org.apache.tez.mapreduce.examples.SecondarySort.IntPair

writePartitionFile(JobContext, Path) - Static method in class org.apache.tez.mapreduce.examples.terasort.TeraInputFormat

Use the input splits to take samples of the input and generate sample keys.

B C E F G H I J M N O P R S T U V W