org.apache.tez.mapreduce.examples.terasort

Class TeraValidate

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.tez.mapreduce.examples.terasort.TeraValidate

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class TeraValidate
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

Generate 1 mapper per a file that checks to make sure the keys are sorted within each file. The mapper also generates "$file:begin", first key and "$file:end", last key. The reduce verifies that all of the start/end items are in order. Any output from the reduce is problem report.

To run the program: bin/hadoop jar hadoop-*-examples.jar teravalidate out-dir report-dir

If there is any output, something is wrong and the output of the reduce will have the problem report.

Constructor Summary

Constructors

Constructor and Description
TeraValidate()

Method Summary

Methods

Modifier and Type	Method and Description
static void	main(String[] args)
int	run(String[] args)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

TeraValidate

public TeraValidate()

Method Detail

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Parameters:

args -

Throws:

Exception