org.apache.hadoop.chukwa.analysis.salsa.fsm

Class TaskTrackerClientTraceMapper

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

org.apache.hadoop.chukwa.analysis.salsa.fsm.TaskTrackerClientTraceMapper

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<ChukwaRecordKey,ChukwaRecord,ChukwaRecordKey,FSMIntermedEntry>

public class TaskTrackerClientTraceMapper
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Mapper<ChukwaRecordKey,ChukwaRecord,ChukwaRecordKey,FSMIntermedEntry>

Pluggable mapper for FSMBuilder K2 = State Name + State ID (We use ChukwaRecordKey since it would already have implemented a bunch of useful things such as Comparators etc.) V2 = TreeMap

Field Summary

Fields

Modifier and Type	Field and Description
protected int	DEFAULT_SHUFFLE_DURATION_MS
protected static String	FSM_CRK_ReduceType
protected static String	SEP

Constructor Summary

Constructors

Constructor and Description
TaskTrackerClientTraceMapper()

Method Summary

Methods

Modifier and Type	Method and Description
void	map(ChukwaRecordKey key, ChukwaRecord val, org.apache.hadoop.mapred.OutputCollector<ChukwaRecordKey,FSMIntermedEntry> output, org.apache.hadoop.mapred.Reporter reporter)
protected void	parseClientTraceDetailed(ChukwaRecordKey key, ChukwaRecord val, org.apache.hadoop.mapred.OutputCollector<ChukwaRecordKey,FSMIntermedEntry> output, org.apache.hadoop.mapred.Reporter reporter, ArrayList<String> fieldNamesList)

Methods inherited from class org.apache.hadoop.mapred.MapReduceBase

close, configure

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.mapred.JobConfigurable

configure

Methods inherited from interface java.io.Closeable

close

Field Detail

SEP

protected static final String SEP

See Also:

Constant Field Values

FSM_CRK_ReduceType

protected static String FSM_CRK_ReduceType

DEFAULT_SHUFFLE_DURATION_MS

protected final int DEFAULT_SHUFFLE_DURATION_MS

See Also:

Constant Field Values

Constructor Detail

TaskTrackerClientTraceMapper

public TaskTrackerClientTraceMapper()

Method Detail

map

public void map(ChukwaRecordKey key,
       ChukwaRecord val,
       org.apache.hadoop.mapred.OutputCollector<ChukwaRecordKey,FSMIntermedEntry> output,
       org.apache.hadoop.mapred.Reporter reporter)
         throws IOException

Specified by:

map in interface org.apache.hadoop.mapred.Mapper<ChukwaRecordKey,ChukwaRecord,ChukwaRecordKey,FSMIntermedEntry>

Throws:

IOException

parseClientTraceDetailed

protected void parseClientTraceDetailed(ChukwaRecordKey key,
                            ChukwaRecord val,
                            org.apache.hadoop.mapred.OutputCollector<ChukwaRecordKey,FSMIntermedEntry> output,
                            org.apache.hadoop.mapred.Reporter reporter,
                            ArrayList<String> fieldNamesList)
                                 throws IOException

Throws:

IOException