org.apache.hadoop.chukwa.analysis.salsa.fsm

Class FSMBuilder.FSMReducer

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder.FSMReducer

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Reducer<ChukwaRecordKey,FSMIntermedEntry,ChukwaRecordKey,ChukwaRecord>

Enclosing class:

FSMBuilder

public static class FSMBuilder.FSMReducer
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Reducer<ChukwaRecordKey,FSMIntermedEntry,ChukwaRecordKey,ChukwaRecord>

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	JCDF_EDGE_TIME
protected static String	JCDF_EDGE_VOL
protected static String	JCDF_ID1
protected static String	JCDF_ID2
protected static String	JCDF_SEP
protected static String[]	NON_COUNTER_KEYS These are used for the add_info TreeMap; keys not listed here are automatically prepended with "COUNTER_"

Constructor Summary

Constructors

Constructor and Description
FSMBuilder.FSMReducer()

Method Summary

Methods

Modifier and Type	Method and Description
protected void	addStitchingFields_blockread(ChukwaRecord cr, ArrayList<String> fnl) Populates fields used by Pig script for stitching together causal flows
protected void	addStitchingFields_blockwrite(ChukwaRecord cr, ArrayList<String> fnl)
protected void	addStitchingFields_map(ChukwaRecord cr, ArrayList<String> fnl) Populates fields used by Pig script for stitching together causal flows
protected void	addStitchingFields_redreducer(ChukwaRecord cr, ArrayList<String> fnl) Populates fields used by Pig script for stitching together causal flows
protected void	addStitchingFields_redshufwait(ChukwaRecord cr, ArrayList<String> fnl) Populates fields used by Pig script for stitching together causal flows
protected void	addStitchingFields_redsort(ChukwaRecord cr, ArrayList<String> fnl) Populates fields used by Pig script for stitching together causal flows
protected void	addStitchingFields_shuffle(ChukwaRecord cr, ArrayList<String> fnl) Populates fields used by Pig script for stitching together causal flows
void	addStitchingFields(ChukwaRecord cr)
void	reduce(ChukwaRecordKey key, Iterator<FSMIntermedEntry> values, org.apache.hadoop.mapred.OutputCollector<ChukwaRecordKey,ChukwaRecord> output, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class org.apache.hadoop.mapred.MapReduceBase

close, configure

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.mapred.JobConfigurable

configure

Methods inherited from interface java.io.Closeable

close

Field Detail

NON_COUNTER_KEYS

protected static String[] NON_COUNTER_KEYS

These are used for the add_info TreeMap; keys not listed here are automatically prepended with "COUNTER_"

JCDF_ID1

protected static String JCDF_ID1

JCDF_ID2

protected static String JCDF_ID2

JCDF_EDGE_TIME

protected static String JCDF_EDGE_TIME

JCDF_EDGE_VOL

protected static String JCDF_EDGE_VOL

JCDF_SEP

protected static String JCDF_SEP

Constructor Detail

FSMBuilder.FSMReducer

public FSMBuilder.FSMReducer()

Method Detail

addStitchingFields_blockread

protected void addStitchingFields_blockread(ChukwaRecord cr,
                                ArrayList<String> fnl)

Populates fields used by Pig script for stitching together causal flows

addStitchingFields_map

protected void addStitchingFields_map(ChukwaRecord cr,
                          ArrayList<String> fnl)

Populates fields used by Pig script for stitching together causal flows

addStitchingFields_shuffle

protected void addStitchingFields_shuffle(ChukwaRecord cr,
                              ArrayList<String> fnl)

Populates fields used by Pig script for stitching together causal flows

addStitchingFields_redshufwait

protected void addStitchingFields_redshufwait(ChukwaRecord cr,
                                  ArrayList<String> fnl)

Populates fields used by Pig script for stitching together causal flows

addStitchingFields_redsort

protected void addStitchingFields_redsort(ChukwaRecord cr,
                              ArrayList<String> fnl)

Populates fields used by Pig script for stitching together causal flows

addStitchingFields_redreducer

protected void addStitchingFields_redreducer(ChukwaRecord cr,
                                 ArrayList<String> fnl)

Populates fields used by Pig script for stitching together causal flows

addStitchingFields_blockwrite

protected void addStitchingFields_blockwrite(ChukwaRecord cr,
                                 ArrayList<String> fnl)

addStitchingFields

public void addStitchingFields(ChukwaRecord cr)

reduce

public void reduce(ChukwaRecordKey key,
          Iterator<FSMIntermedEntry> values,
          org.apache.hadoop.mapred.OutputCollector<ChukwaRecordKey,ChukwaRecord> output,
          org.apache.hadoop.mapred.Reporter reporter)
            throws IOException

Specified by:

reduce in interface org.apache.hadoop.mapred.Reducer<ChukwaRecordKey,FSMIntermedEntry,ChukwaRecordKey,ChukwaRecord>

Throws:

IOException