org.apache.hadoop.chukwa.extraction.hbase

Class AbstractProcessor

java.lang.Object

org.apache.hadoop.chukwa.extraction.hbase.AbstractProcessor

Direct Known Subclasses:

DefaultProcessor, HadoopMetricsProcessor, SystemMetrics

public abstract class AbstractProcessor
extends Object

Constructor Summary

Constructors

Constructor and Description
AbstractProcessor()

Method Summary

Modifier and Type	Method and Description
void	addRecord(long time, String metric, String source, byte[] value, ArrayList<org.apache.hadoop.hbase.client.Put> output) Generic metric function to add a metric to HBase with full primary key and source computed.
void	addRecord(String metric, byte[] value) Generic function to add a metric to HBase metric table, this function assumes "time" and "source" have been defined and will construct primaryKey only, without recompute time and source md5.
void	addRecord(String primaryKey, String value)
void	process(Chunk chunk, ArrayList<org.apache.hadoop.hbase.client.Put> output, Reporter reporter) Process a chunk to store in HBase.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractProcessor

public AbstractProcessor()
                  throws NoSuchAlgorithmException

Throws:

NoSuchAlgorithmException

Method Detail

addRecord

public void addRecord(long time,
                      String metric,
                      String source,
                      byte[] value,
                      ArrayList<org.apache.hadoop.hbase.client.Put> output)

Generic metric function to add a metric to HBase with full primary key and source computed.

Parameters:

time - is timestamp in epoch

metric - is metric name

source - is data source name

value - is metric value in bytes

output - is an array list of Put operations

addRecord

public void addRecord(String primaryKey,
                      String value)

addRecord

public void addRecord(String metric,
                      byte[] value)

Generic function to add a metric to HBase metric table, this function assumes "time" and "source" have been defined and will construct primaryKey only, without recompute time and source md5.

Parameters:

metric - is metric name

value - is metric value in bytes

process

public void process(Chunk chunk,
                    ArrayList<org.apache.hadoop.hbase.client.Put> output,
                    Reporter reporter)
             throws Throwable

Process a chunk to store in HBase.

Parameters:

chunk - is a Chukwa chunk

output - is an array of Put operations

reporter - is a reporter to track progress

Throws:

Throwable - if there is problem parsing data