org.apache.hadoop.chukwa.datacollection.sender

Class AsyncAckSender

java.lang.Object

org.apache.hadoop.chukwa.datacollection.sender.ChukwaHttpSender

org.apache.hadoop.chukwa.datacollection.sender.AsyncAckSender

All Implemented Interfaces:

ChukwaSender

public class AsyncAckSender
extends ChukwaHttpSender

An enhancement to ChukwaHttpSender that handles asynchronous acknowledgment. This class will periodically poll the collectors to find out how much data has been committed to HDFS, and will then pass those acks on to the Agent.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AsyncAckSender.DelayedCommit

Nested classes/interfaces inherited from class org.apache.hadoop.chukwa.datacollection.sender.ChukwaHttpSender

ChukwaHttpSender.CommitListEntry

Field Summary

Fields

Modifier and Type	Field and Description
AdaptorResetThread	adaptorReset
static String	POLLHOSTS_OPT
static String	POLLPERIOD_OPT

Fields inherited from class org.apache.hadoop.chukwa.datacollection.sender.ChukwaHttpSender

COLLECTOR_TIMEOUT_OPT

Constructor Summary

Constructors

Constructor and Description
AsyncAckSender(org.apache.hadoop.conf.Configuration conf, ChukwaAgent a)

Method Summary

Modifier and Type	Method and Description
List<ChukwaHttpSender.CommitListEntry>	postAndParseResponse(org.apache.commons.httpclient.methods.PostMethod method, List<ChukwaHttpSender.CommitListEntry> expectedCommitResults)
void	setCollectors(Iterator<String> collectors) Set up a list of connectors for this client to send Chunks to
void	stop()

Methods inherited from class org.apache.hadoop.chukwa.datacollection.sender.ChukwaHttpSender

send

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

POLLPERIOD_OPT

public static final String POLLPERIOD_OPT

See Also:

Constant Field Values

POLLHOSTS_OPT

public static final String POLLHOSTS_OPT

See Also:

Constant Field Values

adaptorReset

public AdaptorResetThread adaptorReset

Constructor Detail

AsyncAckSender

public AsyncAckSender(org.apache.hadoop.conf.Configuration conf,
                      ChukwaAgent a)
               throws IOException

Throws:

IOException

Method Detail

setCollectors

public void setCollectors(Iterator<String> collectors)

Description copied from class: ChukwaHttpSender

Set up a list of connectors for this client to send Chunks to

Specified by:

setCollectors in interface ChukwaSender

Overrides:

setCollectors in class ChukwaHttpSender

Parameters:

collectors - is a list of collectors

postAndParseResponse

public List<ChukwaHttpSender.CommitListEntry> postAndParseResponse(org.apache.commons.httpclient.methods.PostMethod method,
                                                                   List<ChukwaHttpSender.CommitListEntry> expectedCommitResults)
                                                            throws IOException,
                                                                   InterruptedException

Overrides:

postAndParseResponse in class ChukwaHttpSender

Parameters:

method - the data to push

expectedCommitResults - the list

Returns:

the list of committed chunks

Throws:

IOException - if error writing

InterruptedException - if shutdown has been initiated

stop

public void stop()

Specified by:

stop in interface ChukwaSender

Overrides:

stop in class ChukwaHttpSender