org.apache.hadoop.chukwa.datacollection.adaptor.filetailer

Class FileTailingAdaptorPreserveLines

java.lang.Object

org.apache.hadoop.chukwa.datacollection.adaptor.AbstractAdaptor

org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.LWFTAdaptor

org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.FileTailingAdaptor

org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.FileTailingAdaptorPreserveLines

All Implemented Interfaces:

Adaptor

public class FileTailingAdaptorPreserveLines
extends FileTailingAdaptor

A subclass of FileTailingAdaptor that reads UTF8/ascii files and only send chunks with complete lines.

Field Summary

Fields inherited from class org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.FileTailingAdaptor

MAX_RETRIES, reader

Fields inherited from class org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.LWFTAdaptor

conf, DEFAULT_MAX_READ_SIZE, fileReadOffset, lastSlurpTime, MAX_READ_SIZE_OPT, offsetOfFirstByte

Fields inherited from class org.apache.hadoop.chukwa.datacollection.adaptor.AbstractAdaptor

adaptorID, control, dest, type

Constructor Summary

Constructors

Constructor and Description
FileTailingAdaptorPreserveLines()

Method Summary

Modifier and Type	Method and Description
protected int	extractRecords(ChunkReceiver eq, long buffOffsetInFile, byte[] buf) Extract records from a byte sequence

Methods inherited from class org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.FileTailingAdaptor

shutdown, start, tailFile

Methods inherited from class org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.LWFTAdaptor

getCurrentStatus, getStreamName, parseArgs, slurp, toString

Methods inherited from class org.apache.hadoop.chukwa.datacollection.adaptor.AbstractAdaptor

deregisterAndStop, getType, hardStop, parseArgs, shutdown, start

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

FileTailingAdaptorPreserveLines

public FileTailingAdaptorPreserveLines()

Method Detail

extractRecords

protected int extractRecords(ChunkReceiver eq,
                             long buffOffsetInFile,
                             byte[] buf)
                      throws InterruptedException

Description copied from class: LWFTAdaptor

Extract records from a byte sequence

Overrides:

extractRecords in class LWFTAdaptor

Parameters:

eq - the queue to stick the new chunk[s] in

buffOffsetInFile - the byte offset in the stream at which buf[] begins

buf - the byte buffer to extract records from

Returns:

the number of bytes processed

Throws:

InterruptedException