org.jwat.warc

Class WarcFileWriterConfig

java.lang.Object

org.jwat.warc.WarcFileWriterConfig

public class WarcFileWriterConfig
extends Object

General configuration of WarcFileWriter.

Author:

nicl

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	bCompression Compress archive(s).
boolean	bOverwrite Overwrite existing file(s).
static long	DEFAULT_MAX_FILE_SIZE Standard/default max file size.
protected Long	maxFileSize Max file size used to determine when to close the current ARC file and start writing to the next one.
protected LinkedHashMap<String,Map.Entry<String,String>>	metadata Array of metadata.
protected File	targetDir Target directory in which to write ARC file(s).

Constructor Summary

Constructors

Constructor and Description
WarcFileWriterConfig() Construct instance with largely default values, except the targetDir which is null.
WarcFileWriterConfig(File targetDir, boolean bCompression, long maxFileSize, boolean bOverwrite) Construct an instance with custom values.

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_MAX_FILE_SIZE

public static final long DEFAULT_MAX_FILE_SIZE

Standard/default max file size.

See Also:

Constant Field Values

targetDir

protected File targetDir

Target directory in which to write ARC file(s).

bCompression

protected boolean bCompression

Compress archive(s).

maxFileSize

protected Long maxFileSize

Max file size used to determine when to close the current ARC file and start writing to the next one.

bOverwrite

public boolean bOverwrite

Overwrite existing file(s).

metadata

protected LinkedHashMap<String,Map.Entry<String,String>> metadata

Array of metadata.

Constructor Detail

WarcFileWriterConfig

public WarcFileWriterConfig()

Construct instance with largely default values, except the targetDir which is null.

WarcFileWriterConfig

public WarcFileWriterConfig(File targetDir,
                            boolean bCompression,
                            long maxFileSize,
                            boolean bOverwrite)

Construct an instance with custom values.

Parameters:

targetDir - target directory in which to write WARC file(s)

bCompression - compress archive(s)

maxFileSize - max file size to determine when to move on to a fresh WARC file

bOverwrite - overwrite existing file(s)