Package com.orientechnologies.orient.etl

Class OETLProcessor

java.lang.Object

com.orientechnologies.orient.etl.OETLProcessor

All Implemented Interfaces:

AutoCloseable

public class OETLProcessor
extends Object
implements AutoCloseable

ETL processor class.

Author:

Luca Garulli (l.garulli--(at)--orientdb.com) (l.garulli-at-orientdb.com)

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	OETLProcessor.LOG_LEVELS
class	OETLProcessor.OETLProcessorStats

Field Summary

Fields

Modifier and Type	Field	Description
protected List<OETLBlock>	beginBlocks
protected OETLContext	context
protected TimerTask	dumpTask
protected long	elapsed
protected List<OETLBlock>	endBlocks
protected OETLExtractor	extractor
protected final OETLComponentFactory	factory
protected boolean	haltOnError
protected OETLLoader	loader
protected Level	logLevel
protected int	maxRetries
protected OETLSource	source
protected long	startTime
protected final OETLProcessor.OETLProcessorStats	stats
protected List<OETLTransformer>	transformers
protected int	workers

Constructor Summary

Constructors

Constructor	Description
OETLProcessor(List<OETLBlock> iBeginBlocks, OETLSource iSource, OETLExtractor iExtractor, List<OETLTransformer> iTransformers, OETLLoader iLoader, List<OETLBlock> iEndBlocks, OETLContext iContext)	Creates an ETL processor by setting all the components on construction.

Method Summary

Modifier and Type	Method	Description
protected void	analyzeFlow()
protected void	begin()
protected void	checkTypeCompatibility(OETLComponent iCurrentComponent, OETLComponent iLastComponent)
void	close()
protected void	configRunBehaviour(OCommandContext context)
protected void	dumpProgress()
protected void	end()
void	execute()
protected Class	getClassByName(OETLComponent iComponent, String iClassName)
OETLContext	getContext()
OETLExtractor	getExtractor()
OETLComponentFactory	getFactory()
OETLLoader	getLoader()
Level	getLogLevel()
OETLSource	getSource()
OETLProcessor.OETLProcessorStats	getStats()
List<OETLTransformer>	getTransformers()
static void	main(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

factory

protected final OETLComponentFactory factory

stats

protected final OETLProcessor.OETLProcessorStats stats

endBlocks

protected List<OETLBlock> endBlocks

transformers

protected List<OETLTransformer> transformers

beginBlocks

protected List<OETLBlock> beginBlocks

source

protected OETLSource source

extractor

protected OETLExtractor extractor

loader

protected OETLLoader loader

context

protected OETLContext context

startTime

protected long startTime

elapsed

protected long elapsed

dumpTask

protected TimerTask dumpTask

logLevel

protected Level logLevel

haltOnError

protected boolean haltOnError

maxRetries

protected int maxRetries

workers

protected int workers

Constructor Details

OETLProcessor

public OETLProcessor(List<OETLBlock> iBeginBlocks,
 OETLSource iSource,
 OETLExtractor iExtractor,
 List<OETLTransformer> iTransformers,
 OETLLoader iLoader,
 List<OETLBlock> iEndBlocks,
 OETLContext iContext)

Creates an ETL processor by setting all the components on construction.

Parameters:

iBeginBlocks - List of Blocks to execute at the beginning of processing

iSource - Source component

iExtractor - Extractor component

iTransformers - List of Transformers

iLoader - Loader component

iEndBlocks - List of Blocks to execute at the end of processing

iContext - Execution Context

Method Details

main

public static void main(String[] args)

configRunBehaviour

protected void configRunBehaviour(OCommandContext context)

getStats

public OETLProcessor.OETLProcessorStats getStats()

getExtractor

public OETLExtractor getExtractor()

getSource

public OETLSource getSource()

getLoader

public OETLLoader getLoader()

getTransformers

public List<OETLTransformer> getTransformers()

getLogLevel

public Level getLogLevel()

getContext

public OETLContext getContext()

execute

public void execute()

close

public void close()

Specified by:

close in interface AutoCloseable

begin

protected void begin()

end

protected void end()

dumpProgress

protected void dumpProgress()

analyzeFlow

protected void analyzeFlow()

checkTypeCompatibility

protected void checkTypeCompatibility(OETLComponent iCurrentComponent,
 OETLComponent iLastComponent)

getClassByName

protected Class getClassByName(OETLComponent iComponent,
 String iClassName)

getFactory

public OETLComponentFactory getFactory()