Indexed by:
Abstract:
To improve the stability and reliability of the ETL workflow engine, in this paper, we put forward a new MAS-based and fault-tolerant distributed ELT workflow engine which is used to study the log management and exception handling mechanism in the distributed computing environment. In the new engine, the ETL jobs will be split into several job domains firstly. Secondly, when an error happens in a job domain, the engine will catch the exception from the error logs and then invoke our new recovery algorithm, Batch, to recover the job domain. The experiment result shows that our engine is not only much more stabile and reliable but also more efficiency in the execution of ETL workflow. © 2012 IEEE.
Keyword:
Reprint 's Address:
Email:
Version:
Source :
Year: 2012
Page: 54-58
Language: English
Cited Count:
SCOPUS Cited Count: 2
ESI Highly Cited Papers on the List: 0 Unfold All
WanFang Cited Count:
Chinese Cited Count:
30 Days PV: 9
Affiliated Colleges: