This　paper　describes　a　method　that　can　be　used　to　track　the　single　moving　object　automatically　in　multiple　scenes.　After　preprocessing　of　the　original　image　sequence,　which　is　sampled　from　the　video　camera,　the　optical　flow　of　the　moving　object　in　multiple　scenes　will　be　calculated　rapidly　with　the　improved　algorithm.　The　moving　object　region　can　be　extracted　completely　through　several　processing　of　the　optical　flow　field　such　as　region-connection,　region-merging　and　region-clustering　methods.　Then,　the　results　of　these　processing　can　be　used　to　measure　the　speed　and　direction　of　the　moving　object　quantitatively,　and　can　be　used　to　output　the　control　signal　to　drive　the　tracker　for　tracking　the　fast-moving　object.