PowerUp
Talend RoundRobin component

tRoundRobin



Background :

When performing heavy data loads, sometimes performances are improved by paralleelizing loads splitting records into blocks directed to different connections.
Indeed the output (insert) statements need to be managed in separate threads to be able to improve performances.

The solution

tRoundRobin is derived from a tReplicate component, where connection are scanned and receive records in sequence.
If there are 5 output connections, each one of them will receive 20% of the records received from the input connection.


Current version

Version : 0.2
Release Date : June 17 2011
Status : Beta
Note (0.2) : Added "Number of records per block" parameter

Usage

Simply connect 1 input and as many outputs as you need.
Records will be sent in sequence to the first output connection, then the second (...) untill the last one is reached (or all the records are sent), then it will start again from the first.
Since version 0.2 a parameter has been added to specify how many records must be sent to each connection before moving to the next one.



You can optionally select which columns to be transferred from the input to the output and eventually rename them, in general you yill want to use the "sync columns" button.



The sample job shows a basic usage of the tRoundRobin Component.





Downloads
License

THIS SOFTWARE IS PROVIDED BY POWERUP ``AS IS'' AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL POWERUP BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.