A Software Product of Techrains.

Reliable and quicker Data Synchronization

Techrains Data Synchronization Toolaids you tosynchronize data across various databases.

In Current day business there are many cases that exist wherein data is managed by separate applications in separate databases. Problem that the business is facing today is to have consistency of data across these systems. As the volumes are also growing the data has to be synched online and also at a quicker pace. Techrains Data Synchronization Tool helps in maintaining consistency of data across systems. This data movement can be unidirectional or bidirectional.

Current Situation:

Data Synchronization tools that exist in market have latency issues and data will be synchronized as a day end process. With this there is always a lag of one day and in certain cases where volumes are high these processes can take more than a day to complete. Application connect to backends which are heterogeneous. data is stored in legacy systems, Hierarchial databases, RDBMS, files, mainframe systems etc..Data structures that need to be synchronized require complex mappings between sources and targets, as well as aggregations, calculations, etc.

Solution:

Techrains Data Synchronization Tool addresses all the current day business problems and provides a highly reliable and quicker Data Synchronization.Data synchronization uses the proved storm technology for the reliable and faster synchronization that can be used in grid computing as well. This tool is configurable to synchronize data either offline or online. Tool is simple to use. Tool administrator has to just modify the configuration file and do a setup. Tool can also be scheduled to run at any point or all through.

Architecture

Techrains Data Synchronization Tool

UI Module:

Techrains Data Synchronization tool can be accessed via Web for Configuration, Proxy Generation, Scheduling and Reporting

Admin Module:

Admin Module is used to set the configuration and mappings. An Administrator should provide the connection details of source and target systems and the Data transformation information.

Proxy Generation Module:

This is for generating java Bean classes for target data bases for easier manipulation of calculations and transformations on data.

Synchronization module:

Critical Module which takes care of Data Synchronization by submitting topologies to Storm

Scheduler Module:

Using this module Administration can set the time at which the Synchronizer has to run and at what intervals it should run. Option for running indefinitely is also there.

Reporting Module:

Generates reports on number of records processed and the failed records. Rules can be set on failed records so that failed records follow that rules and get processed

Storm

Fault-tolerant:

The Storm cluster takes care of workers going down, reassigning tasks when necessary.

Scalable:

All you need to do in order to scale is add more machines to the cluster. Storm will reassign tasks to new machines as they become available.

Reliable:

All messages are guaranteed to be processed at least once. If there are errors, messages might be processed more than once, but you’ll never lose any message.

Fast:

Speed was one of the key factors driving Storm’s design.

Transactional:

You can get exactly once messaging semantics for pretty much any computation.