DataMigrator is a powerful and comprehensive automated tool designed to dramatically simplify extract, transformation, and load (ETL) processes, including the creation, maintenance, and expansion of data warehouses, data marts, and operational data stores.
Truly Seamless Integration
DataMigrator enables fast, flexible, end-to-end ETL process creation involving heterogeneous data structures across disparate computing platforms.
Accelerate the Creation and Execution of ETL Jobs
DataMigrator provides greater reach and range than any other ETL offering by employing iWay Software’s award-winning data and application adapters to efficiently retrieve data from almost any source. These include:
- Relational databases
- Files in XML, JSON, delimited and other formats
- SOAP and RESTful web services
- ERP and cloud based systems including salesforce.com
- Hadoop data sources on any major distribution through Hive, Impala or Drill, HBase through Phoenix and other NoSQL data sources
DataMigrator can create tables in any major relational database, create delimited files, XML or JSON documents, and efficiently load data to Hadoop file formats including text files, ORC and Parquet. DataMigrator can also read and write data in column stores including Hyperstage and Jethro.
DataMigrator meets the widest range of information needs by enabling direct access to data in operational systems and staged data in warehouses or marts.
Remote Review and Administration
Web Console provides efficient management of ETL jobs in a secure environment. Administrators and users can easily review job statistics and drill down into job logs, review the job queue, start and stop servers and server processes, schedule jobs and configure e-mail nodes, manage adapters and metadata, administrate application directories, and create and edit scripts and user exits.
Runs on Every Platform, Handles All Data
DataMigrator runs on all Unix, Linux, Windows, z/OS, z/Linux, and Series i platforms. It also interacts with a wide variety of applications, such as SAP, JD Edwards, and PeopleSoft that can act as either data sources or as targets. It also provides the ability to perform calculations and data cleansing at both the source and target.
DataMigrator is designed to dramatically simplify extract, transformation, and load (ETL) processes.
Event-Driven ETL and Changed Data Capture
DataMigrator provides the real-time capability to listen for files as they arrive on a message queue, in a directory, or via s/ftp. The files then can be processed and loaded into a database table, and when processing is complete they can be removed or archived.
DataMigrator also provides a Changed Data Capture (CDC) facility that reads RDBMS logs or journals to deliver data changes only (inserts, updates, and deletions) to DataMigrator for follow-on processing. Some of the benefits of CDC are:
- Improving timeliness of information in data warehouses
- Reducing ETL run times
- Using non-intrusive log-scraping technology to reduce impact on source systems
- Simplifying development efforts by completely integrating the CDC system with ETL
CDC data sources supported are:
- Windows, UNIX and Linux: IBM UDB, ORACLE 11 and later, MS SQL Server 2008 and later, MySQL, Maria DB
- IBM zSeries: DB2
- IBM iSeries: DB2/400