Learn

Data Warehouse

A data warehouse is a repository that presents an aggregated view of enterprise data, optimized for BI and analytics. 

Information is extracted from heterogeneous sources and consolidated, allowing end users to easily access and interact with it, without putting a strain on operational systems. As data architectures have become more sophisticated, and information volumes continue to explode, modern approaches to data warehousing have evolved to embrace new and emerging data management needs, such as big data integration, the Internet of Things (IoT), and cloud data integration.

Information Builders offers comprehensive solutions for developing, managing, and optimizing a flexible data architecture that efficiently supports any enterprise information initiative. iWay data management, ETL, and real-time transformation solutions enable direct access to data in operational systems, data warehouses, and data marts, or retrieval of detail data via drill-throughs.

 

Information Builders offers a variety of ways to integrate and manage data, and embrace data warehouse initiatives and other modern integration approaches, including:

  • Extracting, transforming, and loading data directly into a data warehouse or mart

  • Directly accessing operational data stores or the files that service operational systems

  • Transparently drilling and joining data warehouses to operational data

  • Using an operational system's own application functions to access data

  • Trickle-feeding a data warehouse to populate and refresh it

  • Performing sophisticated data integration, transformation, and manipulation in real-time

 

DataMigrator

Fully automated ETL tools simplify the creation, maintenance, and expansion of data warehouses, data marts, micro marts, and operational data stores. An intuitive interface enables fast end-to-end ETL process creation involving heterogeneous data structures across disparate computing platforms.

  • Aggregate, join, merge, and apply selection criteria to information from any combination of systems

  • Simplify data movement from back-office systems to e-business platforms using automatically generated and managed FTP scripts or most native transport protocols

  • Transform raw data into structures that are more suited to your application

  • Simplify loading of data into a target data warehouse or database through the automatic invocation of bulk loaders or row-at-a-time inserts

  • Execute, schedule, review, manage, audit, and create dependencies among ETL requests

Additionally, a change data capture feature loads only changed records into the data source, dramatically reducing the time needed to refresh data, and facilitating a near-real-time data warehouse.

 

Real-Time Transformations

iWay Software solutions can be fully leveraged for real-time data integration and transformation, including sophisticated manipulations such as:

  • Aggregations, sorts, and joins before data leaves the source platform

  • Data set-level transformations with multiple roll-up levels, summations, and more on a single pass of the source data

  • Field-level transformations that can later be selected as if they were standard database fields

In addition, real-time process flows can feed your business intelligence system with data from Web services, EDI documents, XML messages, flat files, and almost any other document format.

iWay Service Manager is a unique, powerful enterprise service bus (ESB) that dynamically captures documents from business events, and transforms them into data that can be consumed by WebFOCUS. Developers can quickly tap into systems through application programming interfaces (APIs) or automatically generated Web services to reuse business logic and gain valuable insights into operational processes. Captured information can then be enriched through queries and lookups against other systems, ensuring that it is always relevant when it reaches the user.

All of this can be done with or without a data warehouse. Messages can be transformed on the fly, and used to trickle-feed a data warehouse.

 

iWay Big Data Integrator (iBDI)

iBDI provides a modern, native approach to Hadoop-based data integration and management that ensures high levels of capability, compatibility, and flexibility with support for all contemporary Hadoop solutions.

iBDI enables organizations to support any kind of use case by incorporating Apache Spark™ pipelines for transformation, cleansing, joining, and more; Sqoop for data replication, capture, and export; Kafka, Flume, and even Flafka for streaming and unstructured data acquisition; iWay Service Manager for ingestion of non-Hadoop data (e.g., transactions, messages, alternate data sources)—all running natively in the cluster.

Skills learned outside the cluster (e.g., using iWay Service Manager for traditional real-time data integration) can easily be transferred into the cluster, and vice versa. iBDI’s easy-to-use interface ensures that users don’t need as much training or knowledge of Hadoop to be effective.

Existing BI and data warehouse infrastructure can be extended, reinforced, or replaced as desired using the same infrastructure. For example, the same data quality rules used outside of Hadoop on non-Hadoop data can also be applied to a data lake in Hadoop.

Ready to get the Information Builders advantage?