Data Virtualization - RDBMS vs Middleware
Data virtualization platforms
Jul. 21, 2011 10:00 AM
As discussed in my previous article, Data Virtualization is the new enterprise data integration pattern for the petabyte enterprise that depends on Cloud for a dynamic allocation of resources to satisfy information needs. We have also seen several attributes of data virtualization that fits the needs of the new enterprise.
As an illustration of data virtualization at work, we have demonstrated the usage of SQL Server as a data virtualization engine that utilizes the relational database engine as a data virtualization server and delivers the results.
However, utilizing the existing RDBMS as a data virtualization engine is not the only option and we can utilize specialized engines outside of RDBMS as a data virtualization engine. This concept is not new.
ROLAP vs MDOLAP
MDOLAP or MOLAP, multi-dimensional OLAP servers, employ dedicated OLAP engines optimized to manage sparse matrices of data. MOLAP storage management maintains the physical storage of OLAP cubes. It has got the advantage of high performance and response time to queries while it is quite proprietary and cannot scale for large data sets.
ROLAP technology accesses data stored in a relational database to provide OLAP analysis without the requirement to store and calculate data in a multi-dimensional cube. Relational databases serve as the database layer for data storage, access and retrieval processes. ROLAP has the advantage of storing large data sets. However the response time is not fast as MOLAP.
While the idea is not to compare between ROLAP and MOLAP but it is more about , certain data integration and access patterns can be either achieved with pure RDBMS implementation or specialized middle tier servers specifically built for them.
In that context apart from analyzing the traditional RDBMS as a data virtualization engines in the last article, we also wanted analyze specialized data virtualization engines that specifically meant for the purpose.
Data Virtualization Using a Composite Platform
This solution provides a virtual data abstraction layer on top of the disparate data sources.
At the heart of this virtualization platform, the Composite Information Server acts a virtual database layer and facilitates the following core tenants of data virtualization.
Another interesting and useful feature of this data virtualization platform and that's not available out-of-the-box in the traditional RDBMS implementation of data virtualization is the ‘Performance Plus Adapters.' This feature converges data from enterprise applications like SAP, Siebel, Oracle E Business Suite, as well as traditional OLAP platforms such as Oracle Essbase, SAP BW and newer analytical databases like HP Vertica, Netezza and even Big Data implementations like Hadoop. This feature enables the creation of entire enterprise application integration patterns using the data virtualization layer, replacing or augmenting the Enterprise Service Bus (ESB).
While most cases of data virtualization solutions are good to visualize, their performance always subject to issues due to the latency involved in connecting to disparate data sources. To solve this issue, this platform also provides a ‘Composite Active Cluster' that acts like MSCS for Microsoft SQL Server implementation, with features like.
SOA World Latest Stories
Subscribe to the World's Most Powerful Newsletters
Subscribe to Our Rss Feeds & Get Your SYS-CON News Live!
SYS-CON Featured Whitepapers
Most Read This Week