This is an old revision of the document!


Administration: Omnidex Fundamentals

Omnidex Updates

Overview

Omnidex allows databases to be updated either in batch or online. The large majority of companies choose to update their databases in batch, and this is in keeping with the design of Omnidex and the nature of large databases.

Omnidex specializes in very large databases that are heavily indexed. This combination is more and more common in the industry as companies require increasing intelligence gathered from larger and larger databases. The classic approach of inserting data into a database simply doesn't scale well. Most relational databases can support inserting hundreds of thousands of rows into a table, but not hundreds of millions. If the database is heavily indexed, the classic approach of inserting data into a database falters even more. Most administrators would be understandably reluctant to insert hundreds of thousands of rows into a table with tens or hundreds of indexes.

This has led to new approaches to handling large volumes of data. Companies frequently process their data in larger batches, and Omnidex specializes in this approach. In contrast to the relational database, Omnidex is designed to regenerate all of the indexes on a table with a single scan of the data, processing rates of 1 billion index entries an hour1. Omnidex Grids also allow new nodes to be created and indexed independently from the rest of the database, allowing an incremental approach to updating the database. While it is impractical to drop and recreate large indexes in a relational database, it is fast and easy to regenerate the indexes with Omnidex.

For applications that require online updates, Omnidex supports the INSERT, DELETE and UPDATE statements and will update most kinds of Omnidex indexes in real time. Omnidex also supports an approach that uses triggers on relational databases to automatically capture all updates. Online updates have some important restrictions that must be considered, but they can provide important flexibility to application designers.


1 An "index entry" represents an indexed column in a single row. If the column contains textual data that is indexed with QuickText or FullText indexes, then an "index entry"" represents a single word or number in an indexed column in a single row.

Next

Additional Resources

See also:

 
Back to top
admin/basics/updates/home.1302621776.txt.gz ยท Last modified: 2016/06/28 22:38 (external edit)