Embedded database

From Wikipedia, the free encyclopedia

An embedded database system is a database management system (DBMS) which is tightly integrated with an application software; it is "embedded in the application". It is actually a broad technology category that includes

The term embedded database can be confusing because only a small subset of embedded database products are used in real-time embedded systems such as telecommunications switches and consumer electronics devices.[1] (See mobile database for small-footprint databases that could be used on embedded devices.)

Implementations[]

Major embedded database products include, in alphabetical order:

Comparisons of database storage engines[]

Advantage Database Server[]

Main article: Advantage Database Server

Sybase's Advantage Database Server (ADS) is a full-featured embedded database management system. It provides both ISAM and relational data access and is compatible with multiple platforms including Windows, Linux, and Netware. It is available as a royalty-free local file-server database or a full client-server version. ADS has been around for many years and is highly scalable, with no administration, and has support for a variety of IDEs including .NET Framework (.NET), Object Pascal (Delphi), Visual FoxPro (FoxPro), PHP, Visual Basic (VB), Visual Objects (VO), Vulcan, Clipper, Perl, Java, xHarbour, etc.

Apache Derby[]

Main article: Apache Derby

Derby is an embeddable SQL engine written entirely in Java. Fully transactional, multi-user with a decent SQL subset, Derby is a mature engine and freely available under the Apache license and is actively maintained. Derby project page. It is also distributed as part of Oracle's Java SE Development Kit (JDK) under the name of Java DB.

Empress Embedded Database[]

Main article: Empress Embedded Database

Empress Software, Inc., developer of the Empress Embedded Database, is a privately held company founded in 1979. Empress Embedded Database is a full-function, relational database that has been embedded into applications by organizations small to large, with deployment environments including medical systems, network routers, nuclear power plant monitors, satellite management systems, and other embedded system applications that require reliability and power.[2] Empress is an ACID compliant, SQL database engine with C, C++, Java, JDBC, ODBC, SQL, ADO.NET and kernel level APIs. Applications developed using these APIs may be run in standalone and/or server modes. Empress Embedded Database runs on Linux, Unix, Microsoft Windows and real-time operating systems.

Extensible Storage Engine[]

Main article: Extensible Storage Engine

ESE is an Indexed Sequential Access Method (ISAM) data storage technology from Microsoft. ESE is notably a core of Microsoft Exchange Server and Active Directory. Its purpose is to allow applications to store and retrieve data via indexed and sequential access. Windows Mail and Desktop Search in the Windows Vista operating system also make use of ESE to store indexes and property information respectively.

eXtremeDB[]

Main article: eXtremeDB

McObject LLC launched eXtremeDB as the first in-memory embedded database designed from scratch for real-time embedded systems. The initial product was soon joined by eXtremeDB High Availability (HA) for fault tolerant applications. The product family now includes 64-bit and transaction logging editions, and the hybrid eXtremeDB Fusion, which combines in-memory and on-disk data storage. In 2008, McObject introduced eXtremeDB Kernel Mode, the first embedded DBMS designed to run in an operating system kernel.[3] Today, eXtremeDB is used in millions of real-time and embedded systems worldwide. McObject also offers Perst, an open source, object-oriented embedded database for Java, Java ME, .NET, .NET Compact Framework and Silverlight.

Firebird Embedded[]

Main article: Firebird (database server)

Firebird Embedded is a relational database engine. It's an open source fork of InterBase, is ACID compliant, supports triggers and stored procedures, and is available on Linux, OSX and Windows systems. It has the same features as the classic and superserver version of Firebird, two or more threads (and applications) can access the same database at the same time starting with Firebird 2.5. So Firebird embedded acts as a local server for one threaded client accessing its databases (that means it works properly for ASP.NET web applications, because there, each user has its own thread, which means two users could access the same database at the same time, but they would not be in the same thread, because ASP.NET opens a new thread for each user). It exports the standard Firebird API entrypoints. The main advantage of Firebird embedded databases is, that unlike SQlite or Access databases, they can be plugged into a full Firebird server without any modifications at all also is multiplatform (runs on Linux, OS X with full ASP.NET Mono support)


H2[]

Main article: H2 (DBMS)

Written in Java Open source very fast database engine. Embedded and Server mode, Clustering support, can run inside the Google App Engine. Supports encrypted database files (AES or XTEA). The development of H2 was started in May 2004, but it was first published on December 14, 2005. H2 is dual licensed and available under a modified version of the MPL 1.1 (Mozilla Public License) or under the (unmodified) EPL 1.0 (Eclipse Public License).

HailDB, formerly Embedded InnoDB[]

Main article: InnoDB

HailDB is a standalone, embeddable form of the InnoDB Storage Engine. Given that HailDB is based on the same code base as the InnoDB Storage Engine, it contains many of the same features: high-performance and scalability, multiversion concurrency control (MVCC), row-level locking, deadlock detection, fault tolerance, automatic crash recovery, etc. However, because the embedded engine is completely independent from MySQL, it lacks server components such as networking, object-level permissions, etc. By eliminating the MySQL server overhead, InnoDB has a small footprint and is well-suited for embedding in applications which require high-performance and concurrency. As with most embedded database systems, HailDB is designed to be accessed primarily with an ISAM-like C API rather than SQL (though an extremely rudimentary SQL variant is supported).[4]

The project is no longer maintained.[5]

HSQLDB[]

Main article: HSQLDB

HSQLDB is an opensource relational database management system with a BSD-like license that runs in the same Java Virtual Machine as the embedded application. HSQLDB supports a variety of in-memory and disk-based table modes, Unicode and SQL:2016.

InfinityDB[]

Main article: InfinityDB

InfinityDB Embedded Java DBMS is a sorted hierarchical key/value store. It now has an Encrypted edition and a Client/Server edition. The multi-core speed is patent-applied-for. InfinityDB is secure, transactional, compressing, and robust, in a single file for instant installation and zero administration. APIs include the simple fast 'ItemSpace', a ConcurrentNavigableMap view, and JSON. A RemoteItemSpace can transparently redirect the embedded APIs to other db instances. Client/Server includes a light-weight Servlet server, web admin and database browsing, and REST for python.

Informix Dynamic Server[]

Main article: Informix Dynamic Server

Informix Dynamic Server (IDS) is characterized as an enterprise class embeddable database server, combining embeddable features such as low footprint, programmable and autonomic capabilities with enterprise class database features such as high availability and flexible replication features.[6] IDS is used in deeply embedded scenarios such as IP telephony call-processing systems, point of sale applications and financial transaction processing systems.

InterBase[]

Main article: InterBase

InterBase is an IoT Award-winning cross-platform, Unicode enabled SQL database platform able to be embedded within turn-key applications. Out of the box SMP support and on disk AES strength 256bit encryption, SQL 92 & ACID compliance and support for Windows, Macintosh, Linux, Solaris, iOS and Android platforms. Ideal for both small-to-medium and large enterprises supporting hundreds of users and mobile application development. InterBase Light is a free version that can be used on any mobile device and is ideal for mobile applications. Enterprises can switch to a paid version as requirements for change management and security increase. InterBase has high adoption in defense, airspace, oil and gas, and manufacturing industries.

LevelDB[]

Main article: LevelDB

LevelDB is an ordered key/value store created by Google as a lightweight implementation of the Bigtable storage design. As a library (which is the only way to use LevelDB), its native API is C++. It also includes official C wrappers for most functionality. Third-party API wrappers exist for Python, PHP, Go (pure Go LevelDB implementation exists but is in progress still), Node.js and Objective C. Google distributes LevelDB under the New BSD License.

LMDB[]

Main article: Lightning Memory-Mapped Database

Lightning Memory-Mapped Database (LMDB) is a memory-mapped key-value database for the OpenLDAP Project. It is written in C and the API is modeled after the Berkeley DB API, though much simplified. The library is extremely compact, compiling down to under 40KB of x86 object code, being usually faster than similar libraries like Berkeley DB, LevelDB, etc. The library implements B+trees with multiversion concurrency control (MVCC), single-level store, Copy on write and provides full ACID transactions with no deadlocks. The library is optimized for high read concurrency; readers need no locks at all. Readers don't block writers and writers don't block readers, so read performance scales perfectly linearly across arbitrarily many threads and CPUs. Third-party wrappers exist for C++, Erlang and Python. LMDB is distributed by the OpenLDAP Project under the OpenLDAP Public License. As of 2013 the OpenLDAP Project is deprecating the use of Berkeley DB, in favor of LMDB.

Mimer SQL[]

Main article: Mimer SQL

An embedded zero maintenance version of the proprietary Mimer SQL database is available.

MySQL Embedded Server Library[]

Main article: MySQL

The Embedded MySQL Server Library provides most of the features of regular MySQL as a linkable library that can be run in the context of a client process. After initialization, clients can use the same C API calls as when talking to a separate MySQL server but with less communication overhead and with no need for a separate database process.

NexusDB[]

Main article: NexusDB

NexusDB is the commercial successor to the FlashFiler database which is now open source. They can both be embedded in Delphi applications to create stand-alone executables with full database functionality.

Oracle Berkeley DB[]

Main article: Berkeley DB

As the name implies, Oracle's embedded database is actually Berkeley DB, which Oracle acquired from Sleepycat Software. It was originally developed at the University of California.[7] Berkeley DB is a fast, open-source embedded database and is used in several well-known open-source products, including the Linux and BSD Unix operating systems, Apache Web server, OpenOffice productivity suite. Nonetheless, over recent years many well-known projects switched to using LMDB, because it outperform Berkeley DB in key scenarios on the ground of "less is more" design, as well due to the license changing. [8]

Raima Database Manager[]

Main article: Raima Database Manager

Raima Database Manager, produced by Raima. According to Raima's definition, the product is embedded in two senses: first, it is embedded within an application, becoming an extension to the application, and second, it is possible to use it in embedded computer/OS or real-time environments because of its small footprint and efficient operation. Its APIs (for C/C++, SQL, JDBC, ODBC, ADO.NET, and RESTful) have been designed to support the limited resources of embedded environments.

RocksDB[]

Main article: RocksDB

RocksDB, created at Facebook, began as a fork of LevelDB.[9] It focuses on performance, especially on SSDs. It adds many features, including transactions,[10] backups,[11] snapshots,[12] bloom filters,[13] column families,[14] expiry,[15] custom merge operators,[16] more tunable compaction,[17] statistics collection,[18] and geospatial indexing.[19] It is used as a storage engine inside of several other databases, including ArangoDB,[20] Ceph,[21] CockroachDB,[22] MongoRocks,[23] MyRocks,[24] Rocksandra,[25] and TiKV.[26][27]

solidDB[]

Main article: solidDB

solidDB is a hybrid on-disk/in-memory, relational database and is often used as an embedded system database in telecommunications equipment, network software, and similar systems. In-memory database technology is used to achieve throughput of tens of thousands of transactions per second with response times measured in microseconds. High availability option maintains two copies of the data synchronized at all times. In case of system failure, applications can recover access to solidDB in less than a second without loss of data.

SQLite[]

Main article: SQLite

SQLite is a software library that implements a self-contained, server-less, zero-configuration, transactional SQL database engine. SQLite is the most widely deployed SQL database engine in the world. The source code, chiefly C, for SQLite is in the public domain. It includes both a native C library and a simple command line client for its database. It's included in several operating systems; among them are Android, FreeBSD, iOS, OS X and Windows 10.[28]

SQL Server Compact[]

Main article: SQL Server Compact

Microsoft's SQL Server Compact is an embedded database with wide variety of features like multi-process connections, T-SQL, ADO.NET Sync Services to sync with any back end database, Merge Replication with SQL Server, Programming API: LINQ to SQL, LINQ to Entities, ADO.NET. The product runs on both Desktop and Mobile Windows platforms. It has been in the market for long time, used by many enterprises in production software (Case Studies). The product went through multiple re-brandings and was known with multiple names like: SQL CE, SQL Server CE, SQL Server Mobile, SQL Mobile.

See also[]

References[]

  1. ^ Graves, Steve. "COTS Databases For Embedded Systems" Archived 2007-11-14 at the Wayback Machine, Embedded Computing Design magazine, January, 2007. Retrieved on August 13, 2008.
  2. ^ Mullins, Craig. "Empress Offers an Effective Embedded Database Solution", 2005. Retrieved on 2008-12-09
  3. ^ Gorine, Andrei and Krivolapov, Alexander. "Kernel Mode Databases: A DBMS Technology For High-Performance Applications", Dr. Dobb's Journal, April, 2008. Retrieved on August 13, 2008.
  4. ^ HailDB homepage
  5. ^ Shutting down HailDB, By Stewart Smith on August 19th, 2015, HailDB
  6. ^ "Embedding Informix Dynamic Server", Retrieved on August 30, 2009.
  7. ^ See Berkeley DB
  8. ^ Niccolai, James. "Update: Oracle Buys Sleepycat open-source database vendor" Archived 2008-06-13 at the Wayback Machine, "InfoWorld", 2006-02-14. Retrieved on June 12, 2008.
  9. ^ "RocksDB Basics". Retrieved 2018-07-19.
  10. ^ "RocksDB transactions". GitHub. Retrieved 2016-04-04.
  11. ^ "How to backup RocksDB?". Retrieved 2017-07-19.
  12. ^ "Checkpoints". Retrieved 2017-07-19.
  13. ^ "RocksDB bloom filters". GitHub. Retrieved 2016-04-04.
  14. ^ "Column families in RocksDB". GitHub. Retrieved 2016-04-04.
  15. ^ "RocksDB TTL support". GitHub. Retrieved 2016-04-04.
  16. ^ "RocksDB merge operator". GitHub. Retrieved 2016-04-04.
  17. ^ "Universal compaction". GitHub. Retrieved 2016-04-04.
  18. ^ "RocksDB perf context and IO stats context". GitHub. Retrieved 2016-04-04.
  19. ^ "Spatial indexing in RocksDB". rocksdb.org. Retrieved 2018-07-19.
  20. ^ "Comparing new RocksDB and MMFiles storage engines". Retrieved 2018-07-19.
  21. ^ "Storage Devices — Ceph Documentation". Retrieved 2018-07-19.
  22. ^ "Storage Layer - CockroachDB". Retrieved 2018-07-19.
  23. ^ "mongodb-partners/mongo-rocks: MongoDB storage integration layer for the Rocks storage engine". Retrieved 2018-07-19.
  24. ^ "MyRocks - A RocksDB storage engine with MySQL". Retrieved 2018-07-19.
  25. ^ "Open-sourcing a 10x reduction in Apache Cassandra tail latency". Retrieved 2018-07-19.
  26. ^ "RocksDB in TiKV - PingCAP". Retrieved 2018-07-19.
  27. ^ https://medium.com/walmartglobaltech/https-medium-com-kharekartik-rocksdb-and-embedded-databases-1a0f8e6ea74f
  28. ^ Answer, Usman (29 October 2015). "Shipping a New Mindset with SQLite in Windows 10". Microsoft. Archived from the original on 2016-01-31. Retrieved 6 March 2016.
Retrieved from ""