OpenIO

From Wikipedia, the free encyclopedia
OpenIO
IndustryInformation technology, Data storage, Data processing
Founded2015
Headquarters
France
OwnerOVH
Websitewww.openio.io

OpenIO offers object storage for a wide range of high-performance applications.[1] OpenIO was founded in 2015 by Laurent Denel (CEO), Jean-François Smigielski (CTO) and five other co-founders; it has leveraged open source software, developed since 2006,[2] based on a grid technology that enables dynamic behaviour and supports heterogenous hardware. In October 2017 OpenIO completed a $5 million funding round.[3] In July 2020 OpenIO has been acquired by OVH.[4]

Product[]

OpenIO is a software-defined object store that supports S3 and can be deployed on-premises, cloud-hosted or at the edge, on any hardware mix. It has been designed from the beginning for performance and cost-efficiency at any scale,[5] and it has been optimized for Big Data, HPC and AI.[6]

OpenIO stores objects within in a flat structure within a massively distributed directory with indirections, which allows the data query path to be independent of the number of nodes and the performance not to be affected by the growth of capacity. Servers are organized as a grid of nodes massively distributed, where each node takes part in directory and storage services, which ensures that there is no single point of failure and that new nodes are automatically discovered and immediately available without the need to rebalance data.[7]

The software is built on top of ConsciousGrid, a technology that ensures optimal data placement based on real-time metrics and allows the addition or removal of storage devices with automatic performance and load impact optimization.[8][9] For data protection OpenIO has synchronous and asynchronous replication with multiple copies, and an erasure coding implementation based on Reed-Solomon that can be deployed in one data center or geo-distributed or stretched clusters.[10][11]

The software has a GridForApps feature that catches all events that occur in the cluster and can pass them up in the stack or to applications running on OpenIO nodes. This enables event-driven computing directly into the storage infrastructure.[12][13]

OpenIO has native object APIs and SDKs for Python, C and Java, it integrates a HTTP REST/API and has strong compatibility with the Amazon S3 API and the OpenStack Swift API.[7] The company also offers a proprietary File System connector to access data stored in an OpenIO object store through file access methods: it is based on FUSE and presents a POSIX File System which can be shared over local networks via NFS, SMB and FTP.[14]

OpenIO is compatible with x86 and ARMv7/ARMv8 servers running Linux[15] and has low hardware requirements.[16] It can be installed also on Raspberry Pis[17][18] and on storage drives with servers embedded.[19][20][21]

The open source code is available on Github and it is licensed under AGPL3 for server code and LGPL3 for client code.

Performance[]

OpenIO claimed to have reached 1.372 Tbps write speed (171 GB/s) on a cluster of 350 physical machines.[22] The benchmark scenario, conducted under production conditions with standard hardware (commodity servers with 7200 rpm HDDs), consisted in backing up a 38 PB Hadoop datalake via the DistCp command.[23] This level of performance marked, according to analysts,[24] the arrival of a new generation of object storage technologies oriented toward high performance and hyper-scalability.

See also[]

References[]

  1. ^ "OpenIO Object Storage Overview". OpenIO.
  2. ^ Nicholas, Philippe (2016-07-15). "The History Boys: Object storage... from the beginning". The Register.
  3. ^ Dillet, Romain (2017-10-24). "OpenIO raises $5 million to build your own Amazon S3 on any storage device". TechCrunch.
  4. ^ "With the acquisition of OpenIO, OVHcloud's ambition is to create the best Object Storage offer on the market". OVHcloud. 2020-07-22.
  5. ^ Mellor, Chris (2015-12-05). "Openio's objective is opening up object storage space". The Register.
  6. ^ "OpenIO | High Performance Object Storage for Big Data and AI". OpenIO.
  7. ^ a b "OpenIO Core Concepts". OpenIO Documentation.
  8. ^ "OpenIO Object Storage for Big Data". OpenIO.
  9. ^ "Why We Designed an Object Store with a Conscience". OpenIO Blog. 2017-07-18.
  10. ^ "OpenIO Data Management Features". OpenIO Documentation.
  11. ^ "OpenIO Storage Policies". OpenIO Documentation.
  12. ^ Delaporte, Guillaume (2017-05-17). "Simple Metadata Indexing through Grid for Apps". OpenIO Blog.
  13. ^ Delaporte, Guillaume (2017-06-07). "Detect patterns in pictures at scale using Tensorflow and OpenIO GridForApps". OpenIO Blog.
  14. ^ "OpenIO File System Connector (OIO-FS) Architecture". OpenIO Documentation.
  15. ^ "OpenIO Supported Linux Distributions". OpenIO Documentation.
  16. ^ "OpenIO Sizing Guide". OpenIO Documentation.
  17. ^ Townsend, Keith (2017-03-14). "Raspberry Pi in the data center: A unique option for object storage and edge computing". TechRepublic.
  18. ^ "OpenIO on a Raspberry Pi". OpenIO Documentation.
  19. ^ Kranz, Garry (2017-02-06). "Open source object storage startup OpenIO adds hardware". SearchStorage.
  20. ^ Mellor, Chris (2016-09-21). "OpenIO wants to turn your spinning rust into object storage nodes". The Register.
  21. ^ Mellor, Chris (2017-10-03). "Is this the real life? Is this just fantasy? Self-processing flash drives, we'll need more capacity". The Register.
  22. ^ Mellor, Chris (2019-10-15). "OpenIO 'solves' the problem with object storage hyperscalability". Blocks & Files.
  23. ^ "Terabit Challenge | OpenIO Object Storage". OpenIO.
  24. ^ Enrico, Signoretti (2019-11-08). "S3, file access and high performance… this is not your old object storage". Gigaom.

External links[]

Retrieved from ""