BigTable



(Back to docs.huihoo.com)

Introduction

Bigtable: A Distributed Storage System for Structured Data

Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects at Google store data in Bigtable, including web indexing, Google Earth, and Google Finance. These applications place very different demands on Bigtable, both in terms of data size (from URLs to web pages to satellite imagery) and latency requirements (from backend bulk processing to real-time data serving). Despite these varied demands, Bigtable has successfully provided a flexible, high-performance solution for all of these Google products. In this paper we describe the simple data model provided by Bigtable, which gives clients dynamic control over data layout and format, and we describe the design and implementation of Bigtable.

BigTable 是 Google Style的数据库,使用结构化的文件来存储数据。BigTable不是一个关系型的数据库。它不支持关联或是类似于SQL的高级查询。取而代之的是多级映射的数据结构。这是一种面向大规模处理、容错性强的自我管理系统,拥有TB级的内存和PB级的存储能力,每秒可以处理数百万的读写操作。目前,BigTable正在为Google六十多种产品和项目提供存储和结构化数据获取的支撑平台

存储每个网站的内容与被其他网站的反向连接的文本

BigTable 的 clone 开源项目: Hypertable

Bigtable-like structured storage for Hadoop HDFS

Documents

• Bigtable: A Distributed Storage System for Structured Data

Links

• BigTable Homepage
• BigTable Wikipedia