Database sharding
Sharding means splitting your data across multiple nodes. This can be done in different ways:
1. Vertical sharding
- Store tables on different nodes.
- Drawback: If one of these tables gets very large, then you need to re-shard that database.
2. Key-based sharding
- Use part of your data (usually the row ID) to shard it.
- Drawback: The number of nodes is fixed. If you want to add more nodes, then you have to reallocate the data.
3. Directory-based sharding
- Maintain a lookup table for where each data is found.
- Drawback: The lookup table is a single point of failure, that's constantly under load.
18
93 reads
CURATED FROM
IDEAS CURATED BY
Alt account of @ocp. I use it to stash ideas about software engineering
📖 Cracking the Coding Interview
“
Similar ideas to Database sharding
What is an index?
A database index is a data structure that improves the speed of data retrieval operations on a database table at the cost of additional writes and storage space to maintain the index data structure. Indexes are used to quickly locate data without having to search every row in a database table eve...
Python data processing with pandas
Pandas is a Python language package, which is used for data processing. This is a very common basic programming library when we use Python language for machine learning programming. This article is an introductory tutorial to it. Pandas provide fast, flexible and expressive data structures with t...
Big data Hadoop
- Ability to store and process huge amounts of any kind of data, quickly. With data volumes and varieties constantly increasing, especially from social media and the Internet of Things (IoT) , th...
Read & Learn
20x Faster
without
deepstash
with
deepstash
with
deepstash
Personalized microlearning
—
100+ Learning Journeys
—
Access to 200,000+ ideas
—
Access to the mobile app
—
Unlimited idea saving
—
—
Unlimited history
—
—
Unlimited listening to ideas
—
—
Downloading & offline access
—
—
Supercharge your mind with one idea per day
Enter your email and spend 1 minute every day to learn something new.
I agree to receive email updates