System design

 0    51 fiche    maciejjankowski9
Télécharger mP3 Imprimer jouer consultez
 
question réponse
what Cassandra is
commencer à apprendre
wide-column store
Couchdb
commencer à apprendre
alternative to MongoDb. An open-source document-oriented NoSQL database, implemented in Erlang
four examples of Wide-column store
commencer à apprendre
Apache Cassandra, Apache HBase, BigTable, scylla
Database replication master/slave
commencer à apprendre
Master -original, only writes, slaves - copies, only reads
expand CDN
commencer à apprendre
Content Delivery Network
expand SPOF
commencer à apprendre
Single point of failure
Cache eviction policies
commencer à apprendre
LRU - Least recently used, LFU - Least Frequently used, FIFO - First in First out
CDN - describe what it is
commencer à apprendre
A CDN is a network of geographically dispersed servers used to deliver static content. CDN servers cache static content like images, videos, CSS, JavaScript files, etc.
Data Lake
commencer à apprendre
is a system or repository of data stored in its natural/raw format,[1] usually object blobs or files
Stateless Web Tier
commencer à apprendre
session is kept in NoSQL database. It is no longer kept in web server. Each server in the cluster can access state data from the database
Load balancer, sticky session
commencer à apprendre
user who authenticated in one of the servers in a cluster, will be redirected to the same server for future calls (for certain amount of time that is longer than the session timeout)
Disadvantages of sticky session
commencer à apprendre
more difficult to add or remove servers, more difficult to handle server failures
Advantages of stateless web tier vs stateful web tier
commencer à apprendre
simpler, more robust and scalable
Shared data store for state data (sessions), what to use
commencer à apprendre
memcached/Redis, NoSQL
geoDNS
commencer à apprendre
geolocation DNS routing - to make sure, that the client is directed to the closest datacenter
Logging and monitoring tool
commencer à apprendre
Datadog, Matomo, prometeus, Pendo
example of Key business metrics
commencer à apprendre
daily active users etc
Shard
commencer à apprendre
each shard has the same schema, but data are specific to shard- user data is allocated to specific shard - hash function is used to find the shard e.g. user_id % 4
Sharding key vs partition key
commencer à apprendre
Sharding key vs partition key
Two Problems with sharding
commencer à apprendre
Resharding data - r.g. One shard goes down, Celebrity problem = hotspot key problem
Nanosecond
commencer à apprendre
10^-9
Microsecond
commencer à apprendre
10^-6
Millisecond
commencer à apprendre
10^-3
2^10
commencer à apprendre
1KB ~ 1 000
2^20
commencer à apprendre
1MB ~ 1 000 000
2^30
commencer à apprendre
1GB ~ 1 000 000 000
2^50
commencer à apprendre
1PB ~ 1 000 000 000 000 000
L1 cache
commencer à apprendre
A memory bank built into the CPU chip. Also known as the "primary cache," an L1 cache is the fastest memory in the computer and closest to the processor.
Fan-out service
commencer à apprendre
is a messaging pattern used to model an information exchange that implies the delivery (or spreading) of a message to one or multiple destinations possibly in parallel
Amazon sns
commencer à apprendre
simple notification service
Amazon EC2 - expand
commencer à apprendre
Amazon Elastic Compute Cloud
Amazon EC2 - describe
commencer à apprendre
allows users to rent virtual computers on which to run their own computer applications
Amazon EBS - expand
commencer à apprendre
Amazon Elastic Block Store
Amazon EBS - expand
commencer à apprendre
block level storage volumes for use with EC2 instances. You can create a file system on top of these volumes, or use them in any way you would use a block device (such as a hard drive)
Amazon DynamoDB
commencer à apprendre
is a fully managed proprietary NoSQL database service that supports key–value and document data structures
Amazon Aurora
commencer à apprendre
is a relational database service developed and offered by Amazon Web Services beginning in October 2014 Aurora is available as part of the Amazon Relational Database Service (RDS).
Amazon sqs
commencer à apprendre
simple queue service
memcached
commencer à apprendre
Memcached is an in-memory key-value store for small chunks of arbitrary data (strings, objects) from results of database calls, API calls, or page rendering.
2^40
commencer à apprendre
1 000 000 000 000 = 1TB
L1 cache reference
commencer à apprendre
0.5 ns
L2 cache reference
commencer à apprendre
7 ns
Mutex lock/unlock
commencer à apprendre
100 ns
Main memory reference
commencer à apprendre
100 ns
Compress 1KB with zippy
commencer à apprendre
10 microseconds = 10000 ns
Send 1KB via 1Gbps network
commencer à apprendre
10 microseconds
read 1MB sequentially from memory
commencer à apprendre
250 microseconds
read 1MB sequentially from disk
commencer à apprendre
30 ms
read 1MB sequentially from network
commencer à apprendre
10 ms
sharding vs partitioning
commencer à apprendre
The difference is that sharding implies the data is spread across multiple computers while partitioning does not. Partitioning is about grouping subsets of data within a single database instance
consistent hashing
commencer à apprendre
consistent hashingConsistent hashing is a special kind of hashing such that when a hash table is re-sized and consistent hashing is used, only k/n keys need to be remapped on average, where k is the number of keys, and n is the number of slots
consistent hashing describe algorithm
commencer à apprendre
To determine which server a key is stored on, we go clockwise from the key position on the ring until a server is found.

Vous devez vous connecter pour poster un commentaire.