Exam Professional Data Engineer topic 1 question 50 discussion

BDE. Hive is not for NoSQL

Answer is BDE - A. Redis - Redis is an in-memory non-relational key-value store. Redis is a great choice for implementing a highly available in-memory cache to decrease data access latency, increase throughput, and ease the load off your relational or NoSQL database and application. Since the question does not ask cache, A is discarded. B. HBase - Meets reqs C. MySQL - they do not need ACID, so not needed. D. MongoDB - Meets reqs E. Cassandra - Apache Cassandra is an open source NoSQL distributed database trusted by thousands of companies for scalability and high availability without compromising performance. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure make it the perfect platform for mission-critical data. F. HDFS with Hive - Hive allows users to read, write, and manage petabytes of data using SQL. Hive is built on top of Apache Hadoop, which is an open-source framework used to efficiently store and process large datasets. As a result, Hive is closely integrated with Hadoop, and is designed to work quickly on petabytes of data. HIVE IS NOT A DATABSE.

Option A: Redis cannot handle large scale data it is NOSQL db to store small amount of key value pairs, Option B: HBase NOSQL db built on Hadoop does not support ACID Properties. Correct answer Option C: Mysql Does not store telemetry IOT data. Mysql is a relational database structured data only stored. Option D, E: NOSQL Databases, Option F: HDFS with hive used for batch processing not real time streaming data. Option

BDE Faster Database are NoSql db than SQL, Cassandra is the fastest one in market now than Hbase and then others, in given list MongoBD

"Which three databases meet your requirements? " Hive is not a database server. HBase, Mongo and Cassandra are and meet the criteria. BDE is the right answer

@hendrixlives

as explained by hendrixlives

BDE: A. Redis is a key-value store (and in many cases used as in-memory and non persistent cache). It is not designed for "100TB per year" of highly available storage. B. HBase is similar to Google Bigtable, fits the requirements perfectly: highly available, scalable and with very low latency. C. MySQL is a relational DB, designed precisely for ACID transactions and not for the stated requirements. Also, growth may be an issue. D. MongoDB is a document-db used for high volume data and maintains currently used data in RAM, so performance is usually really good. Should also fit the requirements well. E. Cassandra is designed precisely for highly available massive datasets, and a fine tuned cluster may offer low latency in reads. Fits the requirements. F. HDFS with Hive is great for OLAP and data-warehouse scenarios, allowing to solve map-reduce problems using an SQL subset, but the latency is usually really high (we may talk about seconds, not milliseconds, when obtaining results), so this does not complies with the requirements.

Very strange question, seems outdated and irrelevant to me as it doesn't contain any GCP products :) Anyway, I would choose BEF. Redis is in-memory key value, not good HBase yes, excelent case for linear growth and a column-oriented database mysql not good, too big and no need for transactionality Mongodb, document db with flexible schema ?? Yes Cassandra, good use case Apache Hive is a data warehouse software project built on top of Apache Hadoop for providing data query and analysis. https://www.wikiwand.com/en/Apache_Hive

Ans: B, D and E

vote for BDE

BEF B: HBASE is based upon BigTable E: Cassandra is low latency columnar distributed database like BigTable F: HDFS is low latency distributed file system and Hive will help with running the queries

BDE: These are NoSQL DB, Hive is not for NoSQL.

The answer is ADE, the statement says they require a NoSQL with high availability and low latency, they do not require consistency. C. it is not NoSQL. F. it is not NoSQL. B. it is NoSQL but focused on strong consistency and based on HDFS, you need HDFS for Hbase. Therefore the answer is ADE

BDF: Redis and Cassandra have only Rowkey and couldn't be indexed, and MySQL isn't NoSQL, Then B D and E is correct answer.

Correct BDE

it should be BDE because Hive is a sql based datawarehouse , it is not a nosql DB