Druid

Druid Profile and History

Low latency streaming ingest, and direct integration with messages buses such as Apache Kafka. Time-based partitioning, which enables performant time-based queries. Fast search and filter, for fast ad-hoc slice and dice. Minimal schema design, and native support for semi-structured and nested data. Consider using Druid over a data warehouse if you have streaming data, and require low-latency inges t as well as low-latency queries. Also consider Druid if you need ad-hoc analytics. Druid is great for slice and dice and drill downs. Druid is also often used over a data warehouse to power interactive applications, where support for high concurrency queries is required. Is Druid a SQL-on-Hadoop solution? When should I use Druid over Presto/Hive? Druid supports SQL and can load data from Hadoop, but is not a SQL-on-Hadoop system. Modern SQL-on-Hadoop solutions are used for the same use cases as data warehouses, except they are designed for architectures where compute and storage are separated systems, and data is loaded from storage into the compute layer as needed by queries. The previous section on Druid vs data warehouses also applies to Druid versus SQL-on-Hadoop solutions. Is Druid a log aggregation/log search system? When should I use Druid over Elastic/Splunk? Druid uses inverted indexes (in particular, compressed bitmaps) for fast searching and filtering, but it is not generally considered a search system. While Druid contains many features commonly found in search systems, such as the ability to stream in structured and semi-structured data and the ability to search and filter the data, Druid isn't commonly used to ingest text logs and run full text search queries over the text logs. However, Druid is often used to ingest and analyze semi-structured data such as JSON. Druid at its core is an analytics engine and as such, it can support numerical aggregations, groupBys (including multi-dimensional groupBys), and other analytic workloads faster and more efficiently than search systems. Is Druid a timeseries ...