Batch Ingestion in Druid, Example less than 1 minute read
read more
Apache Druid Tutorial in Docker 6 minute read

πŸ”—Druid Tutorial in Docker 원본 좜처

μ΅œλŒ€ν•œ κ°œλ°œν™˜κ²½μ— μ œμ•½μ‚¬ν•­ 없이 μ‹€ν–‰ν•˜κΈ° μœ„ν•΄μ„œ Docker Compose둜 μ‹€ν–‰ν•΄λ΄€μŠ΅λ‹ˆλ‹€.

Docker compose YAML

πŸ”—Apache Druid 24.0.0, Docker compose YAML

version: "2.2"volumes: metadata_data: {} middle_var: {} historical_var: {} broker_var: {} coordinator_var: {} router_var: {} druid_shared: {}services: postgres: container_name: postgres image: postgres:latest volumes: - metadata_data:/var/lib/postgresql/data environment: - POSTGRES_PASSWORD=FoolishPassword  read more
What is Druid? 5 minute read

Druid μ†Œκ°œ

OLAP을 μœ„ν•΄ μ„€κ³„λœ μ‹€μ‹œκ°„ 데이터 λΆ„μ„μš© λ°μ΄ν„°λ² μ΄μŠ€.

  • 클릭슀트림 뢄석
  • λ„€νŠΈμ›Œν¬ μ„±λŠ₯ λͺ¨λ‹ˆν„°λ§μ„ ν¬ν•¨ν•œ λ„€νŠΈμ›Œν¬ 뢄석
  • μ„œλ²„ λ©”νŠΈλ¦­ μ €μž₯μ†Œ
  • μ• ν”Œλ¦¬μΌ€μ΄μ…˜ μ„±λŠ₯ λ©”νŠΈλ¦­ μ €μž₯μ†Œ
  • 제쑰 데이터 λ©”νŠΈλ¦­ μ €μž₯μ†Œ
  • OLAP
  • etc.

β€œμ‹€μ‹œκ°„μœΌλ‘œ 데이터λ₯Ό λ§Œμ§€κ³  μ‘°νšŒν•  수 μžˆλŠ”κ²Œ ν•„μš”ν•΄!” 라면 λ‹€ 적용 κ°€λŠ₯ ν•˜λ‹€λŠ” λ‚΄μš©μΈ 것 κ°™μŠ΅λ‹ˆλ‹€. IoT같이 μž‘μ€ 데이터가 μ‹€μ‹œκ°„μœΌλ‘œ 무수히 μŒ“μ΄λŠ” ν™˜κ²½μ΄λΌλ©΄ μ΅œμ μ΄λΌλŠ” μƒκ°μž…λ‹ˆλ‹€.

Druid νŠΉμ§•

  1. μ—΄ μ €μž₯ ν˜•μ‹(Columar DB)
    • μ—΄ 쑰회 쿼리 속도가 크게 ν–₯μƒλ©λ‹ˆλ‹€.
  2. ν™•μž₯ κ°€λŠ₯ν•œ λΆ„μ‚° μ‹œμŠ€ν…œ
    • DruidλŠ” μˆ˜μ‹­μ• μ—μ„œ μˆ˜λ°±λŒ€κΉŒμ§€ ν΄λŸ¬μŠ€ν„°λ§ ν•  수 μžˆμŠ΅λ‹ˆλ‹€.
    • μš”κ±΄μ— λ”°λΌμ„œ ν΄λŸ¬μŠ€ν„° λ…Έλ“œ 개수λ₯Ό μ‘°μ •ν•˜λ©΄ λ©λ‹ˆλ‹€.
  3. λŒ€κ·œλͺ¨ 병렬 처리
  4. μ‹€μ‹œκ°„ λ˜λŠ” 일괄 μˆ˜μ§‘