Search Kafka for specific content

Usage scenario

  • Actor: Regulatory compliance specialist or anyone tasked with compliance verification
  • Context: In production environment Kafka topics may contain sensitive or personally identifiable information
  • Goal: Verify that the company follows the laws and regulations governing information management in its business

Governments demand compliance with an ever-increasing list of intersecting laws and regulations that pertain to information security and privacy.

Apache Kafka topics can potentially contain large amount of business-related information which can be hard to observe, and even harder to search for specific type of data.

Kafka Magic allows creation of very precise, sophisticated search queries using familiar JavaScript language, providing reliable tool for monitoring large Kafka topics for pieces of sensitive or personally identifiable information. Automation engine allows saving and running verification scripts at regular intervals.

See details in Query Topics and Automation sections.

Kafka Magic: Query Topics using JavaScript