Makigami
High-Performance Log Search for Low-Speed Storage
Achieve fast log searches on HDDs through sequential read optimization and efficient indexing.
Learn More
High-Performance Log Search for Low-Speed Storage
Achieve fast log searches on HDDs through sequential read optimization and efficient indexing.
Learn MoreDownload the latest binaries for your platform and start optimizing your log searches today.
Fast search performance even on low-speed storage through sequential read optimization
Only 0.5% of original log file size, minimizing storage overhead
Seamlessly integrates with grep, awk, and other command-line tools
mg build LOG_FILE
Creates a compressed .zstd file and a tiny .mg index file
mg search -z LOG_FILE.zstd -i LOG_FILE.mg "search string"
Quickly finds text blocks containing your search string
mg search ... | grep pattern | awk '{print $1}'
Pipe output to your favorite command-line tools
Named after the Japanese word for "scroll paper" (巻紙), Makigami processes logs sequentially, similar to unrolling a scroll. This approach, combined with efficient indexing, enables high-performance searches even on low-speed storage.
Unlike traditional SIEM solutions that require high-performance storage, Makigami works efficiently with HDDs by utilizing sequential reads and intelligent index-based skipping.
Makigami is designed to outperform traditional log search tools, especially on HDDs.
| Tool | Storage Type | Log Size | Search Time |
|---|---|---|---|
| Makigami + grep | HDD(500MB/s in seq.) | 200GB | 5.493s |
| Traditional(zstd -d -c | grep) | HDD(500MB/s in seq.) | 200GB | 3m37.581s |
A: Yes, but its sequential read optimization is designed to maximize HDD performance.
A: Maybe yes. Currently it's tested on Linux and Mac. Not for Windows.