Installation on FreeBSD

Configure Kafka topics (run on one kafka node)

doc/kafka_topics.sh

Initialize elasticsearch

curl -X PUT 'http://:9200/threatline' -d@doc/es_mapping.json

Install service file

cp doc/threatline /usr/local/etc/rc.d/threatline

Enable threatline

sysrc threatline_enable=YES sysrc threatline_agents="normalize enrich check archive"

Start threatline

service threatline start

Monitor logs

tail -f /tmp/tl_worker.log

Stages

Normalize: Touch-up/rename fields, etc. Enrich: Enrich and part of the message. Check: Checks parts of message (now enriched) against known bad stuff. Archive: Push document into elasticsearch. Can also log to file.

711 B Raw Blame History