Log Handler to ship logs to Kafka Producer. Compatible with Django.
- Install using PIP:
pip install -i https://test.pypi.org/simple/ python-logging-kafka - (Work In Progress): https://test.pypi.org/project/python-logging-kafka/
| Version | Dependency |
|---|---|
| >= 1.x | kafka-python>=2.0.0 |
- The package has a built in handler for Kafka:
from python_logging_kafka import KafkaHandler - KafkaHandler is a basic handler for sending logs to Kafka. Every record will be delivered using the exchange configured.
- Refer
python_logging_kafka/example.py
class Main:
def __init__(self):
logging.basicConfig(
format='%(asctime)s %(levelname)s %(message)s',
level=logging.INFO,
datefmt='%m/%d/%Y %I:%M:%S %p'
)
self.logger = logging.getLogger('pylog')
ch = logging.StreamHandler()
ch.setLevel(logging.INFO)
formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
ch.setFormatter(formatter)
self.logger.addHandler(ch)
f1 = logging.FileHandler("pylog.log")
self.logger.addHandler(f1)
kh = KafkaHandler('localhost:9092', "pylog")
kh.setLevel(logging.INFO)
self.logger.addHandler(kh)
def run(self):
while True:
log = input("> ")
self.logger.info(log)
if __name__ == '__main__':
main = Main()
main.run()