kafka consumer erlang client
###Config
kafka_brokers %%used to define kafka brokers {ip, port}
auto_offset_largest %%default value is largest, you can find the specified meaning in kafka wiki page
cluster_info %%this defines the kafka consumers cluster info.
%%you can set different erlang vm to consumer diffrent topics or both
msg_callback %%this is the thing you should to do for each message fetched from kafka.
%%the default action is to lager:notice to file
###TODO
- auto multiple erlang nodes coordinate partitions
- auto offset reset
- auto start/stop workers based on kafka broker down/up/add/remove/change
- skip messages for partitions
- change kafka brokers dynamicly
- auto config reload