script:

- cd nginx

- auto/configure --with-debug --with-stream --with-ld-opt="-Wl,-E" --prefix=$NGINX_PREFIX --without-http_gzip_module --add-module=$PWD/.. > build.log 2>&1 || (cat build.log && exit 1)

- cat objs/ngx_modules.c | awk '{ sub("\"ngx_http_json_log_module\",", ""); sub("\"ngx_http_header_filter_module\"", "\"ngx_http_json_log_module\", \"ngx_http_header_filter_module\""); print}' > objs/ngx_modules.c.dat && mv objs/ngx_modules.c.dat objs/ngx_modules.c

- make -j$JOBS > build.log 2>&1 || (cat build.log && exit 1)

- sudo make install > build.log 2>&1 || (cat build.log && exit 1)

- cd ..

nginx modules for logging in custom json format - aka kasha (🍲)

Current version released is 0.0.7.

Current version released is 0.0.8.

Stream logging is only available when using nginx (>= 1.11.2).

The $request_id is only available for nginx (>=1.11.0).

Nginx will short circuit response if the client sends a Bad Request. In that case, the log handler will not be run.

In order to, capture and log these requests we can define at server level, a format and output location for this requests.

The directives json_err_log_* (same suffixes as the directives for location logging), should be used for this case.

Additionally, the variable $http_json_err_log_req will be set with a base64 encodede string for the data sent from the client, until the limit set by **http_json_log_req_body_limit** is reached.

```

The value of key of type `string` can be encoded in 3 ways.

To change the encoding output this should be configured per output key by specifying the encoding after a "|" character.

For instance for `base64` output the key should be like this `key|base64`

The default encoding is *plain* when no encoding is supplied.

* plain

* base64

* hex

* hexdump

Format example:

json_log_format body_log '

http.req.body_plain $http_json_log_req_body;

http.req.body_hex|hex $http_json_log_req_body;

http.req.body_hexdump|hexdump $http_json_log_req_body;

http.req.body_base64|base64 $http_json_log_req_body;

';

* Syntax: **http_json_log_req_body_limit** _size_;

* Default: 512

* Context: http local

Limits the body size to log.

Argument is a size string. May be 1k or 1M, but avoid this!

* Syntax: **json_err_log_format** _format_name_ { _format_ } _if_=...;

* Default: —

* Context: http main

* Syntax: **json_err_log** _location_ _format_name_

* Default: —

* Context: http server

* Syntax: **json_err_log_kafka_brokers** list of brokers separated by spaces;

* Default: —

* Context: http main

* Syntax: **json_err_log_kafka_client_id** _id_;

* Default: nginx

* Context: http server

* Syntax: **json_err_log_kafka_compression** _compression_codec_;

* Default: snappy

* Context: http server

* Syntax: **json_err_log_kafka_max_retries** _numeric_;

* Default: 0

* Context: http main

* Syntax: **json_err_log_kafka_log_level** _numeric_log_level_;

* Default: 6

* Context: http server

* Syntax: **json_err_log_kafka_buffer_max_messages** _numeric_;

* Default: 100000

* Context: http main

* Syntax: **json_err_log_kafka_backoff_ms** _numeric_;

* Default: 10

* Context: http main

* Syntax: **json_err_log_kafka_partition** _partition_;

* Default: RD_KAFKA_PARTITION_UA

* Context: http main

Log request body encoded as base64.

It requires proxy_pass configuration at logging location.

It requires proxy_pass configuration at logging location.

Creates a json object with available response headers.

Build as a common nginx module.

After configure we need to modify the default order of the modules.

$ ./configure --add-module=/build/ngx_json_log

$ cat objs/ngx_modules.c | awk '{ sub("\"ngx_http_json_log_module\",", ""); sub("\"ngx_http_header_filter_module\"", "\"ngx_http_json_log_module\", \"ngx_http_header_filter_module\""); print}' > objs/ngx_modules.c.dat && mv objs/ngx_modules.c.dat objs/ngx_modules.c

$ make && make install

NGINX_VERSION=`grep version src/core/nginx.h | sed 's/#define nginx_version *//;'`

if [ ! -z "${NGINX_VERSION}" ]

then

if [ $NGINX_VERSION -gt 1011002 ]

then

STREAM_MODULES="$STREAM_MODULES ngx_stream_json_log_module"

STREAM_MODULES="$STREAM_MODULES ngx_stream_json_log_preread_module"

NGX_ADDON_SRCS="$NGX_ADDON_SRCS \

$ngx_addon_dir/src/ngx_stream_json_log_preread_module.c \

$ngx_addon_dir/src/ngx_stream_json_log_module.c"

echo " + ngx_json_log: stream support"

fi

fi

HTTP_MODULES="$HTTP_MODULES ngx_http_json_log_module"

HTTP_FILTER_MODULES="$HTTP_FILTER_MODULES ngx_http_json_log_filter_module"

CORE_INCS="$CORE_INCS $ngx_module_incs"

NGX_ADDON_SRCS="$NGX_ADDON_SRCS \

$ngx_addon_dir/src/ngx_json_log_str.c \

$ngx_addon_dir/src/ngx_json_log_text.c \

$ngx_addon_dir/src/ngx_json_log_output.c \

$ngx_addon_dir/src/ngx_http_json_log_variables.c \

$ngx_addon_dir/src/ngx_http_json_log_filter_module.c \

$ngx_addon_dir/src/ngx_http_json_log_module.c \

"

NGX_ADDON_SRCS="$NGX_ADDON_SRCS $ngx_addon_dir/src/ngx_http_json_log_module.c"

STREAM_MODULES="$STREAM_MODULES ngx_stream_json_log_module"

HTTP_AUX_FILTER_MODULES="$HTTP_AUX_FILTER_MODULES ngx_http_json_log_module"

#

# rdkafka

if [ $ngx_found = yes ]; then

echo " + ngx_json_log: kafka support"

NGX_ADDON_SRCS="$NGX_ADDON_SRCS $ngx_addon_dir/src/ngx_json_log_kafka.c"

CORE_LIBS="$CORE_LIBS $ngx_feature_libs"

fi

CORE_LIBS="$CORE_LIBS -ljansson"

have_stream="0"

case $NGX_CONFIGURE in

*"--with-stream"*)

STREAM_MODULES="$STREAM_MODULES ngx_stream_json_log_module";

echo " + ngx_json_log: stream support"

have_stream="1"

;;

esac

have="NGX_HAVE_STREAM"

value=$have_stream

. auto/define

RUN apk add --no-cache perl-dev

RUN auto/configure --with-cc=/usr/bin/gcc --add-module=/build/nginx-json-log --with-debug --with-mail --with-stream --with-ld-opt="-Wl,-E"

RUN cat objs/ngx_modules.c | awk '{ sub("\"ngx_http_json_log_module\",", ""); sub("\"ngx_http_header_filter_module\"", "\"ngx_http_json_log_module\", \"ngx_http_header_filter_module\""); print}' > objs/ngx_modules.c.dat && mv objs/ngx_modules.c.dat objs/ngx_modules.c

RUN make install

COPY nginx.conf /usr/local/nginx/conf/nginx.conf