I'm using Alluxio 2.0 to accelerate compute layer's performance.
When no query is performing, I found there are about verbose netty output appendding to $Alluxio_home/logs/master.log.
2019-11-25 10:26:32,141 DEBUG NettyServerHandler - {} {} HEADERS: streamId={} headers={} streamDependency={} weight={} exclusive={} padding={} endStream={}
2019-11-25 10:26:32,141 DEBUG NettyServerHandler - {} {} DATA: streamId={} padding={} endStream={} length={} bytes={}
Dozens of above message are appeneded to master.log each second.
Is it a normal behavior? If sure, what's it used for? For heartbeat amoung components?
I found the root cause, leave this thread here for anyone who might encounter the same problem.
The
Alluxiois usinggRPCas its RPC framework and the latter is based onnetty, the verbose output is actually fromnetty, check this thread for details.To disable the verbose output from Alluxio side, add below statement to
$Alluxio_home/conf/alluxio-site.properties:log4j.logger.io.grpc.netty.NettyServerHandler=OFFNote that modify
log4j.rootLoggerofalluxio-propetiescan't disable this verbose output.