jjzjj

SparkSubmit

全部标签

SparkSubmit object分析

org.apache.spark.deploy.SparkSubmit分析ObjectSparkSubmit类图分析结合spark的log4j来说,printStream为error,log4j的配置也是System.error,导致做日志收集的时候莫名其妙。。。。解决方案如下,采用重新构造log4j的appender:Logger.getRootLogger.removeAllAppenders()Logger.getRootLogger.setLevel(Level.INFO)valconsole=newConsoleAppender()console.setTarget("System.

SparkSubmit object分析

org.apache.spark.deploy.SparkSubmit分析ObjectSparkSubmit类图分析结合spark的log4j来说,printStream为error,log4j的配置也是System.error,导致做日志收集的时候莫名其妙。。。。解决方案如下,采用重新构造log4j的appender:Logger.getRootLogger.removeAllAppenders()Logger.getRootLogger.setLevel(Level.INFO)valconsole=newConsoleAppender()console.setTarget("System.
12