PySparkLogger([name])

Custom logging.Logger wrapper for PySpark that logs messages in a structured JSON format.

PySparkLogger.getLogger([name])

Return a PySparkLogger with the specified name, creating it if necessary.

PySparkLogger.addHandler(handler)

Add the specified handler to this logger in structured JSON format.

PySparkLogger.info(msg, *args, **kwargs)

Log 'msg % args' with severity 'INFO' in structured JSON format.

PySparkLogger.warning(msg, *args, **kwargs)

Log 'msg % args' with severity 'WARNING' in structured JSON format.

PySparkLogger.error(msg, *args, **kwargs)

Log 'msg % args' with severity 'ERROR' in structured JSON format.

PySparkLogger.exception(msg, *args[, exc_info])

Convenience method for logging an ERROR with exception information.