Known 2.2 image version issues and limitations:

• Legacy agents are not installed in 2.2 image version clusters.monitoring-agent-defaultsare not available unless theOps Agentis installed. Note: OSS metrics and logging areavailable forDataproc components.

• Logging or monitoring for third-party applications are not availableunless theOps Agentis installed.

Notes:

• 2.2.x-*-arm imagessupport only the pre-installed components and the followingoptional components. The other 2.2 optional components and allinitialization actions aren't supported:

  • Apache Hive WebHCat
  • Apache Pig (starting with2.2.75-ubuntu22-arm)
  • Docker
  • Zeppelin
  • Zookeeper (installed inhigh availability clusters;optional component in other clusters)

• The source code to image 2.2 libraries that are licensed under Reciprocaland Restricted licenses is available at the/usr/local/share/google/dataproc/third-party-sources path onDataproc cluster VMs.

• The followingHudi proceduresare known to not work on a Hudi table backed by the Cloud Storage file system:

  • run_clustering
  • run_compaction

• The default resource calculator for YARN has been changed fromDefaultResourceCalculatortoDominantResourceCalculator,which uses the dominant-resource concept to determine resource allocation,such as Memory and CPU allocation. This change impactsAutoscaler,which scales based on the dominant resource usage of the cluster.