Key Default Type Description
yarn.application-attempt-failures-validity-interval
10000 Long Time window in milliseconds which defines the number of application attempt failures when restarting the AM. Failures which fall outside of this window are not being considered. Set this value to -1 in order to count globally. See here for more information.
yarn.application-attempts
(none) String Number of ApplicationMaster restarts. Note that that the entire Flink cluster will restart and the YARN Client will loose the connection. Also, the JobManager address will change and you’ll need to set the JM host:port manually. It is recommended to leave this option at 1.
yarn.application-master.port
"0" String With this configuration option, users can specify a port, a range of ports or a list of ports for the Application Master (and JobManager) RPC port. By default we recommend using the default value (0) to let the operating system choose an appropriate port. In particular when multiple AMs are running on the same physical host, fixed port assignments prevent the AM from starting. For example when running Flink on YARN on an environment with a restrictive firewall, this option allows specifying a range of allowed ports.
yarn.application.id
(none) String The YARN application id of the running yarn cluster. This is the YARN cluster where the pipeline is going to be executed.
yarn.application.name
(none) String A custom name for your YARN application.
yarn.application.node-label
(none) String Specify YARN node label for the YARN application.
yarn.application.priority
-1 Integer A non-negative integer indicating the priority for submitting a Flink YARN application. It will only take effect if YARN priority scheduling setting is enabled. Larger integer corresponds with higher priority. If priority is negative or set to '-1'(default), Flink will unset yarn priority setting and use cluster default priority. Please refer to YARN's official documentation for specific settings required to enable priority scheduling for the targeted YARN version.
yarn.application.queue
(none) String The YARN queue on which to put the current pipeline.
yarn.application.type
(none) String A custom type for your YARN application..
yarn.appmaster.rpc.address
(none) String The hostname or address where the application master RPC system is listening.
yarn.appmaster.rpc.port
-1 Integer The port where the application master RPC system is listening.
yarn.appmaster.vcores
1 Integer The number of virtual cores (vcores) used by YARN application master.
yarn.containers.vcores
-1 Integer The number of virtual cores (vcores) per YARN container. By default, the number of vcores is set to the number of slots per TaskManager, if set, or to 1, otherwise. In order for this parameter to be used your cluster must have CPU scheduling enabled. You can do this by setting the `org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler`.
yarn.flink-dist-jar
(none) String The location of the Flink dist jar.
yarn.heartbeat.container-request-interval
500 Integer Time between heartbeats with the ResourceManager in milliseconds if Flink requests containers:
  • The lower this value is, the faster Flink will get notified about container allocations since requests and allocations are transmitted via heartbeats.
  • The lower this value is, the more excessive containers might get allocated which will eventually be released but put pressure on Yarn.
If you observe too many container allocations on the ResourceManager, then it is recommended to increase this value. See this link for more information.
yarn.heartbeat.interval
5 Integer Time between heartbeats with the ResourceManager in seconds.
yarn.maximum-failed-containers
(none) String Maximum number of containers the system is going to reallocate in case of a failure.
yarn.per-job-cluster.include-user-jar
"ORDER" String Defines whether user-jars are included in the system class path for per-job-clusters as well as their positioning in the path. They can be positioned at the beginning ("FIRST"), at the end ("LAST"), or be positioned based on their name ("ORDER"). "DISABLED" means the user-jars are excluded from the system class path.
yarn.properties-file.location
(none) String When a Flink job is submitted to YARN, the JobManager’s host and the number of available processing slots is written into a properties file, so that the Flink client is able to pick those details up. This configuration parameter allows changing the default location of that file (for example for environments sharing a Flink installation between users).
yarn.ship-directories
(none) List<String> A semicolon-separated list of directories to be shipped to the YARN cluster.
yarn.tags
(none) String A comma-separated list of tags to apply to the Flink YARN application.