Release Notes for Storm 2.0.0

JIRA issues addressed in the 2.0.0 release of Storm. Documentation for this release is available at the Apache Storm project site.

New Feature

• [STORM-171] - Add "progress" method to OutputCollector
• [STORM-1226] - Port backtype.storm.util to java
• [STORM-1227] - port backtype.storm.config to java
• [STORM-1228] - port backtype.storm.fields-test to java
• [STORM-1229] - port backtype.storm.metric.testing to java
• [STORM-1230] - port backtype.storm.process-simulator to java
• [STORM-1231] - port backtype.storm.scheduler.EvenScheduler to java
• [STORM-1232] - port backtype.storm.scheduler.DefaultScheduler to java
• [STORM-1233] - port backtype.storm.security.auth.AuthUtils-test to java
• [STORM-1234] - port backtype.storm.security.auth.DefaultHttpCredentialsPlugin-test to java
• [STORM-1235] - port backtype.storm.security.auth.ReqContext-test to java
• [STORM-1236] - port backtype.storm.security.auth.SaslTransportPlugin-test to java
• [STORM-1237] - port backtype.storm.security.auth.ThriftClient-test to java
• [STORM-1238] - port backtype.storm.security.auth.ThriftServer-test to java
• [STORM-1239] - port backtype.storm.scheduler.IsolationScheduler to java
• [STORM-1240] - port backtype.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer-test to java
• [STORM-1242] - migrate backtype.storm.command.config-value to java
• [STORM-1243] - port backtype.storm.command.healthcheck to java
• [STORM-1244] - port backtype.storm.command.upload-credentials to java
• [STORM-1245] - port backtype.storm.daemon.acker to java
• [STORM-1246] - port backtype.storm.local-state to java
• [STORM-1247] - port backtype.storm.messaging.local to java
• [STORM-1248] - port backtype.storm.messaging.loader to java
• [STORM-1249] - port backtype.storm.security.serialization.BlowfishTupleSerializer-test to java
• [STORM-1250] - port backtype.storm.serialization-test to java
• [STORM-1251] - port backtype.storm.serialization.SerializationFactory-test to java
• [STORM-1252] - port backtype.storm.stats to java
• [STORM-1253] - port backtype.storm.timer to java
• [STORM-1254] - port backtype.storm.ui.helpers to java
• [STORM-1255] - port backtype.storm.utils-test to java
• [STORM-1256] - port backtype.storm.utils.ZookeeperServerCnxnFactory-test to java
• [STORM-1257] - port backtype.storm.zookeeper to java
• [STORM-1258] - port backtype.storm.thrift to java
• [STORM-1259] - Create Clojure API package + tests
• [STORM-1260] - port backtype.storm.command.activate to java
• [STORM-1261] - port backtype.storm.command.deactivate to java
• [STORM-1262] - port backtype.storm.command.dev-zookeeper to java
• [STORM-1263] - port backtype.storm.command.kill-topology to java
• [STORM-1264] - port backtype.storm.command.list to java
• [STORM-1265] - port backtype.storm.command.monitor to java
• [STORM-1266] - port backtype.storm.command.rebalance to java
• [STORM-1267] - port backtype.storm.command.set-log-level to java
• [STORM-1268] - port backtype.storm.daemon.builtin-metrics to java
• [STORM-1269] - port backtype.storm.daemon.common to java
• [STORM-1270] - port backtype.storm.daemon.drpc to java
• [STORM-1271] - port backtype.storm.daemon.task to java
• [STORM-1272] - port backtype.storm.disruptor to java
• [STORM-1273] - port backtype.storm.cluster to java
• [STORM-1274] - port backtype.storm.LocalDRPC to java
• [STORM-1276] - port backtype.storm.daemon.nimbus to java
• [STORM-1277] - port backtype.storm.daemon.executor to java
• [STORM-1278] - port backtype.storm.daemon.worker to java
• [STORM-1279] - port backtype.storm.daemon.supervisor to java
• [STORM-1280] - port backtype.storm.daemon.logviewer to java
• [STORM-1281] - port backtype.storm.testing to java
• [STORM-1282] - port backtype.storm.LocalCluster to java
• [STORM-1283] - port backtype.storm.MockAutoCred to java
• [STORM-1285] - port backtype.storm.command.get-errors to java
• [STORM-1286] - port backtype.storm.command.kill-workers to java
• [STORM-1289] - port backtype.storm.integration-test to java
• [STORM-1290] - port backtype.storm.local-state-test to java
• [STORM-1291] - port backtype.storm.logviewer-test to java
• [STORM-1292] - port backtype.storm.messaging-test to java
• [STORM-1294] - port backtype.storm.messaging.netty-unit-test to java
• [STORM-1300] - port backtype.storm.scheduler.resource-aware-scheduler-test to java
• [STORM-1306] - port backtype.storm.testing4j to java
• [STORM-1307] - port backtype.storm.testing4j-test to java
• [STORM-1308] - port backtype.storm.tick-tuple-test to java
• [STORM-1311] - port backtype.storm.ui.core to java
• [STORM-1312] - port backtype.storm.worker-test to java
• [STORM-1318] - Investigate if backtype.storm.command.shell-submission shuld be dropped
• [STORM-1336] - Evalute/Port JStorm cgroup support
• [STORM-1434] - Support the GROUP BY clause in StormSQL
• [STORM-1435] - Build a single jar with dependency for StormSQL dependency
• [STORM-1443] - Support customizing parallelism in StormSQL
• [STORM-1444] - Support EXPLAIN statement in StormSQL
• [STORM-1529] - Change default worker temp directory location for workers
• [STORM-1549] - Add support for extending tuple tree timeout
• [STORM-1553] - port backtype.storm.event to java
• [STORM-1611] - port org.apache.storm.pacemaker.pacemaker to java
• [STORM-1705] - Cap on number of retries for a failed message in kafka spout
• [STORM-1720] - Support GEO in storm-redis
• [STORM-1723] - Introduce ClusterMetricsConsumer
• [STORM-1893] - Support OpenTSDB for storing timeseries data.
• [STORM-1914] - Storm Kafka Field Topic Selector
• [STORM-1919] - Introduce FilterBolt on storm-redis
• [STORM-1930] - Kafka New Client API - Support for Topic Wildcards
• [STORM-2009] - port org.apache.storm.blobstore.clj and org.apache.storm.command.blobstore.clj to Java
• [STORM-2010] - port org.apache.storm.command.heartbeats.clj to Java
• [STORM-2018] - Simplify Threading Model of the Supervisor
• [STORM-2038] - Provide an alternative to using symlinks
• [STORM-2057] - Support JOIN statement in Storm SQL
• [STORM-2083] - Blacklist Scheduler
• [STORM-2139] - Let ShellBolts and ShellSpouts run with scripts from blobs
• [STORM-2170] - [Storm SQL] Add built-in socket datasource to runtime
• [STORM-2172] - [Storm SQL] Support Avro as input / output format
• [STORM-2173] - [Storm SQL] Support CSV as input / output format
• [STORM-2177] - [Storm SQL] Support TSV as input / output format
• [STORM-2204] - Add caching to HBaseLookupBolt
• [STORM-2236] - storm kafka client should support manual partition management.
• [STORM-2294] - Send activate and deactivate command from ShellSpout
• [STORM-2327] - Abstract class ConfigurableTopology
• [STORM-2344] - Flux YAML File Viewer for Nimbus UI
• [STORM-2383] - [storm-hbase] Support HBase as state backend
• [STORM-2484] - Flux: support bolt+spout memory configuration
• [STORM-2490] - Lambda support
• [STORM-2492] - Support Cassandra Object Mapper
• [STORM-2609] - We need a drpc-client command line.
• [STORM-2610] - Spout throtteling metrics are unusable
• [STORM-2648] - Kafka spout can't show acks/fails and complete latency when auto commit is enabled
• [STORM-2694] - Create a listener to handle tuple state changes of the KafkaSpout
• [STORM-2790] - Add nimbus admin groups
• [STORM-2898] - Storm should support auth through delegation tokens for workers
• [STORM-3026] - Upgrade ZK instance for security
• [STORM-3027] - Make Impersonation Optional
• [STORM-3130] - Add Timer registration and Timed object wrapper to Storm metrics util.
• [STORM-3147] - Port ClusterSummary as Metrics to StormMetricsRegistry
• [STORM-3175] - Use custom Callback in KafkaBolt
• [STORM-3232] - Display other versions of storm offered on the cluster in the UI
• [STORM-3233] - Upgrade zookeeper client to newest version (3.4.13)
• [STORM-3234] - Document Cluster Metrics

Improvement

• [STORM-515] - Clojure documentation and examples
• [STORM-621] - UI should expose more version information
• [STORM-676] - Storm Trident support for sliding/tumbling windows
• [STORM-832] - Validation for configuration settings beyond those in storm.yaml
• [STORM-971] - Storm-Kafka: Emit metric for messages lost due to kafka retention
• [STORM-1086] - Make FailedMsgRetryManager configurable when setting up KafkaSpout
• [STORM-1136] - Provide a bin script to check consumer lag from KafkaSpout to Kafka topic offsets and integrate with storm ui
• [STORM-1369] - Add trident MapState to Cassandra
• [STORM-1446] - Compile the Calcite logical plan to Storm Trident logical plan
• [STORM-1450] - Fix bugs and refactor code in ResourceAwareScheduler
• [STORM-1459] - Allow not specifying producer properties in read-only Kafka table in StormSQL
• [STORM-1464] - storm-hdfs should support writing to multiple files
• [STORM-1479] - use a simple implemention for IntSerializer
• [STORM-1511] - min/max operations on trident stream
• [STORM-1546] - Adding Read and Write Aggregations for Pacemaker to make it HA compatible
• [STORM-1569] - Allowing users to specify the nimbus thrift server queue size.
• [STORM-1570] - Support nested field lookup in Storm sql
• [STORM-1571] - Improvment Kafka Spout Time Metric
• [STORM-1574] - Better exception handling in backpressure thread, and remove backpressure dir during topology kill.
• [STORM-1590] - port defmeters/defgauge/defhistogram... to java for all of our code to use
• [STORM-1605] - storm shell script should use /bin/env python to check python version
• [STORM-1607] - Add MongoMapState for supporting trident's exactly once semantics
• [STORM-1618] - Add the option of passing config directory apart from the file
• [STORM-1624] - add maven central status in README
• [STORM-1648] - DRPCSpout should attempt reconnect if on fail it cannot reach client
• [STORM-1649] - Optimize Kryo instaces creation in HBaseWindowsStore
• [STORM-1659] - Add documents for external projects
• [STORM-1660] - remove flux gitignore file and move rules to top level gitignore
• [STORM-1664] - Allow Java users to start a local cluster with a Nimbus Thrift server
• [STORM-1671] - Enable logviewer to delete directory with no yaml file
• [STORM-1678] - abstract batch processing to common api `BatchHelper`
• [STORM-1679] - add storm Scheduler documents
• [STORM-1695] - Create trident spout that uses the new kafka consumer API
• [STORM-1701] - Add simple JSON mapping to storm-hbase
• [STORM-1709] - Add group by support in storm-sql standalone mode
• [STORM-1715] - Jedis Default Host
• [STORM-1719] - Introduce REST API: Topology metric stats for stream
• [STORM-1742] - More accurate 'complete latency'
• [STORM-1745] - Add partition to PartitionManager logs where it's missing
• [STORM-1755] - Revert the kafka client version upgrade in storm-kafka module
• [STORM-1766] - A better algorithm server rack selection for RAS
• [STORM-1833] - Add simple equi-join support in storm-sql standalone mode
• [STORM-1835] - add lock info in thread dump
• [STORM-1839] - Kinesis Spout
• [STORM-1865] - update command line client document
• [STORM-1868] - Modify TridentKafkaWordCount to run in distributed mode
• [STORM-1870] - Allow FluxShellBolt/Spout set custom "componentConfig" via yaml.
• [STORM-1873] - Reemit late tuples in windowed mode
• [STORM-1874] - Update Logger access permissions
• [STORM-1876] - Provide option to build storm-kafka against different kafka clients
• [STORM-1886] - Extend KeyValueState interface with delete method
• [STORM-1888] - add description for storm shell command
• [STORM-1890] - Employ cache-busting method to ensure newly deployed UI forces browsers to refetch scripts, templates, and CSS
• [STORM-1899] - Release HBase connection when topology shutdown
• [STORM-1902] - add a simple & flexible FileNameFormat for storm-hdfs
• [STORM-1910] - One topology can't use hdfs spout to read from two locations
• [STORM-1913] - Additions and Improvements for Trident RAS API
• [STORM-1916] - Add ability for worker-first classpath
• [STORM-1922] - Supervisor summary default order by host
• [STORM-1927] - Upgrade Jetty and Ring
• [STORM-1950] - Change response json of "Topology Lag" REST API to keyed by spoutId, topic, partition
• [STORM-1966] - Expand metric having Map type as value into multiple metrics based on entries
• [STORM-1969] - Modify HiveTopology to show usage of non-partition table
• [STORM-1970] - external project examples refator
• [STORM-1979] - Storm Druid connector implementation.
• [STORM-1994] - Add table with per-topology & worker resource usage and components in (new) supervisor and topology pages
• [STORM-2003] - Make sure config contains TOPIC before get it
• [STORM-2012] - Upgrade Kafka to 0.8.2.2
• [STORM-2014] - New Kafka spout duplicates checking if failed messages have reached max retries
• [STORM-2016] - Topology submission improvement: support adding local jars and maven artifacts on submission
• [STORM-2058] - Maven warnings about reporting.plugins.plugin.version is missing
• [STORM-2063] - Add thread name in worker logs
• [STORM-2072] - Add map, flatMap with different outputs (T->V) in Trident
• [STORM-2078] - Enable paging in worker data tables
• [STORM-2081] - create external directory for storm-sql various data sources and move storm-sql-kafka to it
• [STORM-2082] - add sql external module storm-sql-hdfs
• [STORM-2084] - after supervisor v2 merge async localizer and localizer
• [STORM-2086] - use DefaultTopicSelector instead of creating a new one
• [STORM-2089] - Replace Consumer of ISqlTridentDataSource with StateFactory and StateUpdater
• [STORM-2092] - optimize TridentKafkaState batch sending
• [STORM-2097] - Improve logging in trident core and examples
• [STORM-2099] - Introduce new sql external module: storm-sql-redis
• [STORM-2103] - Introduce new sql external module: storm-sql-mongodb
• [STORM-2105] - Cluster/Supervisor total and available resources displayed in the UI
• [STORM-2122] - Supervisor V2 can use a lot more memory
• [STORM-2124] - Show requested cpu/memory for each component on topology and component page
• [STORM-2125] - Use Calcite's implementation of Rex Compiler
• [STORM-2127] - Storm-eventhubs should use latest amqp and eventhubs-client versions
• [STORM-2133] - Page-rendered-at timestamp visible on the UI
• [STORM-2134] - improving the current scheduling strategy for RAS
• [STORM-2145] - Leave leader nimbus's hostname to log when trying to connect leader nimbus
• [STORM-2148] - [Storm SQL] Trident mode: back to code generate and compile Trident topology
• [STORM-2182] - Refactor Storm Kafka Examples Into Own Modules
• [STORM-2188] - It can be difficult to tell which thread is hanging when an executor fails to shut down in time in local mode
• [STORM-2192] - Add a new IAutoCredentials plugin to support SSL files
• [STORM-2201] - Dynamic scheduler configuration loader
• [STORM-2203] - Add a getAll method to KeyValueState interface
• [STORM-2206] - Topology Visualization revamp / swap underlying JS graphing library
• [STORM-2212] - Remove Redundant Declarations in Maven POM Files
• [STORM-2214] - Cache Kerberos tickets for long lived Daemons
• [STORM-2215] - Check that blobs are present before launching a topology
• [STORM-2216] - Favor JSONValue.parseWithException
• [STORM-2217] - Finish porting drpc to java
• [STORM-2220] - Adding config keys for CassandraBolts instead of taking at topology level configuration.
• [STORM-2223] - Storm PMML Bolt
• [STORM-2224] - Expose a method to override in computing the field from given tuple in FieldSelector
• [STORM-2225] - Kafka New API make simple things simple
• [STORM-2235] - Introduce new option: 'add remote repositories' for dependency resolver
• [STORM-2238] - Add Timestamp extractor for windowed bolt
• [STORM-2243] - Add ip address to supervisor id for easier debugging
• [STORM-2250] - Kafka Spout Refactoring to Increase Modularity and Testability
• [STORM-2277] - Add shaded jar for Druid connector
• [STORM-2278] - Allow max number of disruptor queue flusher threads to be configurable.
• [STORM-2280] - Upgrade Calcite version to 1.11.0
• [STORM-2296] - Kafka spout - no duplicates on topic leader changes
• [STORM-2297] - [storm-opentsdb] Support Flux for OpenTSDBBolt
• [STORM-2298] - Don't kill Nimbus when ClusterMetricsConsumer is failed to initialize
• [STORM-2300] - [Flux] support list of references
• [STORM-2301] - [storm-cassandra] upgrade cassandra driver to 3.1.2
• [STORM-2317] - Once STORM-2225 goes in remove deprecated classes from master
• [STORM-2333] - CGroup Metrics
• [STORM-2340] - fix AutoCommitMode issue in KafkaSpout
• [STORM-2363] - Provide configuration to set the number of RollingWindow
• [STORM-2365] - Support for specifying output stream in event hubs spout
• [STORM-2369] - [storm-redis] Use binary type for State management
• [STORM-2379] - [storm-elasticsearch] switch ES client to Java REST API
• [STORM-2381] - Add logging of JDBC connection string in storm-jdbc integration for debugging failures
• [STORM-2406] - [Storm SQL] Change underlying API to Streams API (for 2.0.0)
• [STORM-2416] - Release Packaging Improvements
• [STORM-2421] - Support lists of childopts beyond just worker
• [STORM-2438] - on-demand resource requirement scaling
• [STORM-2441] - Break down 'storm-core' to extract client (worker) artifacts
• [STORM-2447] - Make local cluster transparent
• [STORM-2448] - Support running workers using older JVMs/storm versions
• [STORM-2453] - Move non-connectors into the top directory
• [STORM-2455] - Expose the window start and end timestamp in TupleWindow
• [STORM-2458] - Kafka Spout should allow hooking up custom logic when retries have exhanusted
• [STORM-2468] - Remove Clojure from storm-client
• [STORM-2471] - Metric for thread count in a worker
• [STORM-2477] - Configs should have generics
• [STORM-2481] - Upgrade Aether version to resolve Aether bug BUG-451566
• [STORM-2482] - Refactor the Storm auto credential plugins to be more usable
• [STORM-2491] - Missing various configuration parameters to configure the Cassandra client used by the Cassandra Bolts
• [STORM-2493] - update documents to reflect the changes
• [STORM-2495] - Integrate checkstyle check during build
• [STORM-2497] - Support Shared Memory Scheduling in RAS
• [STORM-2501] - Implement auto credential plugin for Hive
• [STORM-2510] - adjust checkstyle configurations to decrease violations
• [STORM-2512] - Change KafkaSpoutConfig in storm-kafka-client to make it work with flux
• [STORM-2515] - Fix most checkstyle violations for storm-kafka-client
• [STORM-2519] - AbstractAutoCreds should look for configKeys in both nimbus and topology configs
• [STORM-2524] - Set Kafka client.id with storm-kafka
• [STORM-2527] - Initialize java.sql.DriverManager earlier to avoid deadlock between DriverManager static initializer and driver static initializer
• [STORM-2528] - Bump log4j version to 2.8.2
• [STORM-2537] - Resolve checkstyle violations in storm-webapp module
• [STORM-2542] - Deprecate storm-kafka-client KafkaConsumer.subscribe API subscriptions on 1.x and remove them as options in 2.x
• [STORM-2543] - Allow Topologies to query current version of downloaded blobs
• [STORM-2548] - Simplify KafkaSpoutConfig
• [STORM-2551] - Thrift client socket timeout
• [STORM-2553] - JedisCluster does not support password
• [STORM-2556] - Break down Auto* classes into Nimbus plugin and Worker / Submitter plugin
• [STORM-2598] - Add proxy server option for dependency resolver
• [STORM-2601] - the method of getting the nimbus cilent doenot accept timeout parameter
• [STORM-2614] - Enhance stateful windowing to persist the window state
• [STORM-2615] - Improvements for access to topology
• [STORM-2616] - Document the built in metrics (just in time to replace them???)
• [STORM-2618] - Add TridentKafkaStateUpdater for storm-kafka-client
• [STORM-2622] - Add owner resource summary
• [STORM-2623] - Add in a whitelist for scheduler strategies
• [STORM-2626] - Provided a template for drpc-auth-acl.yaml
• [STORM-2630] - Apply new code style to storm-sql-hdfs
• [STORM-2631] - Apply new code style to storm-sql-mongodb
• [STORM-2632] - Apply new code style to storm-sql-kafka
• [STORM-2633] - Apply new code style to storm-sql-redis
• [STORM-2634] - Apply new code style to storm-sql-runtime
• [STORM-2643] - Add a confirmation dialog for profiling and debugging actions on Storm UI
• [STORM-2644] - Show message when result not found on deep search page
• [STORM-2649] - Update config validation check to give better information
• [STORM-2650] - Add test for non-string property substitution in Flux tests
• [STORM-2653] - PaceMaker code improvement
• [STORM-2654] - Error column in Storm UI loses original formatting
• [STORM-2657] - Update SECURITY.MD
• [STORM-2658] - Provide storm-kafka-client spout examples
• [STORM-2664] - Fix for the distribution packaged on Windows OS can't run on Linux
• [STORM-2671] - For the love of all that is good remove storm-rename-hack
• [STORM-2672] - Expose a metric for calls to reportError()
• [STORM-2673] - For debugging allow users to tell the scheduler which nodes they would prefer
• [STORM-2679] - Need to close resources and streams after use
• [STORM-2689] - storm-kafka-examples and storm-kafka-client-examples are difficult for new users to run
• [STORM-2693] - Topology submission or kill takes too much time when topologies grow to a few hundred
• [STORM-2698] - Upgrade to newest Mockito and Hamcrest versions
• [STORM-2699] - Put all the version information of third party components into the main pom
• [STORM-2702] - Better load generation testing tools
• [STORM-2712] - accept arbitrary number of rows per tuple in storm-cassandra
• [STORM-2717] - Output topology Id from storm list command
• [STORM-2718] - Show some descriptions on LogViewer index page
• [STORM-2730] - Add in config options for acker cpu and memory
• [STORM-2731] - Simple checks in Storm Windowing
• [STORM-2740] - Add caching of some blobs in nimbus to improve performance
• [STORM-2741] - Add in config options for metrics consumer cpu and memory
• [STORM-2743] - Add logging to monitor how long scheduling is taking
• [STORM-2744] - Add in "restart timeout" for backpressure
• [STORM-2759] - Let users indicate if a worker should restart on blob download
• [STORM-2760] - Add Blobstore Migration Scripts
• [STORM-2767] - Surefire now truncates too much of the stack trace
• [STORM-2770] - Add fragmentation metrics for CPU and Memory
• [STORM-2775] - Improve KafkaPartition Metric Names
• [STORM-2781] - Refactor storm-kafka-client KafkaSpout Processing Guarantees
• [STORM-2782] - Refactor partial key grouping for greater flexibility
• [STORM-2791] - Add support for multiple output fields to FixedTupleSpout
• [STORM-2792] - Clean up RAS and remove possible loops
• [STORM-2793] - Add transferred byte count metrics
• [STORM-2796] - Flux: Provide means for invoking static factory methods and improve non-primitive number handling
• [STORM-2805] - Clean up configs in topology builders
• [STORM-2806] - Give users the option to disable the login cache
• [STORM-2807] - Integration test should shut down topologies immediately after the test
• [STORM-2813] - Clean up RAS resource Map.
• [STORM-2832] - misuse of Utils.readStormConfig() and ConfigUtils.readStormConfig()
• [STORM-2837] - RAS Constraint Solver Strategy
• [STORM-2842] - Fixed links for YARN&Kubernetes Integration
• [STORM-2854] - Expose IEventLogger to make event logging pluggable
• [STORM-2857] - Loosen some constraints on validation to support running topologies of older version
• [STORM-2860] - Add Kerberos support to Solr bolt
• [STORM-2862] - More flexible logging in multilang (Python, Ruby, JS)
• [STORM-2864] - Minor optimisation about trident kafka state
• [STORM-2867] - Add Consumer lag metrics to Kafka Spout
• [STORM-2877] - Introduce an option to configure pagination in Storm UI
• [STORM-2891] - Upgrade Checkstyle plugin to version 3.0.0
• [STORM-2896] - Support automatic migration of offsets from storm-kafka to storm-kafka-client KafkaSpout
• [STORM-2897] - Optimize defaults.yaml by removing the zeromq configurations and adding some annotations
• [STORM-2899] - Remove/replace the contributors lists in the README and on https://storm.apache.org/contribute/People.html
• [STORM-2901] - Reuse ZK connection for getKeySequenceNumber
• [STORM-2902] - Some improvements for storm-rocketmq module
• [STORM-2909] - New Metrics Reporting API - for 2.0.0
• [STORM-2914] - Remove enable.auto.commit support from storm-kafka-client
• [STORM-2916] - Separate hdfs-blobstore from storm-hdfs
• [STORM-2917] - Check the config(nimbus.host) before using it to connect
• [STORM-2933] - Add a storm-perf topology that uses storm-kafka-client, so we can benchmark that module
• [STORM-2939] - Create interface for processing worker metrics
• [STORM-2948] - Add -XX:+HeapDumpOnOutOfMemoryError for maven-surefire-plugin in pom.xml
• [STORM-2958] - Use new wait strategies for Spout as well
• [STORM-2961] - Refactoring duplicate code in Topology Builder classes
• [STORM-2977] - Update the BlowfishTupleSerializer to make it simpler to use
• [STORM-2990] - Make the storm-kafka-client Trident spout FirstPollOffsetStrategy behavior consistent with the regular spout
• [STORM-2997] - Add logviewer ssl module in SECURITY.md
• [STORM-2998] - Wrong className in LoggerFactory.getLogger method
• [STORM-3006] - Distributed RPC documentation needs an update
• [STORM-3011] - Use default bin path in flight.bash if $JAVA_HOME is undefined
• [STORM-3017] - Refactor pacemaker code
• [STORM-3022] - Decouple storm-hive UTs with Hive
• [STORM-3025] - Optimize Scheduler Loopy loops with Caching in Cluster State
• [STORM-3029] - Don't use keytab if AutoTGT is used
• [STORM-3036] - Add isRemoteBlobExists RPC interface for deciding if remote blob exists
• [STORM-3037] - Improve CheckStyle code compatibility
• [STORM-3039] - Ports of killed topologies remain in TIME_WAIT state preventing to start new topology
• [STORM-3040] - RAS scheduling performance improvements
• [STORM-3041] - worker-launcher setup is confusing
• [STORM-3044] - AutoTGT should ideally check if a TGT is specific to IP addresses and reject
• [STORM-3061] - Upgrade Dependencies before 2.x release
• [STORM-3064] - PartitionedTridentSpoutExecutor should use getPartitionsForTask
• [STORM-3069] - Allow users to specify maven local repository directory for storm submit tool
• [STORM-3083] - Upgrade HikariCP version to 2.4.7
• [STORM-3093] - Cache the storm id to executors mapping on master to avoid repeat computation
• [STORM-3094] - Topology name needs to be validated at storm-client
• [STORM-3099] - Extend metrics on supervisor, workers, and DRPC
• [STORM-3115] - Add admin command to get a zookeeper shell
• [STORM-3125] - Refactoring methods in components for Supervisor and DRPC
• [STORM-3131] - Support hostname-substitution for blobstore.hdfs.principal
• [STORM-3133] - Extend metrics on Nimbus and LogViewer
• [STORM-3134] - upload-credentials imporvements
• [STORM-3138] - dev-zookeeper logging to stdout is annoying
• [STORM-3142] - Add support for JUnit 5 tests
• [STORM-3150] - Improve Gauge Registration in StormMetricsRegistry
• [STORM-3157] - General improvement to StormMetricsRegistry
• [STORM-3196] - 'storm list' should include topology owner in output
• [STORM-3198] - Topology submitters should be able to supply log4j2 configurations
• [STORM-3205] - Optimization in TuplImpl
• [STORM-3222] - Fix KafkaSpout internals to use LinkedList instead of ArrayList
• [STORM-3226] - Improve Supervisor authorization handler error message
• [STORM-3227] - Improve security of credentials push
• [STORM-3229] - Better error reporting in WorkerTokenAuthorizer
• [STORM-3242] - Example and External maven modules in their own profiles
• [STORM-3243] - Clean up Maven POM dependency on clojure
• [STORM-3258] - prevent flooding supervisor log with blobstore location
• [STORM-3260] - Add in more admin commands to debug cluster state
• [STORM-3263] - Memory and CPU guarantee columns do not sort correctly in Owner Summary
• [STORM-3274] - Ensure Python 3 and 2.7 compatibility for all scripts (disallow 2.6)
• [STORM-3292] - Trident HiveState must flush writers when the batch commits
• [STORM-3318] - Complete information in Class NewKafkaSpoutOffsetQuery
• [STORM-3325] - Storm-webapp should not be part of Externals on travis
• [STORM-3326] - FakeMetricsConsumer exposes internal lists, causing ConcurrentModificationException
• [STORM-3335] - timeout when scheduling topology runs too long
• [STORM-3342] - Add plugin to generate list of dependency licenses to build
• [STORM-3344] - blacklist scheduler causing nimbus restart
• [STORM-3347] - Storm-starter should not suggest using maven-exec-plugin
• [STORM-3355] - Make force kill delay for workers follow the supervisor's SUPERVISOR_WORKER_SHUTDOWN_SLEEP_SECS
• [STORM-3361] - Add output of license plugin to git and distributions
• [STORM-3363] - Migrate Aether to maven-resolver as Aether was brought to ASF as a subproject of Apache Maven
• [STORM-3365] - Configuration to disable Topology lag monitoring
• [STORM-3366] - Workers with low CPU may fail to start in Cgroups or docker containers
• [STORM-3374] - StormClientHandler exceptionCaught() log message does not warrant callstack

Bug

• [STORM-203] - Add /usr/lib64 in default java library path
• [STORM-584] - LoggingMetricsConsumer metrics.log file is shared by multiple topologies.
• [STORM-1114] - Racing condition in trident zookeeper zk-node create/delete
• [STORM-1344] - storm-jdbc build error "object name already exists: USER_DETAILS in statement"
• [STORM-1363] - TridentKafkaState should handle null values from TridentTupleToKafkaMapper.getMessageFromTuple()
• [STORM-1476] - Filter -c options from args and add them as part of storm.options
• [STORM-1481] - avoid Math.abs(Integer) get a negative value
• [STORM-1492] - With nimbus.seeds set to default, a nimbus for localhost may appear "Offline"
• [STORM-1516] - Topology workers are not getting killed when a topology is killed.
• [STORM-1521] - When using Kerberos login from keytab with multiple bolts/executors ticket is not renewed
• [STORM-1522] - REST API throws invalid worker log links.
• [STORM-1528] - Fix CsvPreparableReporter log directory
• [STORM-1530] - Add API doc for minBy/min/max/maxBy operations on stream
• [STORM-1532] - Fix readCommandLineOpts to parse JSON correctly
• [STORM-1535] - Storm-HDFS - When using keytab Kerberos ticket is not renewed with multiple bolts/executors
• [STORM-1538] - Exception being thrown after Utils conversion to java
• [STORM-1541] - Change scope of 'hadoop-minicluster' to test
• [STORM-1543] - DRPCSpout should always try to reconnect disconnected DRPCInvocationsClient
• [STORM-1544] - Document Debug/Sampling of Topologies
• [STORM-1545] - Topology Debug Event Log in Wrong Location
• [STORM-1556] - nimbus.clj/wait-for-desired-code-replication wrong reset for current-replication-count-jar in local mode
• [STORM-1558] - Utils in java breaks component page due to illegal type cast
• [STORM-1561] - Supervisor should relaunch worker if assignments have changed
• [STORM-1564] - fix wrong package-info in org.apache.storm.utils.staticmocking
• [STORM-1566] - Worker exits with error o.a.s.d.worker [ERROR] Error on initialization of server mk-worker java.lang.ClassCastException: java.lang.String cannot be cast to java.io.File
• [STORM-1567] - in defaults.yaml 'topology.disable.loadaware' should be 'topology.disable.loadaware.messaging'
• [STORM-1572] - throw NPE when parsing the command line arguments by CLI
• [STORM-1575] - TwitterSampleSpout throws NPE on close
• [STORM-1578] - ClassCastException from Integer to Long for "port" in cluster.clj translation
• [STORM-1579] - Got NoSuchFileException when running tests in storm-core
• [STORM-1588] - component page gets divide by 0 if no event loggers configured
• [STORM-1592] - clojure code calling into Utils.exitProcess throws ClassCastException
• [STORM-1594] - org.apache.storm.tuple.Fields can throw NPE if given invalid field in selector
• [STORM-1596] - Multiple Subject sharing Kerberos TGT - causes services to fail
• [STORM-1608] - Fix stateful topology acking behavior
• [STORM-1609] - Netty Client is not best effort delivery on failed Connection
• [STORM-1614] - Clean backpressure zk node in do-cleanup
• [STORM-1615] - Update state checkpointing doc with bolt's acking contract
• [STORM-1623] - nimbus.clj's minor bug
• [STORM-1625] - Move storm-sql dependencies out of lib folder
• [STORM-1631] - storm CGroup bugs 1) when launching workers as the user that submitted the topology 2) when initial cleanup of cgroup fails
• [STORM-1636] - Supervisor shutdown with worker id pass in being nil
• [STORM-1642] - NullPointerException when deserialize
• [STORM-1646] - Intermittent test failures in storm-kafka unit tests
• [STORM-1658] - documents improvements and links fixes
• [STORM-1663] - Clicking on an active topology from storm ui home page and then refreshing the page throws exception
• [STORM-1665] - Worker cannot instantiate kryo
• [STORM-1666] - Kill from the UI fails silently.
• [STORM-1669] - Fix SolrUpdateBolt flush bug
• [STORM-1670] - LocalState#get(String) can throw FileNotFoundException which results in not removing worker heartbeats and supervisor is kind of stuck and goes down after some time.
• [STORM-1672] - Stats not get class cast exception
• [STORM-1673] - log4j2/worker.xml refers old package of LoggerMetricsConsumer
• [STORM-1674] - Idle KafkaSpout consumes more bandwidth than needed
• [STORM-1676] - NullPointerException while serializing ClusterWorkerHearbeat
• [STORM-1677] - Test resource files (.log) are excluded from source distribution, which makes logviewer-test failing
• [STORM-1681] - Bug in scheduling cyclic topologies when scheduling with RAS
• [STORM-1687] - Divide by zero exception in stats
• [STORM-1694] - Kafka Spout Trident Implementation Using New Kafka Consumer API
• [STORM-1696] - Backpressure flag not sync if zookeeper connection errors
• [STORM-1713] - Don't use proprietary NotImplementedException in storm-kafka
• [STORM-1728] - TransactionalTridentKafkaSpout error
• [STORM-1730] - LocalCluster#shutdown() does not terminate all storm threads/thread pools.
• [STORM-1733] - Logs from bin/storm are lost because stdout and stderr are not flushed
• [STORM-1735] - Nimbus logs that replication was not reached when min-replication-count was reached exactly
• [STORM-1737] - storm-kafka-client has compilation errors with Apache Kafka 0.10
• [STORM-1749] - Fix storm-starter links in the github code
• [STORM-1750] - Report-error-and-die may not kill the worker
• [STORM-1756] - Storm-kafka tests leak resources due to retained references to KafkaServer
• [STORM-1761] - Storm-Solr Example Throws ArrayIndexOutOfBoundsException in Remote Cluster Mode
• [STORM-1764] - Pacemaker is throwing some stack traces
• [STORM-1771] - HiveState should flushAndClose before closing old or idle Hive connections
• [STORM-1772] - Create topologies for measuring performance
• [STORM-1773] - Utils.javaDeserialize() doesn't work with primitive types
• [STORM-1832] - Consistently slow metrics consumer triggers backpressure which will be never back to normal
• [STORM-1834] - Documentation How to Generate Certificates For Local Testing SSL Setup
• [STORM-1837] - Running local clusters without simulating time breaks Testing.completeTopology, and may cause message loss
• [STORM-1841] - Address a few minor issues in windowing and doc
• [STORM-1842] - Forward references in storm.thrift cause tooling issues
• [STORM-1844] - Some tests are flaky due to low timeout
• [STORM-1848] - NotSerializableException when using storm-kafka spout with event logging
• [STORM-1849] - HDFSFileTopology should take 3rd argument as topology name
• [STORM-1851] - Nimbus impersonation authorizer in defaults.yaml causes issues in secure mode
• [STORM-1853] - Deserialization issues in Utils.javaDeserialize()
• [STORM-1859] - Late tuples are not acked in windowed mode
• [STORM-1861] - Storm submit command returns exit code of 0 even when it fails
• [STORM-1862] - Flux ShellSpout and ShellBolt can't emit to named streams
• [STORM-1864] - StormSubmitter should show proper error messages for submitter hook invocation.
• [STORM-1872] - Storm Redis connection release
• [STORM-1878] - Flux does not handle stateful bolts
• [STORM-1879] - Supervisor may not shut down workers cleanly
• [STORM-1881] - storm-redis is missing dependant libraries in distribution
• [STORM-1882] - Expose TextFileReader public
• [STORM-1884] - In RedisKeyValueState.prepareCommit keys in pendingPrepare should have priority over pendingCommit
• [STORM-1887] - Help message for the set_log_level command does not have the topology name parameter
• [STORM-1906] - Window count/length of zero should be disallowed
• [STORM-1907] - PartitionedTridentSpoutExecutor has incompatible types that cause ClassCastException
• [STORM-1911] - Inconsistency of timestamp between IMetricsConsumer and IClusterMetricsConsumer
• [STORM-1915] - Supervisor keeps restarting forever
• [STORM-1920] - version of parent pom for storm-kafka-monitor is set 1.0.2-SNAPSHOT in master branch
• [STORM-1924] - Add a config file parameter to HDFS test topologies
• [STORM-1925] - Nimbus fails to start in secure mode
• [STORM-1928] - ShellSpout should check heartbeat while ShellSpout is waiting for subprocess to sync
• [STORM-1934] - Race condition between sync-supervisor and sync-processes raises several strange issues
• [STORM-1937] - trident topologies WindowTridentProcessor cause NullPointerException when using windowing
• [STORM-1939] - Frequent InterruptedException raised by ShellBoltMessageQueue.poll
• [STORM-1941] - Nimbus discovery can fail when zookeeper reconnect happens.
• [STORM-1942] - Extra closing div tag in topology.html
• [STORM-1945] - Internal Server Error shown on topology page for topology using KafkaSpout
• [STORM-1946] - ShellBolt.java - On busy system BoltHeartbeatTimerTask fires before setHeartbeat() is executed
• [STORM-1954] - Large Trident topologies can cause memory issues due to DefaultResourceDeclarer object reading config
• [STORM-1956] - Disable Backpressure by default
• [STORM-1959] - KafkaPartitionOffsetLag.java does not have license
• [STORM-1962] - python storm integration does not run on python 3
• [STORM-1964] - Unexpected behavior when using count window together with timestamp extraction
• [STORM-1976] - Storm Nimbus H/A has issue on cleaning corrupted topologies
• [STORM-1977] - Leader Nimbus crashes with getClusterInfo when it doesn't have one or more replicated topology codes
• [STORM-1985] - Provide a tool for showing and killing corrupted topology
• [STORM-1987] - Fix TridentKafkaWordCount arg handling
• [STORM-1988] - Kafka Offset not showing due to bad classpath
• [STORM-1995] - downloadChunk in nimbus.clj should close the input stream
• [STORM-1999] - Update docs with OutputCollector's threadsafety
• [STORM-2000] - Add opentsdb libs to external dir in installation.
• [STORM-2017] - ShellBolt stops reporting task ids
• [STORM-2020] - Stop using sun internal classes
• [STORM-2021] - storm-kinesis missing licenses
• [STORM-2022] - FieldsTest.selectingUnknownFieldThrowsTest is failing
• [STORM-2023] - Add calcite-core to dependency of storm-sql-runtime
• [STORM-2026] - Inconsistency between (SpoutExecutor, BoltExecutor) and (spout-transfer-fn, bolt-transfer-fn)
• [STORM-2028] - Exceptions in JDBCClient are hidden by subsequent SQL-Exception in close()
• [STORM-2032] - "not fast enough" metrics WARN message in netty client can be misinterpreted
• [STORM-2036] - Fix minor bug in RAS Tests
• [STORM-2037] - debug operation should be whitelisted in SimpleAclAuthorizer
• [STORM-2040] - Config.TOPOLOGY_TESTING_ALWAYS_TRY_SERIALIZE=true causes j.l.UnsupportedOperationException: nth not supported on this type: AddressedTuple
• [STORM-2042] - Nimbus client connections not closed properly causing connection leaks
• [STORM-2045] - NPE in SpoutExecutor in 2.0 branch
• [STORM-2047] - In secure setup the log page can't be viewed
• [STORM-2052] - Kafka Spout New Client API - Log Improvements and Parameter Tuning for Better Performance
• [STORM-2054] - DependencyResolver should be aware of relative path and absolute path
• [STORM-2056] - Bugs in logviewer
• [STORM-2059] - storm-submit-tools is getting rat failures.
• [STORM-2064] - Add storm name and function, access result and function to log-thrift-access
• [STORM-2066] - Fix scheduler status when in isolation and running with less slots than requested
• [STORM-2067] - "array element type mismatch" from compute-executors in nimbus.clj
• [STORM-2070] - Sigar native binary download link went 404
• [STORM-2071] - nimbus-test test-leadership failing with Exception
• [STORM-2074] - NPE bug in storm-kafka-monitor
• [STORM-2079] - Unneccessary readStormConfig operation
• [STORM-2087] - Storm-kafka-client: Failed tuples are not always replayed
• [STORM-2088] - Typos in documentation "Guaranteeing Message Processing"
• [STORM-2093] - Cannot download OOM heap dumps on MT storm systems through UI
• [STORM-2095] - Nimbus dies and never recovers due to java.nio.file.DirectoryNotEmptyException
• [STORM-2098] - DruidBeamBolt: Pass DruidConfig.Builder as constructor argument
• [STORM-2100] - Few tests are getting failed in external/sql module with JDK 7
• [STORM-2101] - NPE in compute-executors in nimbus
• [STORM-2104] - New Kafka spout crashes if partitions are reassigned while tuples are in-flight
• [STORM-2109] - Under supervisor V2 SUPERVISOR_MEMORY_CAPACITY_MB and SUPERVISOR_CPU_CAPACITY must be Doubles
• [STORM-2110] - in supervisor v2 filter out empty command line args
• [STORM-2115] - [Storm SQL] 'IN' with subquery making implicit aggregate calls which is having 'null' as name
• [STORM-2117] - Supervisor V2 with local mode extracts resources directory to topology root directory instead of temporary directory
• [STORM-2118] - A few fixes for storm-sql standalone mode
• [STORM-2119] - bug in log message printing to stdout
• [STORM-2120] - Emit to outputStreamId configured in SpoutConfig for KafkaSpout
• [STORM-2126] - Fix NPE due to race condition in nimbus.clj when attempting to get resources from SupervisorDetail
• [STORM-2128] - SimpleSqlTridentConsumer missing license headder
• [STORM-2131] - Add blob command to worker-launcher, make stormdist directory not writeable by topo owner
• [STORM-2142] - ReportErrorAndDie runs suicide function only when InterruptedException or InterruptedIOException is thrown
• [STORM-2144] - Fix Storm-sql group-by behavior in standalone mode
• [STORM-2158] - OutOfMemoryError in Nimbus' SimpleTransportPlugin
• [STORM-2171] - blob recovery on a single host results in deadlock
• [STORM-2175] - Supervisor V2 can possibly shut down workers twice in local mode
• [STORM-2176] - Workers do not shutdown cleanly and worker hooks don't run when a topology is killed
• [STORM-2184] - New Kafka spout will fail to commit offsets on shutdown if there are offsets to commit
• [STORM-2185] - Storm Supervisor doesn't delete directories properly sometimes
• [STORM-2189] - RAS_Node::freeCPU outputs incorrect info
• [STORM-2190] - Topology submission blocked behind scheduling
• [STORM-2193] - Storm UI/Logviewer passing in params in wrong order to FilterConfiguration
• [STORM-2194] - ReportErrorAndDie doesn't always die
• [STORM-2195] - Clean up some of worker-launcher code
• [STORM-2196] - A typo in RAS_Node::consumeCPU
• [STORM-2197] - NimbusClient connectins leak due to leakage in ThriftClient.
• [STORM-2198] - perform RotationAction when stopping HdfsBolt
• [STORM-2205] - Racecondition in getting nimbus summaries while ZK connections are reconnected.
• [STORM-2208] - HDFS State Throws FileNotFoundException in Azure Data Lake Store file system (adl://)
• [STORM-2210] - ShuffleGrouping does not produce even distribution
• [STORM-2213] - ShellSpout has race condition when ShellSpout is being inactive longer than heartbeat timeout
• [STORM-2226] - New kafka spout offset lag tool does not work for secured kafka setup
• [STORM-2228] - KafkaSpout does not replay properly when a topic maps to multiple streams
• [STORM-2231] - NULL in DisruptorQueue while multi-threaded ack
• [STORM-2234] - heartBeatExecutorService in shellSpout don't work well with deactivate
• [STORM-2239] - New Kafka spout does not properly handle interrupts
• [STORM-2240] - STORM PMML Bolt - Add Support to Load Models from Blob Store
• [STORM-2245] - integration-test constant compilation failure
• [STORM-2246] - Logviewer download link has urlencoding on part of the URL
• [STORM-2251] - Integration test refers specific version of Storm which should be project version
• [STORM-2257] - Add built in support for sum function with different types in storm-sql standalone mode
• [STORM-2264] - OpaqueTridentKafkaSpout failing after STORM-2216
• [STORM-2266] - NimbusClient is not closed properly from some of the usages.
• [STORM-2267] - [storm-submit-tools] Use user's local maven repo. directory to local repo.
• [STORM-2268] - Fix integration test for Travis CI build
• [STORM-2271] - ClosedByInterruptException should be handled in few cases and removing a confusing debug statement
• [STORM-2272] - LocalCluster can leak simulated time
• [STORM-2274] - Support named output streams in Hdfs Spout
• [STORM-2275] - Nimbus crashed during state transition of topology
• [STORM-2276] - Remove twitter4j usages due to license issue (JSON.org is catalog X)
• [STORM-2279] - Unable to open bolt page of storm ui
• [STORM-2281] - Running Multiple Kafka Spouts (Trident) Throws Illegal State Exception
• [STORM-2283] - Fix DefaultStateHandler kryo multithreading issues
• [STORM-2293] - hostname should only refer node's 'storm.local.hostname'
• [STORM-2295] - KafkaSpoutStreamsNamedTopics changing the sequence of fields name while emitting data
• [STORM-2303] - [storm-opentsdb] Fix list invariant issue for JDK 7
• [STORM-2305] - STORM-2279 calculates task index different from grouper code
• [STORM-2315] - New kafka spout can't commit offset when ack is disabled.
• [STORM-2320] - DRPC client printer class reusable for local and remote DRPC
• [STORM-2321] - Nimbus did not come up after restart
• [STORM-2323] - Precondition for Leader Nimbus should check all topology blobs
• [STORM-2324] - Topology should not fail if topology jar is missing resources directory
• [STORM-2325] - Logviewer doesn't consider 'storm.local.hostname'
• [STORM-2330] - Fix storm sql code generation for UDAF with non standard sql types
• [STORM-2331] - Anchoring emit in JavaScript only works with exactly one anchor
• [STORM-2334] - Bolt for Joining streams
• [STORM-2335] - Topology visualization breaks when ':transferred' in executor stats doesn't have any informations
• [STORM-2336] - LocalCluster doesn't terminate properly after cluster shutdown (needs Ctrl+C to terminate)
• [STORM-2338] - Subprocess exception handling is broken in storm.py on Windows environment
• [STORM-2343] - New Kafka spout can stop emitting tuples if more than maxUncommittedOffsets tuples fail at once
• [STORM-2345] - Type mismatch in ReadClusterState's ProfileAction processing Map
• [STORM-2346] - Files with unapproved licenses: download-rc-directory.sh verify-release-file.sh
• [STORM-2350] - Storm-HDFS's listFilesByModificationTime is broken
• [STORM-2357] - add At-Most-Once guarantee in KafkaSpout
• [STORM-2361] - Kafka spout - after topic leader change, it stops committing offsets to ZK
• [STORM-2371] - Replace existing AMQP eventhub client with the lastest one from Microsoft eventhubs
• [STORM-2372] - Pacemaker client doesn't clean up heartbeats properly.
• [STORM-2374] - Storm Kafka Client Func Interface Must be Serializable
• [STORM-2386] - Fail-back Blob deletion also fails in BlobSynchronizer.syncBlobs
• [STORM-2387] - Handle tick tuples properly for Bolts in external modules
• [STORM-2389] - Event Logger bolt is instantiated even if topology.eventlogger.executors=0
• [STORM-2391] - HdfsSpoutTopology example needs to be moved into storm-hdfs-examples from storm-starter
• [STORM-2396] - Utils.sleep method doesn't set interrupted flag after catching InterruptedException
• [STORM-2400] - Intermittent failure in nimbus because of errors from LeaderLatch#getLeader()
• [STORM-2403] - Fix KafkaBolt test failure: tick tuple should not be acked
• [STORM-2407] - KafkaTridentSpoutOpaque Doesn't Poll Data From All Topic-Partitions When Parallelism Hint Not a Multiple Total Topic-Partitions
• [STORM-2408] - build failed if storm.kafka.client.version = 0.10.2.0
• [STORM-2409] - Storm-Kafka-Client KafkaSpout Support for Failed and Null Tuples
• [STORM-2411] - Event Logger count in defaults.yaml needs to be 0
• [STORM-2412] - Nimbus isLeader check while waiting for max replication
• [STORM-2413] - New Kafka spout is ignoring retry limit
• [STORM-2414] - Skip checking meta's ACL when subject has write privileges for any blobs
• [STORM-2422] - Serialized Trident topology size does not grow linerarly
• [STORM-2423] - Join Bolt : Use explicit instead of default window anchoring of emitted tuples
• [STORM-2425] - Storm Hive Bolt not closing open transactions
• [STORM-2426] - First tuples fail after worker is respawn
• [STORM-2427] - Event logger enable/disable UI is not working as expected in master branch
• [STORM-2429] - non-string values in supervisor.scheduler.meta cause crash
• [STORM-2431] - the default blobstore.dir is storm.local.dir/blobs which is different from distcache-blobstore.md
• [STORM-2432] - Storm-Kafka-Client Trident Spout Seeks Incorrect Offset With UNCOMMITTED_LATEST Strategy
• [STORM-2435] - Logging in storm.js inconsistent to console.log and does not support log levels
• [STORM-2443] - Nimbus throws error when changing log level on UI topology page
• [STORM-2445] - Topology log search refers supervisor ID as host of worker which contains UUID
• [STORM-2449] - Iterator of Redis State may return same key multiple time, with different values
• [STORM-2450] - supervisor v2 broke ShellBolt/Spout in local mode from storm jar
• [STORM-2451] - windows storm.cmd does not set log4j2 config file correctly by default
• [STORM-2454] - the default returned value of this method which named "isConsumerAutoCommitMode" in KafkaSpoutConfig.java should be false
• [STORM-2457] - update and modify storm/hbase/README.md and storm-hbase.md
• [STORM-2463] - fix DRPCTest.testDequeueAfterTimeout test failure
• [STORM-2467] - Encoding issues in Kafka consumer
• [STORM-2469] - fix integration-test dependencies issue
• [STORM-2474] - fix external README format
• [STORM-2475] - NimbusInfo does not handle IPv6 addresses
• [STORM-2476] - the path for 4 kinds of built-in schedulers in Storm-Scheduler.md is wrong
• [STORM-2478] - BlobStoreTest.testDeleteAfterFailedCreate fails on Windows
• [STORM-2479] - DRPC tests should not use Utils.getAvailablePort, since that function is inherently unsafe
• [STORM-2480] - "principle" should be modified to "principal"
• [STORM-2486] - bin/storm launcher script can be broken if CDPATH is exported from environment
• [STORM-2488] - The UI user Must be HTTP
• [STORM-2489] - Overlap and data loss on WindowedBolt based on Duration
• [STORM-2496] - Dependency artifacts should be uploaded to blobstore with READ permission for all
• [STORM-2503] - lgtm.com alerts: bugs in equality and comparison operations
• [STORM-2505] - Kafka Spout doesn't support voids in the topic (topic compaction not supported)
• [STORM-2511] - Submitting a topology with name containing unicode getting failed.
• [STORM-2516] - WindowedBoltExecutorTest.testExecuteWithLateTupleStream is flaky
• [STORM-2517] - storm-hdfs writers can't be subclassed
• [STORM-2518] - NPE during uploading dependency artifacts with secured cluster
• [STORM-2520] - AutoHDFS should prefer cluster-wise hdfs kerberos principal to global hdfs kerberos principal
• [STORM-2521] - "storm sql" fails since '--jars' can't handle wildcard
• [STORM-2522] - examples in package do not build with checkstyle issues
• [STORM-2525] - Fix flaky integration tests
• [STORM-2526] - I broke the UI (and changed generated code)
• [STORM-2532] - Get rid of most uses of Utils.getAvailablePort
• [STORM-2533] - Visualization API returns "spout" for system components
• [STORM-2534] - Visualization API missing stats/instances for "system" components
• [STORM-2535] - test-reset-timeout is flaky. Replace with a more reliable test.
• [STORM-2536] - storm-autocreds adds jersey 1.x to worker classpath
• [STORM-2541] - Manual partition assignment doesn't work
• [STORM-2544] - Bugs in the Kafka Spout retry logic when using manual commit
• [STORM-2546] - Kafka spout can stall / get stuck due to edge case with failing tuples
• [STORM-2549] - The fix for STORM-2343 is incomplete, and the spout can still get stuck on failed tuples
• [STORM-2552] - KafkaSpoutMessageId should be serializable
• [STORM-2555] - storm-autocreds for HBase doesn't handle impersonation
• [STORM-2557] - A bug in DisruptorQueue causing severe underestimation of queue arrival rates
• [STORM-2558] - The Windows command line storm.cmd script is outdated and doesn't work
• [STORM-2559] - There are three configurations in defaults.yaml haven't been used in storm.
• [STORM-2562] - Use stronger key size for blow fish key generator and get rid of stack trace
• [STORM-2563] - Remove the workaround to handle missing UGI.loginUserFromSubject
• [STORM-2564] - We should provide a template for storm-cluster-auth.yaml
• [STORM-2597] - EXT_CLASSPATH strips out directories
• [STORM-2599] - BasicContainer.getWildcardDir tries to resolve the wildcard character with Paths.get, which prevents workers from booting on Windows
• [STORM-2602] - "storm.zookeeper.topology.auth.payload" doesn't work even you set it
• [STORM-2607] - [kafka-client] Consumer group every time with lag 1
• [STORM-2608] - Out Of Range Offsets Should Be Removed From Pending Queue
• [STORM-2613] - Tuples that aren't sampled shouldn't be considered for execute latency calculations
• [STORM-2621] - STORM-2557 broke sojourn time estimation
• [STORM-2627] - The annotation of "storm.zookeeper.topology.auth.scheme" in Config.java is wrong
• [STORM-2635] - Deep log search doesn’t work when there’s no topology in topology history
• [STORM-2638] - Add in maximum object size for Pacemaker Thrift objects
• [STORM-2639] - Kafka Spout incorrectly computes numCommittedOffsets due to voids in the topic (topic compaction)
• [STORM-2641] - storm.py and storm.ps1 don't handle errors correctly on Windows
• [STORM-2642] - Storm-kafka-client spout cannot be serialized when using manual partition assignment
• [STORM-2645] - update storm.py to be python3 compatible
• [STORM-2652] - Exception thrown in JmsSpout open method
• [STORM-2655] - Log user cannot view worker.log on Storm UI on secure cluster
• [STORM-2660] - The Nimbus storm-local directory is relative to the working directory of the shell executing "storm nimbus"
• [STORM-2666] - Storm-kafka-client spout can sometimes emit messages that were already committed.
• [STORM-2674] - NoNodeException when ZooKeeper tries to delete nodes
• [STORM-2675] - KafkaTridentSpoutOpaque not committing offsets to Kafka
• [STORM-2676] - Error class name for log in JsonRecordHiveMapper.java.
• [STORM-2678] - Improve performance of LoadAwareShuffleGrouping
• [STORM-2682] - Supervisor crashes with NullPointerException
• [STORM-2690] - resurrect invocation of ISupervisor.assigned() & make Supervisor.launchDaemon() accessible
• [STORM-2691] - storm-kafka-client Trident spout implements the Trident interface incorrectly
• [STORM-2695] - BlobStore uncompress argument should be Boolean
• [STORM-2700] - Blobstore shouldn't check ACL when Blobstore Acl validation disabled
• [STORM-2701] - Supervisor crashed if blob has bad permission
• [STORM-2705] - DRPCSpout sleeps twice when idle
• [STORM-2706] - Nimbus stuck in exception and does not fail fast
• [STORM-2716] - Storm-webapp tests don't work on Windows
• [STORM-2722] - JMSSpout test fails way too often
• [STORM-2724] - ExecutorService in WaterMarkEventGenerator never shutdown
• [STORM-2729] - Fix NPE in WorkerState runWorkerStartHooks and runWorkerShutdownHooks methods
• [STORM-2732] - Eldest writer is not closed when removed from WritersMap
• [STORM-2733] - Make Load Aware Shuffle much better at really bad situations
• [STORM-2734] - The master branch cannot release due to crash in Checkstyle
• [STORM-2736] - o.a.s.b.BlobStoreUtils [ERROR] Could not update the blob with key
• [STORM-2738] - The number of ackers should default to the number of actual running workers on RAS cluster
• [STORM-2742] - Logviewer leaking file descriptors
• [STORM-2748] - TickTupleTest is useless
• [STORM-2750] - fix double_checked locking
• [STORM-2751] - Remove AsyncLoggingContext from Supervisor
• [STORM-2757] - Links are broken when logviewer https port is used
• [STORM-2758] - logviewer_search page not found
• [STORM-2762] - Sort out multiple places of codes of manipulation of collections
• [STORM-2764] - HDFSBlobStore leaks file system objects
• [STORM-2765] - Disallow colons in blobstore key name
• [STORM-2769] - Fast-fail if output stream Id is null
• [STORM-2771] - Some tests are being run twice
• [STORM-2772] - In the DRPCSpout class, when the fetch from the DRPC server fails, the log should return to get the DRPC request failed instead of getting the DRPC result failed
• [STORM-2777] - The number of ackers doesn't default to the number of workers
• [STORM-2779] - NPE on shutting down WindowedBoltExecutor
• [STORM-2784] - storm-kafka-client KafkaTupleListener method onPartitionsReassigned() should be called after initialization is complete
• [STORM-2786] - Ackers leak tracking info on failure and lots of other cases.
• [STORM-2787] - storm-kafka-client KafkaSpout should set 'initialized' flag independently of processing guarantees
• [STORM-2794] - Translate backtype.storm to org.apache for topology.scheduler.strategy if scheduling older version topologies
• [STORM-2795] - Race in downloading resources can cause failure
• [STORM-2803] - SlotTest failing on travis frequently
• [STORM-2804] - TopoCache is not caching ACLs correctly
• [STORM-2808] - Main UI gets some errors.
• [STORM-2809] - Integration test is failing consistently and topologies sometimes fail to start workers
• [STORM-2810] - Storm-hdfs tests are leaking resources
• [STORM-2811] - Nimbus may throw NPE if the same topology is killed multiple times, and the integration test kills the same topology multiple times
• [STORM-2814] - Logviewer HTTP server should return 403 instead of 200 if the user is unauthorized
• [STORM-2815] - UI HTTP server should return 403 if the user is unauthorized
• [STORM-2820] - validateTopologyWorkerMaxHeapSizeConfigs function never picks up the value set by nimbus
• [STORM-2827] - Logviewer search returns incorrect logviewerUrl
• [STORM-2829] - Logviewer deepSearch not working
• [STORM-2833] - Cached Netty Connections can have different keys for the same thing.
• [STORM-2834] - getOwnerResourceSummaries not working properly because scheduler is wrapped as BlacklistScheduler
• [STORM-2835] - storm-kafka-client KafkaSpout can fail to remove all tuples from waitingToEmit
• [STORM-2843] - Flux: properties file not found when loading resources from classpath
• [STORM-2844] - KafkaSpout Throws IllegalStateException After Committing to Kafka When First Poll Strategy Set to EARLIEST
• [STORM-2845] - Drop standalone mode of Storm SQL
• [STORM-2847] - Exception thrown after rebalance IllegalArgumentException
• [STORM-2850] - ManualPartitionSubscription assigns new partitions before calling onPartitionsRevoked
• [STORM-2851] - org.apache.storm.kafka.spout.KafkaSpout.doSeekRetriableTopicPartitions sometimes throws ConcurrentModificationException
• [STORM-2853] - Deactivated topologies cause high cpu utilization
• [STORM-2855] - Travis build doesn't work after update of Ubuntu image
• [STORM-2856] - Make Storm build work on post 2017Q4 Travis Trusty image
• [STORM-2859] - NormalizedResources has some bugs in special cases where 0 of a resource is available.
• [STORM-2863] - Some ras tests fail because of static resource caching
• [STORM-2868] - Address handling activate/deactivate in multilang module files
• [STORM-2869] - KafkaSpout discards all pending records when adjusting the consumer position after a commit
• [STORM-2870] - FileBasedEventLogger leaks non-daemon ExecutorService which prevents process to be finished
• [STORM-2876] - Some storm-hdfs tests fail with out of memory periodically
• [STORM-2879] - Supervisor collapse continuously when there is a expired assignment for overdue storm
• [STORM-2885] - TickTupleTest can fail because it uses NimbusDaemon
• [STORM-2892] - Flux test fails to parse valid PATH environment variable
• [STORM-2893] - maven-assembly-plugin upgrade is breaking distribution build
• [STORM-2894] - fix some random typos in tests
• [STORM-2900] - Subject is not populated and NPE is thrown while populating credentials in nimbus.
• [STORM-2903] - Fix possible NullPointerException in AbstractAutoCreds
• [STORM-2906] - HDFS and HBase bolt on the same worker fails with GSS no valid credentials exception
• [STORM-2910] - Tests taking a long time to run
• [STORM-2911] - SpoutConfig is serializable but does not declare a serialVersionUID field
• [STORM-2912] - Tick tuple is being shared without resetting start time and incur side-effect to break metrics
• [STORM-2913] - STORM-2844 made autocommit and at-most-once storm-kafka-client spouts log warnings on every emit, because those modes don't commit the right metadata to Kafka
• [STORM-2918] - Upgrade Netty version
• [STORM-2932] - topology.localityaware.higher/lower.bound.percent configs are confusing
• [STORM-2934] - Logviewer ClassNotFoundException validating configs
• [STORM-2940] - Set the CAPACITY value of LoadAwareShuffleGrouping dynamically
• [STORM-2941] - checkstyle failing on master
• [STORM-2950] - ArrayIndexOutOfBoundsException in FieldsGrouper.chooseTasks function
• [STORM-2965] - Interpret wildcard in classpath correctly when reading config from classpath
• [STORM-2967] - Upgrade jackson to latest version 2.9.4
• [STORM-2968] - Exclude a few unwanted jars from storm-autocreds
• [STORM-2969] - remove @isDerivedFrom validation for topology.spout/bolt/backpressure.wait.strategy
• [STORM-2976] - Fix Supervisor healthCheck issues
• [STORM-2978] - The fix for STORM-2706 is broken, and adds a transitive dependency on Zookeeper 3.5.3-beta for projects that depend on e.g. storm-kafka
• [STORM-2979] - WorkerHooks EOFException during run_worker_shutdown_hooks
• [STORM-2980] - The storm-starter documentation incorrectly states that the examples can be run in a local cluster via a command line flag.
• [STORM-2981] - Upgrade Curator to lastest patch version
• [STORM-2983] - Some topologies not working properly
• [STORM-2986] - NPE from LogCleaner
• [STORM-2987] - PaceMakerStateStorage should deal with InterruptedException correctly
• [STORM-2988] - "Error on initialization of server mk-worker" when using org.apache.storm.metrics2.reporters.JmxStormReporter on worker
• [STORM-2989] - LogCleaner should preserve current worker.log.metrics
• [STORM-2993] - Storm HDFS bolt throws ClosedChannelException when Time rotation policy is used
• [STORM-2994] - KafkaSpout consumes messages but doesn't commit offsets
• [STORM-3009] - Storm-webapp has multiple SLF4j bindings on the classpath
• [STORM-3012] - Nimbus will crash if pacemaker is restarted
• [STORM-3013] - Deactivated topology restarts if data flows into Kafka
• [STORM-3018] - Fix integration test DemoTest#testExclamationTopology fail problem
• [STORM-3020] - Fix race condition is async localizer
• [STORM-3021] - RAS doesn't honor Config.TOPOLOGY_WORKERS
• [STORM-3023] - Storm UI not showing correct values for component CPU, Memory and Executors
• [STORM-3028] - HdfsSpout does not handle empty files in case of ack enabled
• [STORM-3035] - JMS Spout ack method causes failure in some cases
• [STORM-3042] - topology.acker.cpu.pcore.percent and other settings not honored
• [STORM-3043] - NullPointerException thrown in SimpleRecordTranslator.apply()
• [STORM-3046] - Getting a NPE leading worker to die when starting a topology.
• [STORM-3048] - A Potential NPE
• [STORM-3052] - Let blobs un archive
• [STORM-3053] - blobstores deleted before topologies can be submitted
• [STORM-3055] - never refresh connection
• [STORM-3056] - Add a test for quickly rebinding to a port
• [STORM-3059] - KafkaSpout throws NPE when hitting a null tuple if the processing guarantee is not AT_LEAST_ONCE
• [STORM-3063] - Minor POM issues
• [STORM-3065] - Very frequent test failures in storm-server
• [STORM-3068] - STORM_JAR_JVM_OPTS are not passed to storm-kafka-monitor properly
• [STORM-3070] - MessageDecoder forgets to rewind buffer position if BackpressureStatus code is received, but the rest of the message is pending
• [STORM-3072] - Frequent test failures in storm-sql-core
• [STORM-3073] - In some cases workers may crash because pendingEmits is full
• [STORM-3075] - NPE starting nimbus
• [STORM-3079] - improve getMessage support for ThriftExceptions
• [STORM-3082] - NamedTopicFilter can't handle topics that don't exist yet
• [STORM-3087] - FluxBuilder.canInvokeWithArgs is too permissive when the method parameter type is a primitive
• [STORM-3091] - worker heartbeat directory recreated after killing
• [STORM-3092] - Metrics Reporter and Shutdown Hook on Supervisor not properly set up at launchDaemon
• [STORM-3096] - blobstores deleted before topologies can be submitted
• [STORM-3097] - Remove storm-druid in 2.x and deprecate support for it in 1.x
• [STORM-3098] - Fix bug in filterChangingBlobsFor() in Slot.java
• [STORM-3102] - Storm Kafka Client performance issues with Kafka Client v1.0.0
• [STORM-3103] - nimbus stuck shutting down causing leadership issues on startup
• [STORM-3109] - Wrong canonical path set to STORM_LOCAL_DIR in storm kill_workers
• [STORM-3110] - Supervisor does not kill all worker processes in secure mode in case of user mismatch
• [STORM-3116] - storm.home is not set in Clojure tests, nor is it guaranteed to be set when using LocalCluster
• [STORM-3117] - Deleting blobs for running topologies hoses Nimbus
• [STORM-3118] - Netty incompatibilities with Pacemaker
• [STORM-3120] - Clean up leftover null checks in Time, ensure idle threads get to run when cluster time is advanced
• [STORM-3121] - Fix flaky metrics tests in storm-core
• [STORM-3123] - Storm Kafka Monitor does not work with Kafka over two-way SSL
• [STORM-3124] - Failures talking to Pacemaker
• [STORM-3126] - Avoid unnecessary force kill when invoking storm kill_workers
• [STORM-3127] - Avoid potential race condition
• [STORM-3129] - Worker state machine does not use correct time util to get start time
• [STORM-3135] - JCQueueTest is flaky
• [STORM-3136] - Fix flaky integration test, and make it more readable
• [STORM-3137] - Flaky test in nimbus_test
• [STORM-3141] - NPE in WorkerState.transferLocalBatch when receiving messages for a task that isn't the first task assigned to the executor
• [STORM-3143] - Unnecessary inclusion of empty match result in Json
• [STORM-3148] - StormServerPipelineFactory can deserialize messages incorrectly
• [STORM-3158] - improve login failure message
• [STORM-3159] - Fixed potential file resource leak
• [STORM-3161] - Local mode should force setting min replication count to 1
• [STORM-3162] - Race condition at updateHeartbeatCache
• [STORM-3164] - Multilang storm.py uses traceback.format_exc incorrectly
• [STORM-3166] - Utils.threadDump does not account for dead threads
• [STORM-3167] - Flaky test in metrics_test.clj
• [STORM-3168] - AsyncLocalizer cleanup appears to crash
• [STORM-3169] - Misleading logviewer.cleanup.age.min
• [STORM-3170] - DirectoryCleaner may not correctly report correct number of deleted files
• [STORM-3179] - No data is available for Nimbus Summary in main UI page even Nimbus is running
• [STORM-3180] - Total executors in Cluster Summary in main UI page is not exposed even a topology is running
• [STORM-3181] - Topology stats doesn't show complete latency even for topology which ack is enabled
• [STORM-3182] - Owner summary page in non-secured cluster shows 500 server error because of NullPointerException
• [STORM-3183] - Topology Visualization is broken: shows components at most, but no more information
• [STORM-3184] - Storm supervisor log showing keystore and truststore password in plaintext
• [STORM-3194] - Reduce logging level of FIFOSchedulingPriorityStrategy
• [STORM-3200] - Improve debugging keytab errors
• [STORM-3201] - kafka spout lag on UI needs some cleanup
• [STORM-3203] - AsyncLocalizer is not updating permissions for storm.conf storm.ser and storm.jar
• [STORM-3206] - don't validate topoConf against DaemonConfig during submission
• [STORM-3207] - Fix KerberosSaslTransportPlugin to use WorkerTokens
• [STORM-3208] - supervisor NPE trying to kill workers
• [STORM-3210] - Fix AuthorizedUser error code
• [STORM-3213] - 500 Server Error on __acker component page on Storm UI
• [STORM-3215] - New UI is not impersonating user
• [STORM-3216] - RAS aware blacklisting strategy needed
• [STORM-3217] - Component errors missing in /api/v1/component API call
• [STORM-3218] - AuthorizedUserFilter should handle authorization exceptions better.
• [STORM-3219] - Storm UI javascript needs better error reporting
• [STORM-3220] - Allow excplicit enabling or disabling of HTTP daemon endpoints
• [STORM-3221] - Utilization in clusterSummary is inverted - shows free instead of used
• [STORM-3223] - RAS can get an NPE if entire rack is blacklisted
• [STORM-3224] - Fix FLUX YAML Viewer icon location/position on UI page
• [STORM-3225] - AuthorizedUserFilter should not convert the media type to a string
• [STORM-3228] - Supervisor blobstore ref counting not working properly
• [STORM-3230] - Small race with worker tokens.
• [STORM-3235] - Auto renewal of WorkerTokens broken.
• [STORM-3236] - DRPC meterShutdownCalls marked after metrics stopped
• [STORM-3237] - create metric to track mkAssignments exceptions
• [STORM-3238] - The result of log search for topology doesn't show in UI page
• [STORM-3239] - Worker profile actions don't work
• [STORM-3240] - healthchecks fail if scripts return 0 exit code
• [STORM-3241] - Event Log link on the UI Component page is broken when topology.eventlogger.executors is 0
• [STORM-3244] - Logviewer uses UI filter settings
• [STORM-3245] - Log viewer cleanup failes if multiple empty worker-artifact dirs
• [STORM-3246] - Use UTF-8 charset to ensure log capture non ascii characters from logs
• [STORM-3247] - remove BLOBSTORE_SUPERUSER
• [STORM-3248] - outputStats not returned in getComponent via Storm API
• [STORM-3249] - Nimbus Shutdown Faster
• [STORM-3251] - Using Logviewer Filter settings causes anyone to access logs via log viewer REST API
• [STORM-3252] - Blobstore sync bug fix
• [STORM-3254] - Blob localization time-outs can cause Slot to be stuck and leaked over time
• [STORM-3255] - Run with dev-zookeeper on travis-ci
• [STORM-3262] - Nimbus REST API reports leader before it gains leadership
• [STORM-3265] - flight.bash fall back to use java utils directly if $JAVA_HOME not set and it's not in $BINPATH
• [STORM-3269] - storm-client and storm-server indirectly depend on storm-core
• [STORM-3273] - Don't pass storm.local.hostname to topology conf
• [STORM-3275] - Fix Storm Profiler Start UI Helper method
• [STORM-3276] - Can't run Flux with Storm 2.0.0
• [STORM-3278] - Permissions issue on logviewer download for heap dump
• [STORM-3279] - Kafka trident spout could loose its position with EARLIEST or LATEST FirstPollOffsetStrategy
• [STORM-3282] - Fix ServerUtils Estimating Worker Count for RAS Topologies
• [STORM-3284] - Add cgroup inheritance to cgroup manager
• [STORM-3288] - Extracting jar dirs with resources in them are corrupted
• [STORM-3295] - Blacklist scheduling doesn't handle multiple supervisors on a host properly
• [STORM-3297] - NimbusMetricProcessor.processWorkerMetrics() can cause supervisor restart
• [STORM-3300] - Potential NPE in Acker when using reset timeout
• [STORM-3301] - The KafkaSpout can in some cases still replay tuples that were already committed
• [STORM-3302] - Several HDFS sockets might leak
• [STORM-3303] - update some logging priorities
• [STORM-3309] - TickTupleTest is still flaky
• [STORM-3310] - JCQueueTest is flaky
• [STORM-3317] - upload credentials fails when using different java.security.auth.login.config file
• [STORM-3319] - Slot can fail assertions in some cases
• [STORM-3320] - Executors should start when all worker connections are ready
• [STORM-3321] - Tests are flaky due to long timeouts in Nimbus and supervisor when using LocalCluster
• [STORM-3327] - Storm-webapp uses default charset for URL encoding in a bunch of places
• [STORM-3333] - storm-kafka-monitor - NoClassDefFoundError: org/apache/kafka/shaded/clients/consumer/KafkaConsumer
• [STORM-3343] - JCQueueTest can still be flaky
• [STORM-3348] - Incorrect message when group id is not provided as kafka spout config on storm ui
• [STORM-3352] - Use Netty BOM to lock all Netty artifacts to same version
• [STORM-3354] - LeaderElector is not shut down properly
• [STORM-3356] - Storm-hive should not pull in a compile-scope sfl4j binding
• [STORM-3362] - EventHubSpout uses a blocking receiver in nextTuple()
• [STORM-3375] - Date.getTime() can be changed to System.currentTimeMillis()
• [STORM-3377] - Scheduling may not fully utilize cluster with STORM_WORKER_MIN_CPU_PCORE_PERCENT set
• [STORM-3381] - Upgrading to Zookeeper 3.4.14 added an LGPL dependency

Question

• [STORM-1386] - Problem using a newer version of log4j-core

Umbrella

• [STORM-1699] - Improve MetricsConsumer

Epic

• [STORM-2725] - Support GPUs and other generic resource types in scheduling of topologes

Story

• [STORM-822] - Kafka Spout New Consumer API
• [STORM-1661] - Introduce a config to turn off blobstore acl validation in insecure mode
• [STORM-1866] - Update Resource Aware Scheduler Documentation
• [STORM-2039] - Backpressure refactoring in worker and executor
• [STORM-2254] - Add socket timeout for thrift client

Dependency upgrade

• [STORM-1038] - Upgrade netty transport from 3.x to 4.x
• [STORM-2326] - Upgrade log4j and slf4j
• [STORM-3294] - Update Jettty version to 9.4.14.v20181114 - latest stable
• [STORM-3296] - Upgrade Curator-test to resolve CURATOR-409
• [STORM-3312] - Upgrade Guava to latest
• [STORM-3349] - Upgrade Hadoop, HBase and Hive to latest compatible
• [STORM-3350] - Upgrade some old dependencies
• [STORM-3353] - Upgrade to Curator 4.2.0
• [STORM-3357] - Bump Clojure to 1.10

Documentation

• [STORM-118] - Docs: Minor typo in transactional-commit-flow.png
• [STORM-1633] - Document "storm blobstore" to command-line-client.md
• [STORM-1724] - Fill up lacking contents to Metrics documentation
• [STORM-1739] - Minor JAVA version dependency is wrong in 0.10.0 and above.
• [STORM-1850] - State Checkpointing documentation update regarding spout state management
• [STORM-1895] - blobstore replication-factor argument
• [STORM-2202] - [Storm SQL] Document how to use supported connectors and formats
• [STORM-2209] - Update documents adding new integration for some external systems
• [STORM-2461] - modify storm-hdfs's READEME.md and update storm-hdfs.md
• [STORM-2464] - update storm-mongodb.md
• [STORM-2465] - modify storm-redis's READEME.md and update storm-redis.md
• [STORM-2620] - Update the docs to better indicate the versions of java tested
• [STORM-2680] - The switch to turn on-off the cgroup in the doc should be “storm.resource.isolation.plugin.enable”
• [STORM-2960] - Better to stress importance of setting up proper OS account for Storm processes
• [STORM-2963] - Updates to Performance.md
• [STORM-3060] - Configuration mapping between storm-kafka & storm-kafka-client
• [STORM-3261] - YAML headers in the /docs

Task

• [STORM-716] - Change Storm Package Names
• [STORM-1769] - Add a test for submitting topologies to local nimbus with STORM_TOPOLOGY_SUBMISSION_NOTIFIER_PLUGIN.
• [STORM-2041] - Make Java 8 as minimum requirement for 2.0 release
• [STORM-2050] - [storm-sql] Support User Defined Aggregate Function for Trident mode
• [STORM-2135] - [StormSQL] document covered features of SQL reference in Calcite
• [STORM-2136] - [Storm SQL] Write some examples to show the usage of Storm SQL
• [STORM-2191] - shorten classpaths in worker and LogWriter commands
• [STORM-2200] - [Storm SQL] Drop Aggregate & Join support on Trident mode
• [STORM-2244] - Some shaded jars doesn't exclude dependency signature files
• [STORM-2349] - Add one RocketMQ plugin for the Apache Storm
• [STORM-2506] - Make Kafka Spout log its assigned partition
• [STORM-2578] - Apply new code style to storm-elasticsearch
• [STORM-2589] - Apply new code style to storm-mongodb
• [STORM-2594] - Apply new code style to storm-rocketmq
• [STORM-2830] - Upgrade Jackson to 2.9.2
• [STORM-2882] - Relocate dependencies on storm-client (and more)
• [STORM-2908] - Document Metrics V2 for 2.0.0
• [STORM-2953] - Remove storm-kafka in 2.0.0
• [STORM-3004] - Fix checkstyle warnings in storm-elasticsearch-examples
• [STORM-3005] - [DRPC] LinearDRPCTopologyBuilder shouldn't be deprecated
• [STORM-3007] - Fix checkstyle warnings in storm-mqtt-examples
• [STORM-3015] - storm-kafka-client-examples should not depend on the Kafka server jar
• [STORM-3086] - Update Flux documentation to demonstrate static factory methods (STORM-2796)
• [STORM-3089] - Document worker hooks on the hooks page
• [STORM-3105] - Update storm hive dependency version
• [STORM-3111] - StormSubmitter localNimbus field is unused
• [STORM-3197] - Make StormMetricsRegistry a regular instance class rather than a static utility
• [STORM-3199] - Metrics-ganglia depends on an LGPL library, so we shouldn't depend on it
• [STORM-3253] - Deprecate 'storm repl' subcommand
• [STORM-3268] - Try to make the integration test more stable
• [STORM-3289] - Add note about KAFKA-7044 to storm-kafka-client compatibility docs
• [STORM-3290] - Split storm-kafka-client KafkaSpoutConfig into a config for the Storm spout and a config for the Trident spouts

Test

• [STORM-2090] - Add integration test for storm windowing
• [STORM-2353] - Test kafka-clients:0.10.1.1 failed due to deprecated call from external Kafka unit dependency
• [STORM-2841] - testNoAcksIfFlushFails UT fails with NullPointerException

Sub-task

• [STORM-1347] - ui changes to display the topology version.
• [STORM-1436] - Random test failure on BlobStoreTest / HdfsBlobStoreImplTest (occasionally killed)
• [STORM-1523] - Translate Available Ports task in util.java
• [STORM-1585] - Add DDL support for UDFs in Storm-sql
• [STORM-1586] - ExprCompiler support for UDFs in Storm-sql
• [STORM-1698] - Asynchronous MetricsConsumerBolt
• [STORM-1700] - Introduce 'whitelist' / 'blacklist' option to MetricsConsumer
• [STORM-1933] - Intermittent test failure on test-multiple-active-storms-multiple-supervisors for supervisor-test
• [STORM-1961] - Come up with streams api for storm core use cases
• [STORM-2258] - Streams api - support CoGroupByKey
• [STORM-2306] - Redesign Messaging Subsystem, switch to JCTools Queues and introduce new Backpressure model
• [STORM-2367] - Documentation for streams API
• [STORM-2686] - Add Locality Aware ShuffleGrouping
• [STORM-2703] - Handle ExecutionException in handleWaitingForBlobLocalization state
• [STORM-2704] - Check blob permission before submitting the topology
• [STORM-2799] - Ensure jdk.tools is not being included transitively since tools.jar doesn't exist in JDK 9 and we don't need it.
• [STORM-2800] - Use JAXB api dependency from Maven instead of relying on that API being available in the standard JDK
• [STORM-2840] - Updated getOwnerResourceSummaries and UI for GRAS
• [STORM-2858] - Fix worker-launcher build
• [STORM-2872] - Memory availability and rebalance broken in GRAS
• [STORM-2887] - Add RocksDB storage and Basic Metrics forwarding from the supervisor
• [STORM-2924] - testTickTupleWorksWithSystemBolt in org.apache.storm.TickTupleTest fails intermittently
• [STORM-2971] - Replace Flux storm-kafka example with an equivalent example for storm-kafka-client
• [STORM-2972] - Replace storm-kafka in storm-sql-kafka with storm-kafka-client
• [STORM-2973] - Replace storm-perf storm-kafka topologies with storm-kafka-client versions
• [STORM-2974] - Add a transactional non-opaque spout to storm-kafka-client
• [STORM-3113] - Upgrade Mockito to fix Java 10 incompatibility
• [STORM-3114] - Ban jdk.tools
• [STORM-3119] - Build Storm with JDK 10
• [STORM-3156] - Remove the transactional topology API
• [STORM-3270] - Build Storm with JDK 11, excluding incompatible modules
• [STORM-3330] - Migrate parts of storm-webapp, and reduce use of mocks for files