Hadoop HADOOP 2.1.0-beta Release Notes
These release notes include new developer and user-facing incompatibilities, features, and major improvements.
Changes since Hadoop 2.0.5-alpha
- HADOOP-9872.
Blocker bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
Improve protoc version handling and detection
- HADOOP-9850.
Blocker bug reported by Daryn Sharp and fixed by Daryn Sharp (ipc)
RPC kerberos errors don't trigger relogin
- HADOOP-9845.
Blocker improvement reported by stack and fixed by Alejandro Abdelnur (performance)
Update protobuf to 2.5 from 2.4.x
- HADOOP-9832.
Blocker sub-task reported by Daryn Sharp and fixed by Daryn Sharp (ipc)
Add RPC header to client ping
Client ping will be sent as a RPC header with a reserved callId instead of as a sentinel RPC packet length.
- HADOOP-9820.
Blocker bug reported by Daryn Sharp and fixed by Daryn Sharp (ipc , security)
RPCv9 wire protocol is insufficient to support multiplexing
- HADOOP-9816.
Blocker bug reported by Daryn Sharp and fixed by Daryn Sharp (ipc , security)
RPC Sasl QOP is broken
- HADOOP-9792.
Major improvement reported by Suresh Srinivas and fixed by Suresh Srinivas (ipc)
Retry the methods that are tagged @AtMostOnce along with @Idempotent
- HADOOP-9787.
Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla (util)
ShutdownHelper util to shutdown threads and threadpools
- HADOOP-9786.
Major bug reported by Jing Zhao and fixed by Jing Zhao
RetryInvocationHandler#isRpcInvocation should support ProtocolTranslator
- HADOOP-9773.
Minor bug reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (test)
TestLightWeightCache fails
- HADOOP-9770.
Minor improvement reported by Suresh Srinivas and fixed by Suresh Srinivas (util)
Make RetryCache#state non volatile
- HADOOP-9763.
Major new feature reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (util)
Extends LightWeightGSet to support eviction of expired elements
- HADOOP-9762.
Major improvement reported by Suresh Srinivas and fixed by Suresh Srinivas (util)
RetryCache utility for implementing RPC retries
- HADOOP-9760.
Major improvement reported by Suresh Srinivas and fixed by Suresh Srinivas (util)
Move GSet and LightWeightGSet to hadoop-common
- HADOOP-9759.
Critical bug reported by Chuan Liu and fixed by Chuan Liu
Add support for NativeCodeLoader#getLibraryName on Windows
- HADOOP-9756.
Minor improvement reported by Junping Du and fixed by Junping Du (ipc)
Additional cleanup RPC code
- HADOOP-9754.
Minor improvement reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (ipc)
Clean up RPC code
- HADOOP-9751.
Major improvement reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (ipc)
Add clientId and retryCount to RpcResponseHeaderProto
- HADOOP-9738.
Major bug reported by Kihwal Lee and fixed by Jing Zhao (tools)
TestDistCh fails
- HADOOP-9734.
Minor improvement reported by Jason Lowe and fixed by Jason Lowe (ipc)
Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol
- HADOOP-9720.
Major sub-task reported by Suresh Srinivas and fixed by Arpit Agarwal
Rename Client#uuid to Client#clientId
- HADOOP-9717.
Major improvement reported by Suresh Srinivas and fixed by Jing Zhao (ipc)
Add retry attempt count to the RPC requests
- HADOOP-9716.
Major improvement reported by Suresh Srinivas and fixed by Tsz Wo (Nicholas), SZE (ipc)
Move the Rpc request call ID generation to client side InvocationHandler
- HADOOP-9707.
Minor bug reported by Todd Lipcon and fixed by Todd Lipcon (util)
Fix register lists for crc32c inline assembly
- HADOOP-9701.
Minor bug reported by Steve Loughran and fixed by Karthik Kambatla (documentation)
mvn site ambiguous links in hadoop-common
- HADOOP-9698.
Blocker sub-task reported by Daryn Sharp and fixed by Daryn Sharp (ipc)
RPCv9 client must honor server's SASL negotiate response
The RPC client now waits for the Server's SASL negotiate response before instantiating its SASL client.
- HADOOP-9691.
Minor improvement reported by Chris Nauroth and fixed by Chris Nauroth (ipc)
RPC clients can generate call ID using AtomicInteger instead of synchronizing on the Client instance.
- HADOOP-9688.
Blocker improvement reported by Suresh Srinivas and fixed by Suresh Srinivas (ipc)
Add globally unique Client ID to RPC requests
- HADOOP-9683.
Blocker sub-task reported by Luke Lu and fixed by Daryn Sharp (ipc)
Wrap IpcConnectionContext in RPC headers
Connection context is now sent as a rpc header wrapped protobuf.
- HADOOP-9681.
Minor bug reported by Chuan Liu and fixed by Chuan Liu
FileUtil.unTarUsingJava() should close the InputStream upon finishing
- HADOOP-9678.
Major bug reported by Ivan Mitic and fixed by Ivan Mitic
TestRPC#testStopsAllThreads intermittently fails on Windows
- HADOOP-9676.
Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
make maximum RPC buffer size configurable
- HADOOP-9673.
Trivial improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (net)
NetworkTopology: when a node can't be added, print out its location for diagnostic purposes
- HADOOP-9665.
Critical bug reported by Zhijie Shen and fixed by Zhijie Shen
BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF
- HADOOP-9661.
Major improvement reported by Sandy Ryza and fixed by Sandy Ryza (metrics)
Allow metrics sources to be extended
- HADOOP-9656.
Minor bug reported by Chuan Liu and fixed by Chuan Liu (test , tools)
Gridmix unit tests fail on Windows and Linux
- HADOOP-9649.
Blocker improvement reported by Zhijie Shen and fixed by Zhijie Shen
Promote YARN service life-cycle libraries into Hadoop Common
- HADOOP-9643.
Minor bug reported by Mark Miller and fixed by Mark Miller (security)
org.apache.hadoop.security.SecurityUtil calls toUpperCase(Locale.getDefault()) as well as toLowerCase(Locale.getDefault()) on hadoop.security.authentication value.
- HADOOP-9638.
Major bug reported by Chris Nauroth and fixed by Andrey Klochkov (test)
parallel test changes caused invalid test path for several HDFS tests on Windows
- HADOOP-9637.
Major bug reported by Chuan Liu and fixed by Chuan Liu
Adding Native Fstat for Windows as needed by YARN
- HADOOP-9632.
Minor bug reported by Chuan Liu and fixed by Chuan Liu
TestShellCommandFencer will fail if there is a 'host' machine in the network
- HADOOP-9630.
Major sub-task reported by Luke Lu and fixed by Junping Du (ipc)
Remove IpcSerializationType
- HADOOP-9625.
Minor improvement reported by Paul Han and fixed by (bin , conf)
HADOOP_OPTS not picked up by hadoop command
- HADOOP-9624.
Minor test reported by Xi Fang and fixed by Xi Fang (test)
TestFSMainOperationsLocalFileSystem failed when the Hadoop test root path has "X" in its name
- HADOOP-9619.
Major sub-task reported by Sanjay Radia and fixed by Sanjay Radia (documentation)
Mark stability of .proto files
- HADOOP-9607.
Minor bug reported by Timothy St. Clair and fixed by (documentation)
Fixes in Javadoc build
- HADOOP-9605.
Major improvement reported by Timothy St. Clair and fixed by (build)
Update junit dependency
- HADOOP-9604.
Minor improvement reported by Jingguo Yao and fixed by Jingguo Yao (fs)
Wrong Javadoc of FSDataOutputStream
- HADOOP-9599.
Major bug reported by Mostafa Elhemali and fixed by Mostafa Elhemali
hadoop-config.cmd doesn't set JAVA_LIBRARY_PATH correctly
- HADOOP-9593.
Major bug reported by Steve Loughran and fixed by Steve Loughran (util)
stack trace printed at ERROR for all yarn clients without hadoop.home set
- HADOOP-9581.
Major bug reported by Ashwin Shankar and fixed by Ashwin Shankar (scripts)
hadoop --config non-existent directory should result in error
- HADOOP-9574.
Major bug reported by Jian He and fixed by Jian He
Add new methods in AbstractDelegationTokenSecretManager for restoring RMDelegationTokens on RMRestart
- HADOOP-9566.
Major bug reported by Lenni Kuff and fixed by Colin Patrick McCabe (native)
Performing direct read using libhdfs sometimes raises SIGPIPE (which in turn throws SIGABRT) causing client crashes
- HADOOP-9563.
Major bug reported by Kihwal Lee and fixed by Tian Hong Wang (util)
Fix incompatibility introduced by HADOOP-9523
- HADOOP-9560.
Minor improvement reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (metrics)
metrics2#JvmMetrics should have max memory size of JVM
- HADOOP-9556.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (ha , test)
disable HA tests on Windows that fail due to ZooKeeper client connection management bug
- HADOOP-9553.
Major bug reported by Arpit Agarwal and fixed by Arpit Agarwal (test)
TestAuthenticationToken fails on Windows
- HADOOP-9550.
Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla
Remove aspectj dependency
- HADOOP-9549.
Blocker bug reported by Kihwal Lee and fixed by Daryn Sharp (security)
WebHdfsFileSystem hangs on close()
- HADOOP-9532.
Minor bug reported by Chris Nauroth and fixed by Chris Nauroth (bin)
HADOOP_CLIENT_OPTS is appended twice by Windows cmd scripts
- HADOOP-9527.
Major bug reported by Arpit Agarwal and fixed by Arpit Agarwal (fs , test)
Add symlink support to LocalFileSystem on Windows
- HADOOP-9526.
Major bug reported by Arpit Agarwal and fixed by Arpit Agarwal (test)
TestShellCommandFencer and TestShell fail on Windows
- HADOOP-9524.
Major bug reported by Arpit Agarwal and fixed by Arpit Agarwal (ha)
Fix ShellCommandFencer to work on Windows
- HADOOP-9523.
Major improvement reported by Tian Hong Wang and fixed by Tian Hong Wang
Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs
- HADOOP-9517.
Blocker bug reported by Arun C Murthy and fixed by Karthik Kambatla (documentation)
Document Hadoop Compatibility
- HADOOP-9515.
Major new feature reported by Brandon Li and fixed by Brandon Li
Add general interface for NFS and Mount
- HADOOP-9511.
Major improvement reported by Omkar Vinit Joshi and fixed by Omkar Vinit Joshi
Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils.
- HADOOP-9509.
Major new feature reported by Brandon Li and fixed by Brandon Li
Implement ONCRPC and XDR
- HADOOP-9507.
Minor bug reported by Mostafa Elhemali and fixed by Chris Nauroth (fs)
LocalFileSystem rename() is broken in some cases when destination exists
- HADOOP-9504.
Critical bug reported by Liang Xie and fixed by Liang Xie (metrics)
MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo
- HADOOP-9503.
Minor improvement reported by Varun Sharma and fixed by Varun Sharma (ipc)
Remove sleep between IPC client connect timeouts
- HADOOP-9500.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (test)
TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe
- HADOOP-9496.
Critical bug reported by Gopal V and fixed by Harsh J (bin)
Bad merge of HADOOP-9450 on branch-2 breaks all bin/hadoop calls that need HADOOP_CLASSPATH
- HADOOP-9490.
Major bug reported by Ivan Mitic and fixed by Ivan Mitic (fs)
LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename
- HADOOP-9488.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (fs)
FileUtil#createJarWithClassPath only substitutes environment variables from current process environment/does not support overriding when launching new process
- HADOOP-9486.
Major bug reported by Vinod Kumar Vavilapalli and fixed by Chris Nauroth
Promote Windows and Shell related utils from YARN to Hadoop Common
- HADOOP-9485.
Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (net)
No default value in the code for hadoop.rpc.socket.factory.class.default
- HADOOP-9483.
Major improvement reported by Chris Nauroth and fixed by Arpit Agarwal (util)
winutils support for readlink command
- HADOOP-9481.
Minor bug reported by Vadim Bondarev and fixed by Vadim Bondarev
Broken conditional logic with HADOOP_SNAPPY_LIBRARY
- HADOOP-9473.
Trivial bug reported by Glen Mazza and fixed by (fs)
typo in FileUtil copy() method
- HADOOP-9469.
Major bug reported by Thomas Graves and fixed by Robert Parker
mapreduce/yarn source jars not included in dist tarball
- HADOOP-9459.
Critical bug reported by Vinay and fixed by Vinay (ha)
ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb
- HADOOP-9455.
Minor bug reported by Sangjin Lee and fixed by Chris Nauroth (bin)
HADOOP_CLIENT_OPTS appended twice causes JVM failures
- HADOOP-9451.
Major bug reported by Junping Du and fixed by Junping Du (net)
Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled
- HADOOP-9450.
Major improvement reported by Mitch Wyle and fixed by Harsh J (scripts)
HADOOP_USER_CLASSPATH_FIRST is not honored; CLASSPATH is PREpended instead of APpended
- HADOOP-9443.
Major bug reported by Chuan Liu and fixed by Chuan Liu
Port winutils static code analysis change to trunk
- HADOOP-9439.
Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (native)
JniBasedUnixGroupsMapping: fix some crash bugs
- HADOOP-9437.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (test)
TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in NativeIOException
- HADOOP-9430.
Major bug reported by Amir Sanjar and fixed by (security)
TestSSLFactory fails on IBM JVM
- HADOOP-9429.
Major bug reported by Amir Sanjar and fixed by (test)
TestConfiguration fails with IBM JAVA
- HADOOP-9425.
Major sub-task reported by Sanjay Radia and fixed by Sanjay Radia (ipc)
Add error codes to rpc-response
- HADOOP-9421.
Blocker sub-task reported by Sanjay Radia and fixed by Daryn Sharp
Convert SASL to use ProtoBuf and provide negotiation capabilities
Raw SASL protocol now uses protobufs wrapped with RPC headers.
The negotiation sequence incorporates the state of the exchange.
The server now has the ability to advertise its supported auth types.
- HADOOP-9418.
Major sub-task reported by Andrew Wang and fixed by Andrew Wang (fs)
Add symlink resolution support to DistributedFileSystem
- HADOOP-9416.
Major sub-task reported by Andrew Wang and fixed by Andrew Wang (fs)
Add new symlink resolution methods in FileSystem and FileSystemLinkResolver
- HADOOP-9414.
Major sub-task reported by Andrew Wang and fixed by Andrew Wang (fs)
Refactor out FSLinkResolver and relevant helper methods
- HADOOP-9413.
Major bug reported by Ivan Mitic and fixed by Ivan Mitic
Introduce common utils for File#setReadable/Writable/Executable and File#canRead/Write/Execute that work cross-platform
- HADOOP-9408.
Minor bug reported by rajeshbabu and fixed by rajeshbabu (conf)
misleading description for net.topology.table.file.name property in core-default.xml
- HADOOP-9407.
Major bug reported by Sangjin Lee and fixed by Sangjin Lee (build)
commons-daemon 1.0.3 dependency has bad group id causing build issues
- HADOOP-9405.
Minor bug reported by Andrew Wang and fixed by Andrew Wang (test , tools)
TestGridmixSummary#testExecutionSummarizer is broken
- HADOOP-9401.
Major improvement reported by Karthik Kambatla and fixed by Karthik Kambatla
CodecPool: Add counters for number of (de)compressors leased out
- HADOOP-9399.
Minor bug reported by Todd Lipcon and fixed by Konstantin Boudnik (build)
protoc maven plugin doesn't work on mvn 3.0.2
Committed to 2.0.4-alpha branch
- HADOOP-9397.
Major bug reported by Jason Lowe and fixed by Chris Nauroth (build)
Incremental dist tar build fails
- HADOOP-9388.
Major bug reported by Ivan Mitic and fixed by Ivan Mitic
TestFsShellCopy fails on Windows
- HADOOP-9380.
Major sub-task reported by Sanjay Radia and fixed by Sanjay Radia (ipc)
Add totalLength to rpc response
- HADOOP-9379.
Trivial improvement reported by Arpit Gupta and fixed by Arpit Gupta
capture the ulimit info after printing the log to the console
- HADOOP-9376.
Major bug reported by Ivan Mitic and fixed by Ivan Mitic
TestProxyUserFromEnv fails on a Windows domain joined machine
- HADOOP-9373.
Minor bug reported by Suresh Srinivas and fixed by Suresh Srinivas
Merge CHANGES.branch-trunk-win.txt to CHANGES.txt
- HADOOP-9369.
Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla (net)
DNS#reverseDns() can return hostname with . appended at the end
- HADOOP-9365.
Major bug reported by Ivan Mitic and fixed by Ivan Mitic
TestHAZKUtil fails on Windows
- HADOOP-9364.
Major bug reported by Ivan Mitic and fixed by Ivan Mitic
PathData#expandAsGlob does not return correct results for absolute paths on Windows
- HADOOP-9358.
Major bug reported by Todd Lipcon and fixed by Todd Lipcon (ipc , security)
"Auth failed" log should include exception string
- HADOOP-9355.
Major sub-task reported by Andrew Wang and fixed by Andrew Wang (fs)
Abstract symlink tests to use either FileContext or FileSystem
- HADOOP-9353.
Major bug reported by Arpit Agarwal and fixed by Arpit Agarwal (build)
Activate native-win profile by default on Windows
- HADOOP-9352.
Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (security)
Expose UGI.setLoginUser for tests
- HADOOP-9349.
Major bug reported by Sandy Ryza and fixed by Sandy Ryza (tools)
Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another
- HADOOP-9343.
Major improvement reported by Siddharth Seth and fixed by Siddharth Seth
Allow additional exceptions through the RPC layer
- HADOOP-9342.
Major bug reported by Thomas Weise and fixed by Thomas Weise (build)
Remove jline from distribution
- HADOOP-9339.
Major bug reported by Daryn Sharp and fixed by Daryn Sharp (ipc)
IPC.Server incorrectly sets UGI auth type
- HADOOP-9338.
Major new feature reported by Nick White and fixed by Nick White (fs)
FsShell Copy Commands Should Optionally Preserve File Attributes
- HADOOP-9337.
Major bug reported by Ivan A. Veselovsky and fixed by Ivan A. Veselovsky
org.apache.hadoop.fs.DF.getMount() does not work on Mac OS
- HADOOP-9336.
Critical improvement reported by Daryn Sharp and fixed by Daryn Sharp (ipc)
Allow UGI of current connection to be queried
- HADOOP-9334.
Minor improvement reported by Nicolas Liochon and fixed by Nicolas Liochon (build)
Update netty version
- HADOOP-9323.
Minor bug reported by Hao Zhong and fixed by Suresh Srinivas (documentation , fs , io , record)
Typos in API documentation
- HADOOP-9322.
Minor improvement reported by Harsh J and fixed by Harsh J (security)
LdapGroupsMapping doesn't seem to set a timeout for its directory search
- HADOOP-9318.
Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
when exiting on a signal, print the signal name first
- HADOOP-9307.
Major bug reported by Todd Lipcon and fixed by Todd Lipcon (fs)
BufferedFSInputStream.read returns wrong results after certain seeks
- HADOOP-9305.
Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (security)
Add support for running the Hadoop client on 64-bit AIX
- HADOOP-9304.
Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
remove addition of avro genreated-sources dirs to build
- HADOOP-9303.
Major bug reported by Thomas Graves and fixed by Andy Isaacson
command manual dfsadmin missing entry for restoreFailedStorage option
- HADOOP-9302.
Major bug reported by Thomas Graves and fixed by Andy Isaacson (documentation)
HDFS docs not linked from top level
- HADOOP-9299.
Blocker bug reported by Roman Shaposhnik and fixed by Daryn Sharp (security)
kerberos name resolution is kicking in even when kerberos is not configured
- HADOOP-9297.
Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur
remove old record IO generation and tests
- HADOOP-9294.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (test)
GetGroupsTestBase fails on Windows
- HADOOP-9290.
Major bug reported by Arpit Agarwal and fixed by Chris Nauroth (build , native)
Some tests cannot load native library
- HADOOP-9287.
Major test reported by Tsuyoshi OZAWA and fixed by Andrey Klochkov (test)
Parallel testing hadoop-common
- HADOOP-9283.
Major new feature reported by Aaron T. Myers and fixed by Aaron T. Myers (security)
Add support for running the Hadoop client on AIX
- HADOOP-9279.
Major improvement reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (build , documentation)
Document the need to build hadoop-maven-plugins for eclipse and separate project builds
- HADOOP-9267.
Minor bug reported by Andrew Wang and fixed by Andrew Wang
hadoop -help, -h, --help should show usage instructions
- HADOOP-9264.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (fs)
port change to use Java untar API on Windows from branch-1-win to trunk
- HADOOP-9253.
Major improvement reported by Arpit Gupta and fixed by Arpit Gupta
Capture ulimit info in the logs at service start time
- HADOOP-9246.
Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla (build)
Execution phase for hadoop-maven-plugin should be process-resources
- HADOOP-9245.
Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla (build)
mvn clean without running mvn install before fails
- HADOOP-9233.
Major test reported by Vadim Bondarev and fixed by Vadim Bondarev
Cover package org.apache.hadoop.io.compress.zlib with unit tests
- HADOOP-9230.
Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla (test)
TestUniformSizeInputFormat fails intermittently
- HADOOP-9222.
Major test reported by Vadim Bondarev and fixed by Vadim Bondarev
Cover package with org.apache.hadoop.io.lz4 unit tests
- HADOOP-9220.
Critical bug reported by Tom White and fixed by Tom White (ha)
Unnecessary transition to standby in ActiveStandbyElector
- HADOOP-9218.
Major sub-task reported by Sanjay Radia and fixed by Sanjay Radia (ipc)
Document the Rpc-wrappers used internally
- HADOOP-9211.
Major bug reported by Sarah Weissman and fixed by Plamen Jeliazkov (conf)
HADOOP_CLIENT_OPTS default setting fixes max heap size at 128m, disregards HADOOP_HEAPSIZE
- HADOOP-9209.
Major new feature reported by Todd Lipcon and fixed by Todd Lipcon (fs , tools)
Add shell command to dump file checksums
- HADOOP-9164.
Minor improvement reported by Binglin Chang and fixed by Binglin Chang (native)
Print paths of loaded native libraries in NativeLibraryChecker
- HADOOP-9163.
Major sub-task reported by Sanjay Radia and fixed by Sanjay Radia (ipc)
The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy
- HADOOP-9154.
Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla (io)
SortedMapWritable#putAll() doesn't add key/value classes to the map
- HADOOP-9151.
Major sub-task reported by Sanjay Radia and fixed by Sanjay Radia (ipc)
Include RPC error info in RpcResponseHeader instead of sending it separately
- HADOOP-9150.
Critical bug reported by Todd Lipcon and fixed by Todd Lipcon (fs/s3 , ha , performance , viewfs)
Unnecessary DNS resolution attempts for logical URIs
- HADOOP-9140.
Major sub-task reported by Sanjay Radia and fixed by Sanjay Radia (ipc)
Cleanup rpc PB protos
- HADOOP-9131.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (test)
TestLocalFileSystem#testListStatusWithColons cannot run on Windows
- HADOOP-9125.
Major bug reported by Kai Zheng and fixed by Kai Zheng (security)
LdapGroupsMapping threw CommunicationException after some idle time
- HADOOP-9117.
Major improvement reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
replace protoc ant plugin exec with a maven plugin
- HADOOP-9043.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (util)
disallow in winutils creating symlinks with forwards slashes
- HADOOP-8982.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (net)
TestSocketIOWithTimeout fails on Windows
- HADOOP-8973.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (util)
DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs
- HADOOP-8958.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (viewfs)
ViewFs:Non absolute mount name failures when running multiple tests on Windows
- HADOOP-8957.
Major bug reported by Chris Nauroth and fixed by Chris Nauroth (fs)
AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs
- HADOOP-8924.
Major improvement reported by Chris Nauroth and fixed by Chris Nauroth (build)
Add maven plugin alternative to shell script to save package-info.java
- HADOOP-8917.
Major bug reported by Arpit Gupta and fixed by Arpit Gupta
add LOCALE.US to toLowerCase in SecurityUtil.replacePattern
- HADOOP-8886.
Major improvement reported by Eli Collins and fixed by Eli Collins (fs)
Remove KFS support
Kosmos FS (KFS) is no longer maintained and Hadoop support has been removed. KFS has been replaced by QFS (HADOOP-8885).
- HADOOP-8711.
Major improvement reported by Brandon Li and fixed by Brandon Li (ipc)
provide an option for IPC server users to avoid printing stack information for certain exceptions
- HADOOP-8569.
Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
CMakeLists.txt: define _GNU_SOURCE and _LARGEFILE_SOURCE
- HADOOP-8562.
Major new feature reported by Bikas Saha and fixed by Bikas Saha
Enhancements to support Hadoop on Windows Server and Windows Azure environments
This umbrella jira makes enhancements to support Hadoop natively on Windows Server and Windows Azure environments.
- HADOOP-8470.
Major sub-task reported by Junping Du and fixed by Junping Du
Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)
This patch should be checked in together (or after) with JIRA Hadoop-8469: https://issues.apache.org/jira/browse/HADOOP-8469
- HADOOP-8469.
Major sub-task reported by Junping Du and fixed by Junping Du
Make NetworkTopology class pluggable
- HADOOP-8462.
Major improvement reported by Govind Kamat and fixed by Govind Kamat (io)
Native-code implementation of bzip2 codec
- HADOOP-8440.
Minor bug reported by Ivan Mitic and fixed by Ivan Mitic (fs)
HarFileSystem.decodeHarURI fails for URIs whose host contains numbers
- HADOOP-8415.
Minor improvement reported by Jan van der Lugt and fixed by Jan van der Lugt (conf)
getDouble() and setDouble() in org.apache.hadoop.conf.Configuration
- HADOOP-7487.
Major bug reported by Todd Lipcon and fixed by Andrew Wang (fs)
DF should throw a more reasonable exception when mount cannot be determined
- HADOOP-7391.
Major bug reported by Sanjay Radia and fixed by Sanjay Radia
Document Interface Classification from HADOOP-5073