##### General

- Overview
- Single Node Setup
- Cluster Setup
- Commands Reference
- FileSystem Shell
- Compatibility Specification
- Downstream Developer's Guide
- Admin Compatibility Guide
- Interface Classification
- FileSystem Specification

##### Common

- CLI Mini Cluster
- Native Libraries
- Proxy User
- Rack Awareness
- Secure Mode
- Service Level Authorization
- HTTP Authentication
- Credential Provider API
- Hadoop KMS
- Tracing
- Unix Shell Guide

##### HDFS

- Architecture
- User Guide
- Commands Reference
- NameNode HA With QJM
- NameNode HA With NFS
- Observer NameNode
- Federation
- ViewFs
- ViewFsOverloadScheme
- Snapshots
- Edits Viewer
- Image Viewer
- Permissions and HDFS
- Quotas and HDFS
- libhdfs (C API)
- WebHDFS (REST API)
- HttpFS
- Short Circuit Local Reads
- Centralized Cache Management
- NFS Gateway
- Rolling Upgrade
- Extended Attributes
- Transparent Encryption
- Multihoming
- Storage Policies
- Memory Storage Support
- Synthetic Load Generator
- Erasure Coding
- Disk Balancer
- Upgrade Domain
- DataNode Admin
- Router Federation
- Provided Storage

##### MapReduce

- Tutorial
- Commands Reference
- Compatibility with 1.x
- Encrypted Shuffle
- Pluggable Shuffle/Sort
- Distributed Cache Deploy
- Support for YARN Shared Cache

##### MapReduce REST APIs

- MR Application Master
- MR History Server

##### YARN

- Architecture
- Commands Reference
- Capacity Scheduler
- Fair Scheduler
- ResourceManager Restart
- ResourceManager HA
- Resource Model
- Node Labels
- Node Attributes
- Web Application Proxy
- Timeline Server
- Timeline Service V.2
- Writing YARN Applications
- YARN Application Security
- NodeManager
- Running Applications in Docker Containers
- Using CGroups
- Secure Containers
- Registry
- Reservation System
- Graceful Decommission
- Opportunistic Containers
- YARN Federation
- Shared Cache
- Using GPU
- Using FPGA
- Placement Constraints
- YARN UI2

##### YARN REST APIs

- Introduction
- Resource Manager
- Node Manager
- Timeline Server
- Timeline Service V.2

##### YARN Service

- Overview
- QuickStart
- Concepts
- Yarn Service API
- Service Discovery
- System Services

##### Submarine

- Index
- QuickStart
- Examples

##### Hadoop Compatible File Systems

- Aliyun OSS
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- OpenStack Swift

##### Auth

- Overview
- Examples
- Configuration
- Building

##### Tools

- Hadoop Streaming
- Hadoop Archives
- Hadoop Archive Logs
- DistCp
- GridMix
- Rumen
- Resource Estimator Service
- Scheduler Load Simulator
- Hadoop Benchmarking

##### Reference

- Changelog and Release Notes
- Java API docs
- Unix Shell API
- Metrics

##### Configuration

- core-default.xml
- hdfs-default.xml
- hdfs-rbf-default.xml
- mapred-default.xml
- yarn-default.xml
- kms-default.xml
- httpfs-default.xml
- Deprecated Properties

# Apache Hadoop Changelog

## Release 2.8.0 - 2017-03-22

### INCOMPATIBLE CHANGES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-3241 | FairScheduler handles “invalid” queue names inconsistently | Major | fairscheduler | zhihai xu | zhihai xu
HADOOP-11731 | Rework the changelog and releasenotes | Major | documentation | Allen Wittenauer | Allen Wittenauer
HADOOP-11746 | rewrite test-patch.sh | Major | build, test | Allen Wittenauer | Allen Wittenauer
HDFS-8226 | Non-HA rollback compatibility broken | Blocker | . | J.Andreina | J.Andreina
HADOOP-11772 | RPC Invoker relies on static ClientCache which has synchronized(this) blocks | Major | ipc, performance | Gopal V | Haohui Mai
YARN-2336 | Fair scheduler REST api returns a missing ‘[’ bracket JSON for deep queue tree | Major | fairscheduler | Kenji Kikushima | Akira Ajisaka
YARN-41 | The RM should handle the graceful shutdown of the NM. | Major | nodemanager, resourcemanager | Ravi Teja Ch N V | Devaraj K
HDFS-6564 | Use slf4j instead of common-logging in hdfs-client | Major | build | Haohui Mai | Rakesh R
MAPREDUCE-6427 | Fix typo in JobHistoryEventHandler | Minor | . | Brahma Reddy Battula | Ray Chiang
HADOOP-12209 | Comparable type should be in FileStatus | Minor | fs | Yong Zhang | Yong Zhang
HADOOP-12269 | Update aws-sdk dependency to 1.10.6; move to aws-sdk-s3 | Major | fs/s3 | Thomas Demoor | Thomas Demoor
HDFS-8900 | Compact XAttrs to optimize memory footprint. | Major | namenode | Yi Liu | Yi Liu
YARN-4087 | Followup fixes after YARN-2019 regarding RM behavior when state-store error occurs | Major | . | Jian He | Jian He
HADOOP-12416 | Trash messages should be handled by Logger instead of being delivered on System.out | Major | trash | Ashutosh Chauhan | Mingliang Liu
HDFS-9063 | Correctly handle snapshot path for getContentSummary | Major | namenode | Jing Zhao | Jing Zhao
HDFS-9433 | DFS getEZForPath API on a non-existent file should throw FileNotFoundException | Major | encryption | Rakesh R | Rakesh R
HADOOP-11252 | RPC client does not time out by default | Critical | ipc | Wilfred Spiegelenburg | Masatake Iwasaki
HDFS-9047 | Retire libwebhdfs | Major | webhdfs | Allen Wittenauer | Haohui Mai
HADOOP-12651 | Replace dev-support with wrappers to Yetus | Major | scripts | Allen Wittenauer | Allen Wittenauer
HADOOP-12552 | Fix undeclared/unused dependency to httpclient | Minor | build | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11792 | Remove all of the CHANGES.txt files | Major | build | Allen Wittenauer | Andrew Wang
YARN-5035 | FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on | Major | fairscheduler | Karthik Kambatla | Karthik Kambatla
HADOOP-12892 | fix/rewrite create-release | Blocker | build | Allen Wittenauer | Allen Wittenauer
HADOOP-13139 | Branch-2: S3a to use thread pool that blocks clients | Major | fs/s3 | Pieter Reuse | Pieter Reuse
HADOOP-13382 | remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects | Major | build | Matt Foley | Matt Foley
HDFS-7933 | fsck should also report decommissioning replicas. | Major | namenode | Jitendra Nath Pandey | Xiaoyu Yao
HADOOP-13560 | S3ABlockOutputStream to support huge (many GB) file writes | Major | fs/s3 | Steve Loughran | Steve Loughran
HDFS-11048 | Audit Log should escape control characters | Major | . | Eric Badger | Eric Badger
HADOOP-13812 | Upgrade Tomcat to 6.0.48 | Blocker | kms | John Zhuge | John Zhuge
HADOOP-13929 | ADLS connector should not check in contract-test-options.xml | Major | fs/adl, test | John Zhuge | John Zhuge
HADOOP-14138 | Remove S3A ref from META-INF service discovery, rely on existing core-default entry | Critical | fs/s3 | Steve Loughran | Steve Loughran

### IMPORTANT ISSUES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-4785 | inconsistent value type of the “type” field for LeafQueueInfo in response of RM REST API - cluster/scheduler | Major | webapp | Jayesh | Varun Vasudev
YARN-6959 | RM may allocate wrong AM Container for new attempt | Major | capacity scheduler, fairscheduler, scheduler | Yuqi Wang | Yuqi Wang

### NEW FEATURES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-8934 | Shell command ls should include sort options | Minor | fs | Jonathan Allen | Jonathan Allen
HADOOP-9477 | Add posixGroups support for LDAP groups mapping service | Major | . | Kai Zheng | Dapeng Sun
HDFS-8009 | Signal congestion on the DataNode | Major | datanode | Haohui Mai | Haohui Mai
YARN-2901 | Add errors and warning metrics page to RM, NM web UI | Major | nodemanager, resourcemanager | Varun Vasudev | Varun Vasudev
HDFS-7891 | A block placement policy with best rack failure tolerance | Minor | namenode | Walter Su | Walter Su
HADOOP-11843 | Make setting up the build environment easier | Major | build | Niels Basjes | Niels Basjes
MAPREDUCE-6284 | Add Task Attempt State API to MapReduce Application Master REST API | Minor | . | Ryu Kobayashi | Ryu Kobayashi
HADOOP-10971 | Add -C flag to make `hadoop fs -ls` print filenames only | Major | fs | Ryan Williams | Kengo Seki
MAPREDUCE-6364 | Add a “Kill” link to Task Attempts page | Minor | applicationmaster | Ryu Kobayashi | Ryu Kobayashi
HDFS-8487 | Generalize BlockInfo in preparation of merging HDFS-7285 into trunk and branch-2 | Major | namenode | Zhe Zhang | Zhe Zhang
HDFS-8608 | Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks) | Major | . | Zhe Zhang | Zhe Zhang
HADOOP-5732 | Add SFTP FileSystem | Minor | fs | Íñigo Goiri | ramtin
HDFS-8622 | Implement GETCONTENTSUMMARY operation for WebImageViewer | Major | . | Jagadesh Kiran N | Jagadesh Kiran N
HDFS-8155 | Support OAuth2 in WebHDFS | Major | webhdfs | Jakob Homan | Jakob Homan
MAPREDUCE-6415 | Create a tool to combine aggregated logs into HAR files | Major | . | Robert Kanter | Robert Kanter
HADOOP-12360 | Create StatsD metrics2 sink | Minor | metrics | Dave Marion | Dave Marion
YARN-261 | Ability to fail AM attempts | Major | api | Jason Lowe | Rohith Sharma K S
HDFS-9184 | Logging HDFS operation’s caller context into audit logs | Major | . | Mingliang Liu | Mingliang Liu
HDFS-9057 | allow/disallow snapshots via webhdfs | Major | webhdfs | Allen Wittenauer | Brahma Reddy Battula
YARN-4349 | Support CallerContext in YARN | Major | . | Wangda Tan | Wangda Tan
YARN-3623 | We should have a config to indicate the Timeline Service version | Major | timelineserver | Zhijie Shen | Xuan Gong
HADOOP-12657 | Add a option to skip newline on empty files with getMerge -nl | Minor | . | Jan Filipiak | Kanaka Kumar Avvaru
YARN-3458 | CPU resource monitoring in Windows | Minor | nodemanager | Íñigo Goiri | Íñigo Goiri
HADOOP-12691 | Add CSRF Filter for REST APIs to Hadoop Common | Major | security | Larry McCay | Larry McCay
HADOOP-12635 | Adding Append API support for WASB | Major | fs/azure | Dushyanth | Dushyanth
HADOOP-12426 | Add Entry point for Kerberos health check | Minor | security | Steve Loughran | Steve Loughran
HDFS-9244 | Support nested encryption zones | Major | encryption | Xiaoyu Yao | Zhe Zhang
HADOOP-12548 | Read s3a creds from a Credential Provider | Major | fs/s3 | Allen Wittenauer | Larry McCay
HDFS-9711 | Integrate CSRF prevention filter in WebHDFS. | Major | datanode, namenode, webhdfs | Chris Nauroth | Chris Nauroth
HDFS-9835 | OIV: add ReverseXML processor which reconstructs an fsimage from an XML file | Major | tools | Colin P. McCabe | Colin P. McCabe
HDFS-9239 | DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness | Major | datanode, namenode | Chris Nauroth | Chris Nauroth
HADOOP-12909 | Change ipc.Client to support asynchronous calls | Major | ipc | Tsz Wo Nicholas Sze | Xiaobing Zhou
HDFS-9945 | Datanode command for evicting writers | Major | datanode | Kihwal Lee | Kihwal Lee
HADOOP-13008 | Add XFS Filter for UIs to Hadoop Common | Major | security | Larry McCay | Larry McCay
HADOOP-13065 | Add a new interface for retrieving FS and FC Statistics | Major | fs | Ram Venkatesh | Mingliang Liu
HADOOP-12723 | S3A: Add ability to plug in any AWSCredentialsProvider | Major | fs/s3 | Steven K. Wong | Steven K. Wong
HADOOP-13226 | Support async call retry and failover | Major | io, ipc | Xiaobing Zhou | Tsz Wo Nicholas Sze
HADOOP-12537 | S3A to support Amazon STS temporary credentials | Minor | fs/s3 | Sean Mackrory | Sean Mackrory
HDFS-9804 | Allow long-running Balancer to login with keytab | Major | balancer & mover, security | Xiao Chen | Xiao Chen
HDFS-10918 | Add a tool to get FileEncryptionInfo from CLI | Major | encryption | Xiao Chen | Xiao Chen
HADOOP-13716 | Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup | Major | test | Steve Loughran | Steve Loughran
HADOOP-14049 | Honour AclBit flag associated to file/folder permission for Azure datalake account | Major | fs/adl | Vishwajeet Dusane | Vishwajeet Dusane
HADOOP-14048 | REDO operation of WASB#AtomicRename should create placeholder blob for destination folder | Critical | fs/azure | NITIN VERMA | NITIN VERMA
MAPREDUCE-6304 | Specifying node labels when submitting MR jobs | Major | job submission | Jian Fang | Naganarasimha G R
YARN-1963 | Support priorities across applications within the same queue | Major | api, resourcemanager | Arun C Murthy | Sunil Govindan

### IMPROVEMENTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HDFS-2580 | NameNode#main(…) can make use of GenericOptionsParser. | Minor | namenode | Harsh J | Harsh J
MAPREDUCE-5232 | log classpath and other key properties on child JVM start | Major | mrv1, mrv2 | Sangjin Lee | Sangjin Lee
HADOOP-7713 | dfs -count -q should label output column | Trivial | . | Nigel Daley | Jonathan Allen
HDFS-7546 | Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern | Minor | security | Harsh J | Harsh J
HADOOP-11692 | Improve authentication failure WARN message to avoid user confusion | Major | ipc | Yongjun Zhang | Yongjun Zhang
HADOOP-11226 | Add a configuration to set ipc.Client’s traffic class with IPTOS_LOWDELAY|IPTOS_RELIABILITY | Major | ipc | Gopal V | Gopal V
HADOOP-11711 | Provide a default value for AES/CTR/NoPadding CryptoCodec classes | Minor | . | Andrew Wang | Andrew Wang
MAPREDUCE-4414 | Add main methods to JobConf and YarnConfiguration, for debug purposes | Major | client | Harsh J | Plamen Jeliazkov
MAPREDUCE-6105 | Inconsistent configuration in property mapreduce.reduce.shuffle.merge.percent | Trivial | . | Dongwook Kwon | Ray Chiang
HDFS-2360 | Ugly stacktrace when quota exceeds | Minor | hdfs-client | Rajit Saha | Harsh J
MAPREDUCE-6100 | replace “mapreduce.job.credentials.binary” with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. | Trivial | mrv2 | zhihai xu | zhihai xu
MAPREDUCE-5755 | MapTask.MapOutputBuffer#compare/swap should have @Override annotation | Trivial | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
MAPREDUCE-4653 | TestRandomAlgorithm has an unused “import” statement | Trivial | contrib/gridmix | Amir Sanjar | Amir Sanjar
HADOOP-11659 | o.a.h.fs.FileSystem.Cache#remove should use a single hash map lookup | Minor | fs | Gera Shegalov | Brahma Reddy Battula
HADOOP-11709 | Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable | Trivial | . | Ajith S | Ajith S
HDFS-7835 | make initial sleeptime in locateFollowingBlock configurable for DFSClient. | Major | hdfs-client | zhihai xu | zhihai xu
HDFS-7829 | Code clean up for LocatedBlock | Minor | . | Jing Zhao | Takanobu Asanuma
MAPREDUCE-6282 | Reuse historyFileAbsolute.getFileSystem in CompletedJob#loadFullHistoryData for code optimization. | Trivial | jobhistoryserver | zhihai xu | zhihai xu
HADOOP-11447 | Add a more meaningful toString method to SampleStat and MutableStat | Minor | metrics | Karthik Kambatla | Karthik Kambatla
YARN-3350 | YARN RackResolver spams logs with messages at info level | Major | . | Wilfred Spiegelenburg | Wilfred Spiegelenburg
MAPREDUCE-6239 | Consolidate TestJobConf classes in hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-core | Minor | client | Varun Saxena | Varun Saxena
MAPREDUCE-5190 | Unnecessary condition test in RandomSampler | Minor | mrv2 | Jingguo Yao | Jingguo Yao
MAPREDUCE-6287 | Deprecated methods in org.apache.hadoop.examples.Sort | Minor | examples | Chao Zhang | Chao Zhang
HADOOP-11737 | mockito’s version in hadoop-nfs’ pom.xml shouldn’t be specified | Minor | nfs | Kengo Seki | Kengo Seki
YARN-2868 | FairScheduler: Metric for latency to allocate first container for an application | Major | . | Ray Chiang | Ray Chiang
HDFS-7875 | Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated | Trivial | datanode | nijel | nijel
HDFS-7793 | Refactor DFSOutputStream separating DataStreamer out | Major | hdfs-client | Kai Zheng | Li Bo
HADOOP-11741 | Add LOG.isDebugEnabled() guard for some LOG.debug() | Major | . | Walter Su | Walter Su
MAPREDUCE-579 | Streaming “slowmatch” documentation | Trivial | contrib/streaming | Bo Adler | Harsh J
HDFS-7928 | Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy | Major | datanode | Rushabh S Shah | Rushabh S Shah
HADOOP-11719 | [Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text | Minor | scripts | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-8004 | Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone | Trivial | encryption | Andrew Wang | Andrew Wang
HDFS-7890 | Improve information on Top users for metrics in RollingWindowsManager and lower log level | Major | . | J.Andreina | J.Andreina
HDFS-4396 | Add START_MSG/SHUTDOWN_MSG for ZKFC | Major | auto-failover, ha, tools | Liang Xie | Liang Xie
HADOOP-11660 | Add support for hardware crc of HDFS checksums on ARM aarch64 architecture | Minor | native | Edward Nevill | Edward Nevill
HDFS-7645 | Rolling upgrade is restoring blocks from trash multiple times | Major | datanode | Nathan Roberts | Keisuke Ogiwara
HDFS-3918 | EditLogTailer shouldn’t log WARN when other node is in standby mode | Major | ha | Todd Lipcon | Todd Lipcon
HDFS-7944 | Minor cleanup of BlockPoolManager#getAllNamenodeThreads | Minor | . | Arpit Agarwal | Arpit Agarwal
YARN-3258 | FairScheduler: Need to add more logging to investigate allocations | Minor | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
HDFS-7671 | hdfs user guide should point to the common rack awareness doc | Major | documentation | Allen Wittenauer | Kai Sasaki
YARN-3412 | RM tests should use MockRM where possible | Major | resourcemanager, test | Karthik Kambatla | Karthik Kambatla
YARN-3428 | Debug log resources to be localized for a container | Trivial | nodemanager | Karthik Kambatla | Karthik Kambatla
YARN-3424 | Change logs for ContainerMonitorImpl’s resourse monitoring from info to debug | Major | nodemanager | Anubhav Dhoot | Anubhav Dhoot
YARN-3248 | Display count of nodes blacklisted by apps in the web UI | Major | capacityscheduler, resourcemanager | Varun Vasudev | Varun Vasudev
HDFS-7978 | Add LOG.isDebugEnabled() guard for some LOG.debug(..) | Major | . | Walter Su | Walter Su
HDFS-8008 | Support client-side back off when the datanodes are congested | Major | hdfs-client | Haohui Mai | Haohui Mai
HDFS-7888 | Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing | Minor | hdfs-client | Li Bo | Li Bo
HDFS-8035 | Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager | Minor | namenode | Haohui Mai | Haohui Mai
HADOOP-9805 | Refactor RawLocalFileSystem#rename for improved testability. | Minor | fs, test | Chris Nauroth | Jean-Pierre Matsumoto
HADOOP-11785 | Reduce number of listStatus operation in distcp buildListing() | Minor | tools/distcp | Zoran Dimitrijevic | Zoran Dimitrijevic
HADOOP-11717 | Add Redirecting WebSSO behavior with JWT Token in Hadoop Auth | Major | security | Larry McCay | Larry McCay
YARN-3294 | Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period | Major | capacityscheduler | Varun Vasudev | Varun Vasudev
HDFS-8073 | Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. | Trivial | namenode | Walter Su | Walter Su
HDFS-8076 | Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible | Major | . | Zhe Zhang | Zhe Zhang
HDFS-7979 | Initialize block report IDs with a random number | Minor | datanode | Andrew Wang | Andrew Wang
HDFS-8101 | DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime | Minor | hdfs-client | Sean Busbey | Sean Busbey
YARN-3293 | Track and display capacity scheduler health metrics in web UI | Major | capacityscheduler | Varun Vasudev | Varun Vasudev
MAPREDUCE-6291 | Correct mapred queue usage command | Minor | client | Brahma Reddy Battula | Brahma Reddy Battula
MAPREDUCE-6307 | Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval | Minor | . | Akira Ajisaka | J.Andreina
YARN-3348 | Add a ‘yarn top’ tool to help understand cluster usage | Major | resourcemanager | Varun Vasudev | Varun Vasudev
YARN-3469 | ZKRMStateStore: Avoid setting watches that are not required | Minor | . | Jun Gong | Jun Gong
HDFS-8117 | More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data | Major | . | Zhe Zhang | Zhe Zhang
HDFS-8144 | Split TestLazyPersistFiles into multiple tests | Major | test | Arpit Agarwal | Arpit Agarwal
YARN-3404 | View the queue name to YARN Application page | Minor | . | Ryu Kobayashi | Ryu Kobayashi
YARN-3451 | Add start time and Elapsed in ApplicationAttemptReport and display the same in RMAttemptBlock WebUI | Major | api, webapp | Rohith Sharma K S | Rohith Sharma K S
HDFS-7863 | Missing description of some methods and parameters in javadoc of FSDirDeleteOp | Minor | . | Yongjun Zhang | Brahma Reddy Battula
HDFS-8152 | Refactoring of lazy persist storage cases | Major | test | Arpit Agarwal | Arpit Agarwal
HDFS-8133 | Improve readability of deleted block check | Major | namenode | Daryn Sharp | Daryn Sharp
HADOOP-11812 | Implement listLocatedStatus for ViewFileSystem to speed up split calculation | Blocker | fs | Gera Shegalov | Gera Shegalov
MAPREDUCE-6297 | Task Id of the failed task in diagnostics should link to the task page | Minor | jobhistoryserver | Siqi Li | Siqi Li
HADOOP-11827 | Speed-up distcp buildListing() using threadpool | Major | tools/distcp | Zoran Dimitrijevic | Zoran Dimitrijevic
YARN-3494 | Expose AM resource limit and usage in QueueMetrics | Major | . | Jian He | Rohith Sharma K S
YARN-3503 | Expose disk utilization percentage and bad local and log dir counts on NM via JMX | Major | nodemanager | Varun Vasudev | Varun Vasudev
YARN-3410 | YARN admin should be able to remove individual application records from RMStateStore | Critical | resourcemanager, yarn | Wangda Tan | Rohith Sharma K S
HDFS-8215 | Refactor NamenodeFsck#check method | Minor | namenode | Takanobu Asanuma | Takanobu Asanuma
YARN-3511 | Add errors and warnings page to ATS | Major | timelineserver | Varun Vasudev | Varun Vasudev
HDFS-8176 | Record from/to snapshots in audit log for snapshot diff report | Minor | snapshots | J.Andreina | J.Andreina
YARN-3406 | Display count of running containers in the RM’s Web UI | Minor | . | Ryu Kobayashi | Ryu Kobayashi
HADOOP-11357 | Print information of the build enviornment in test-patch.sh | Minor | scripts | Haohui Mai | Allen Wittenauer
HDFS-8204 | Mover/Balancer should not schedule two replicas to the same DN | Minor | balancer & mover | Walter Su | Walter Su
HDFS-8280 | Code Cleanup in DFSInputStream | Minor | . | Jing Zhao | Jing Zhao
HDFS-8283 | DataStreamer cleanup and some minor improvement | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-5574 | Remove buffer copy in BlockReader.skip | Trivial | . | Binglin Chang | Binglin Chang
HDFS-7770 | Need document for storage type label of data node storage locations under dfs.datanode.data.dir | Major | documentation | Xiaoyu Yao | Xiaoyu Yao
HDFS-8200 | Refactor FSDirStatAndListingOp | Major | . | Haohui Mai | Haohui Mai
YARN-3363 | add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. | Major | nodemanager | zhihai xu | zhihai xu
HDFS-7397 | Add more detail to the documentation for the conf key “dfs.client.read.shortcircuit.streams.cache.size” | Minor | hdfs-client | Tsz Wo Nicholas Sze | Brahma Reddy Battula
YARN-2980 | Move health check script related functionality to hadoop-common | Blocker | . | Ming Ma | Varun Saxena
HADOOP-11911 | test-patch should allow configuration of default branch | Minor | . | Sean Busbey | Sean Busbey
HDFS-7758 | Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-11925 | backport trunk’s smart-apply-patch.sh to branch-2 | Major | scripts | Allen Wittenauer | Allen Wittenauer
MAPREDUCE-6192 | Create unit test to automatically compare MR related classes and mapred-default.xml | Minor | . | Ray Chiang | Ray Chiang
HADOOP-11813 | releasedocmaker.py should use today’s date instead of unreleased | Minor | build | Allen Wittenauer | Darrell Taylor
YARN-3491 | PublicLocalizer#addResource is too slow. | Critical | nodemanager | zhihai xu | zhihai xu
MAPREDUCE-6279 | AM should explicity exit JVM after all services have stopped | Major | . | Jason Lowe | Eric Payne
HDFS-8108 | Fsck should provide the info on mandatory option to be used along with “-blocks , -locations and -racks” | Trivial | documentation | J.Andreina | J.Andreina
HDFS-8207 | Improper log message when blockreport interval compared with initial delay | Minor | . | Brahma Reddy Battula | Brahma Reddy Battula
MAPREDUCE-6079 | Rename JobImpl#username to reporterUserName | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-8209 | Support different number of datanode directories in MiniDFSCluster. | Minor | test | Surendra Singh Lilhore | Surendra Singh Lilhore
YARN-3169 | Drop YARN’s overview document | Major | documentation | Allen Wittenauer | Brahma Reddy Battula
YARN-2784 | Make POM project names consistent | Minor | build | Rohith Sharma K S | Rohith Sharma K S
MAPREDUCE-5981 | Log levels of certain MR logs can be changed to DEBUG | Major | . | Varun Saxena | Varun Saxena
HADOOP-6842 | “hadoop fs -text” does not give a useful text representation of MapWritable objects | Major | io | Steven K. Wong | Akira Ajisaka
YARN-20 | More information for “yarn.resourcemanager.webapp.address” in yarn-default.xml | Trivial | documentation, resourcemanager | Nemon Lou | Bartosz Ługowski
HDFS-5640 | Add snapshot methods to FileContext. | Major | hdfs-client, snapshots | Chris Nauroth | Rakesh R
HDFS-8284 | Update documentation about how to use HTrace with HDFS | Major | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-7433 | Optimize performance of DatanodeManager’s node map | Critical | namenode | Daryn Sharp | Daryn Sharp
MAPREDUCE-5248 | Let NNBenchWithoutMR specify the replication factor for its test | Minor | client, test | Erik Paulson | Erik Paulson
HADOOP-9737 | JarFinder#getJar should delete the jar file upon destruction of the JVM | Major | util | Esteban Gutierrez | Jean-Baptiste Onofré
YARN-1050 | Document the Fair Scheduler REST API | Major | documentation, fairscheduler | Sandy Ryza | Kenji Kikushima
YARN-3271 | FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability | Major | . | Karthik Kambatla | nijel
YARN-2206 | Update document for applications REST API response examples | Minor | documentation | Kenji Kikushima | Brahma Reddy Battula
HDFS-6757 | Simplify lease manager with INodeID | Major | . | Haohui Mai | Haohui Mai
HDFS-8327 | Simplify quota calculations for snapshots and truncate | Major | . | Haohui Mai | Haohui Mai
YARN-1287 | Consolidate MockClocks | Major | . | Sandy Ryza | Sebastian Wong
HDFS-8357 | Consolidate parameters of INode.CleanSubtree() into a parameter objects. | Major | . | Haohui Mai | Li Lu
HADOOP-11950 | Add cli option to test-patch to set the project-under-test | Minor | . | Sean Busbey | Sean Busbey
HADOOP-11948 | test-patch’s issue matching regex should be configurable. | Major | . | Sean Busbey | Sean Busbey
MAPREDUCE-5465 | Tasks are often killed before they exit on their own | Major | mr-am, mrv2 | Radim Kolar | Ming Ma
YARN-3513 | Remove unused variables in ContainersMonitorImpl and add debug log for overall resource usage by all containers | Trivial | nodemanager | Naganarasimha G R | Naganarasimha G R
HDFS-8255 | Rename getBlockReplication to getPreferredBlockReplication | Major | . | Zhe Zhang | Zhe Zhang
YARN-3613 | TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods | Minor | test | Karthik Kambatla | nijel
HDFS-6184 | Capture NN’s thread dump when it fails over | Major | namenode | Ming Ma | Ming Ma
YARN-3539 | Compatibility doc to state that ATS v1 is a stable REST API | Major | documentation | Steve Loughran | Steve Loughran
HADOOP-9723 | Improve error message when hadoop archive output path already exists | Trivial | . | Stephen Chu | Yongjun Zhang
HADOOP-11713 | ViewFileSystem should support snapshot methods. | Major | fs | Chris Nauroth | Rakesh R
HDFS-8350 | Remove old webhdfs.xml and other outdated documentation stuff | Major | documentation | Akira Ajisaka | Brahma Reddy Battula
HADOOP-11960 | Enable Azure-Storage Client Side logging. | Major | tools | Dushyanth | Dushyanth
HDFS-6888 | Allow selectively audit logging ops | Major | . | Kihwal Lee | Chen He
HDFS-8397 | Refactor the error handling code in DataStreamer | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8394 | Move getAdditionalBlock() and related functionalities into a separate class | Major | . | Haohui Mai | Haohui Mai
HADOOP-11939 | Deprecate DistCpV1 and Logalyzer | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-4185 | Add a metric for number of active leases | Major | namenode | Kihwal Lee | Rakesh R
HADOOP-1540 | Support file exclusion list in distcp | Minor | util | Senthil Subramanian | Steven Rand
HADOOP-11103 | Clean up RemoteException | Trivial | ipc | Sean Busbey | Sean Busbey
HDFS-8131 | Implement a space balanced block placement policy | Minor | namenode | Liu Shaohui | Liu Shaohui
HADOOP-11970 | Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom | Major | . | Sean Busbey | Sean Busbey
HADOOP-11995 | Make jetty version configurable from the maven command line | Trivial | build, ld | sriharsha devineni | sriharsha devineni
HDFS-4383 | Document the lease limits | Minor | . | Eli Collins | Mohammad Arshad
HADOOP-10366 | Add whitespaces between the classes for values in core-default.xml to fit better in browser | Minor | documentation | Chengwei Yang | Kanaka Kumar Avvaru
HADOOP-11594 | Improve the readability of site index of documentation | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
YARN-160 | nodemanagers should obtain cpu/memory values from underlying OS | Major | nodemanager | Alejandro Abdelnur | Varun Vasudev
HADOOP-11242 | Record the time of calling in tracing span of IPC server | Minor | ipc | Masatake Iwasaki | Masatake Iwasaki
YARN-3722 | Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtils | Minor | test | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11894 | Bump the version of Apache HTrace to 3.2.0-incubating | Major | . | Masatake Iwasaki | Masatake Iwasaki
YARN-3489 | RMServerUtils.validateResourceRequests should only obtain queue info once | Major | resourcemanager | Jason Lowe | Varun Saxena
HDFS-8443 | Document dfs.namenode.service.handler.count in hdfs-site.xml | Major | documentation | Akira Ajisaka | J.Andreina
YARN-3547 | FairScheduler: Apps that have no resource demand should not participate scheduling | Major | fairscheduler | Xianyin Xin | Xianyin Xin
YARN-3713 | Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition | Minor | nodemanager | zhihai xu | zhihai xu
HADOOP-12043 | Display warning if defaultFs is not set when running fs commands. | Minor | fs | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3467 | Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI | Minor | webapp, yarn | Anthony Rojas | Anubhav Dhoot
HDFS-8490 | Typo in trace enabled log in ExceptionHandler of WebHDFS | Trivial | webhdfs | Jakob Homan | Archana T
HDFS-8521 | Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}} | Trivial | . | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-6174 | Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. | Major | mrv2 | Eric Payne | Eric Payne
HDFS-8532 | Make the visibility of DFSOutputStream#streamer member variable to private | Trivial | . | Rakesh R | Rakesh R
HDFS-8535 | Clarify that dfs usage in dfsadmin -report output includes all block replicas. | Minor | documentation | Lei (Eddy) Xu | Lei (Eddy) Xu
MAPREDUCE-6383 | Pi job (QuasiMonteCarlo) should not try to read the results file if its job fails | Major | examples | Harsh J | Harsh J
YARN-3259 | FairScheduler: Trigger fairShare updates on node events | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
HADOOP-12059 | S3Credentials should support use of CredentialProvider | Major | fs/s3 | Sean Busbey | Sean Busbey
MAPREDUCE-6354 | ShuffleHandler should be able to log shuffle connections | Major | . | Chang Li | Chang Li
HADOOP-12055 | Deprecate usage of NativeIO#link | Major | native | Andrew Wang | Andrew Wang
HDFS-8432 | Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. | Major | namenode, rolling upgrades | Chris Nauroth | Chris Nauroth
HDFS-8116 | Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager | Trivial | namenode | Xiaoyu Yao | Brahma Reddy Battula
YARN-2716 | Refactor ZKRMStateStore retry code with Apache Curator | Major | . | Jian He | Karthik Kambatla
HDFS-8553 | Document hdfs class path options | Major | documentation | Xiaoyu Yao | Brahma Reddy Battula
YARN-3786 | Document yarn class path options | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula
MAPREDUCE-6392 | Document mapred class path options | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-8549 | Abort the balancer if an upgrade is in progress | Major | balancer & mover | Andrew Wang | Andrew Wang
HDFS-8573 | Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-11971 | Move test utilities for tracing from hadoop-hdfs to hadoop-common | Minor | tracing | Masatake Iwasaki | Masatake Iwasaki
HDFS-8361 | Choose SSD over DISK in block placement | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-3789 | Improve logs for LeafQueue#activateApplications() | Minor | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-8606 | Cleanup DFSOutputStream by removing unwanted changes | Minor | hdfs-client | Rakesh R | Rakesh R
YARN-3148 | Allow CORS related headers to passthrough in WebAppProxyServlet | Major | . | Prakash Ramachandran | Varun Saxena
HDFS-8589 | Fix unused imports in BPServiceActor and BlockReportLeaseManager | Trivial | . | Colin P. McCabe | Colin P. McCabe
HADOOP-7139 | Allow appending to existing SequenceFiles | Major | io | Stephen Rose | Kanaka Kumar Avvaru
HDFS-8605 | Merge Refactor of DFSOutputStream from HDFS-7285 branch | Major | . | Vinayakumar B | Vinayakumar B
MAPREDUCE-6395 | Improve the commit failure messages in MRAppMaster recovery | Major | applicationmaster | Gera Shegalov | Brahma Reddy Battula
HDFS-8582 | Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings | Minor | datanode, hdfs-client | Lei (Eddy) Xu | Lei (Eddy) Xu
MAPREDUCE-6316 | Task Attempt List entries should link to the task overview | Major | . | Siqi Li | Siqi Li
MAPREDUCE-6305 | AM/Task log page should be able to link back to the job | Major | . | Siqi Li | Siqi Li
YARN-3834 | Scrub debug logging of tokens during resource localization. | Major | nodemanager | Chris Nauroth | Chris Nauroth
MAPREDUCE-6408 | Queue name and user name should be printed on the job page | Major | applicationmaster | Siqi Li | Siqi Li
HDFS-8639 | Option for HTTP port of NameNode by MiniDFSClusterManager | Minor | test | Kai Sasaki | Kai Sasaki
YARN-3360 | Add JMX metrics to TimelineDataManager | Major | timelineserver | Jason Lowe | Jason Lowe
HADOOP-12049 | Control http authentication cookie persistence via configuration | Major | security | Benoy Antony | H Lu
HDFS-8462 | Implement GETXATTRS and LISTXATTRS operations for WebImageViewer | Major | . | Akira Ajisaka | Jagadesh Kiran N
HDFS-8640 | Make reserved RBW space visible through JMX | Major | . | Kanaka Kumar Avvaru | Kanaka Kumar Avvaru
HDFS-8546 | Use try with resources in DataStorage and Storage | Minor | datanode | Andrew Wang | Andrew Wang
HADOOP-11807 | add a lint mode to releasedocmaker | Minor | build, documentation, yetus | Allen Wittenauer | ramtin
HDFS-8653 | Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo | Major | . | Zhe Zhang | Zhe Zhang
HDFS-8659 | Block scanner INFO message is spamming logs | Major | datanode | Yongjun Zhang | Yongjun Zhang
MAPREDUCE-6384 | Add the last reporting reducer info for too many fetch failure diagnostics | Major | . | Chang Li | Chang Li
HADOOP-12158 | Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed | Trivial | test | Andrew Wang | Andrew Wang
HADOOP-12172 | FsShell mkdir -p makes an unnecessary check for the existence of the parent. | Minor | fs | Chris Nauroth | Chris Nauroth
HDFS-8703 | Merge refactor of DFSInputStream from ErasureCoding branch | Major | . | Vinayakumar B | Vinayakumar B
HDFS-8709 | Clarify automatic sync in FSEditLog#logEdit | Minor | . | Andrew Wang | Andrew Wang
HADOOP-12045 | Enable LocalFileSystem#setTimes to change atime | Minor | fs | Kazuho Fujii | Kazuho Fujii
HADOOP-12185 | NetworkTopology is not efficient adding/getting/removing nodes | Major | . | Íñigo Goiri | Íñigo Goiri
HADOOP-12135 | cleanup releasedocmaker | Major | yetus | Allen Wittenauer | Allen Wittenauer
HADOOP-12195 | Add annotation to package-info.java file to workaround MCOMPILER-205 | Trivial | . | Andrew Wang | Andrew Wang
HADOOP-12193 | Rename Touchz.java to Touch.java | Trivial | . | Andrew Wang | Andrew Wang
HDFS-8711 | setSpaceQuota command should print the available storage type when input storage type is wrong | Major | hdfs-client | Surendra Singh Lilhore | Surendra Singh Lilhore
HDFS-8712 | Remove “public” and “abstract” modifiers in FsVolumeSpi and FsDatasetSpi | Trivial | . | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-12194 | Support for incremental generation in the protoc plugin | Major | . | Andrew Wang | Andrew Wang
HADOOP-12180 | Move ResourceCalculatorPlugin from YARN to Common | Major | util | Chris Douglas | Chris Douglas
HADOOP-12210 | Collect network usage on the node | Major | . | Robert Grandl | Robert Grandl
YARN-3069 | Document missing properties in yarn-default.xml | Major | documentation | Ray Chiang | Ray Chiang
YARN-3381 | Fix typo InvalidStateTransitonException | Minor | api | Xiaoshuang LU | Brahma Reddy Battula
HADOOP-12211 | Collect disks usages on the node | Major | . | Robert Grandl | Robert Grandl
HDFS-8722 | Optimize datanode writes for small writes and flushes | Critical | . | Kihwal Lee | Kihwal Lee
HADOOP-12232 | Upgrade Tomcat dependency to 6.0.44. | Major | build | Chris Nauroth | Chris Nauroth
YARN-3170 | YARN architecture document needs updating | Major | documentation | Allen Wittenauer | Brahma Reddy Battula
MAPREDUCE-5762 | Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2 | Minor | documentation | Akira Ajisaka | Akira Ajisaka
YARN-3174 | Consolidate the NodeManager and NodeManagerRestart documentation into one | Major | documentation | Allen Wittenauer | Masatake Iwasaki
HDFS-7314 | When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient | Major | . | Ming Ma | Ming Ma
HADOOP-11893 | Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public | Major | security | Steve Loughran | Brahma Reddy Battula
HADOOP-12081 | Fix UserGroupInformation.java to support 64-bit zLinux | Major | security | Adam Roberts | Akira Ajisaka
HADOOP-12214 | Parse ‘HadoopArchive’ commandline using cli Options. | Minor | . | Vinayakumar B | Vinayakumar B
YARN-2921 | Fix MockRM/MockAM#waitForState sleep too long | Major | test | Karthik Kambatla | Tsuyoshi Ozawa
HADOOP-12161 | Add getStoragePolicy API to the FileSystem interface | Major | fs | Arpit Agarwal | Brahma Reddy Battula
HADOOP-12189 | Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. | Major | ipc, test | zhihai xu | zhihai xu
HADOOP-12009 | Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus | Minor | documentation, fs, test | Jakob Homan | J.Andreina
HADOOP-12259 | Utility to Dynamic port allocation | Major | test, util | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-8735 | Inotify : All events classes should implement toString() API. | Major | hdfs-client | Surendra Singh Lilhore | Surendra Singh Lilhore
HDFS-7858 | Improve HA Namenode Failover detection on the client | Major | hdfs-client | Arun Suresh | Arun Suresh
HDFS-8180 | AbstractFileSystem Implementation for WebHdfs | Major | webhdfs | Santhosh G Nayak | Santhosh G Nayak
HDFS-8811 | Move BlockStoragePolicy name’s constants from HdfsServerConstants.java to HdfsConstants.java | Major | . | Vinayakumar B | Vinayakumar B
HDFS-8822 | Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies | Major | . | Vinayakumar B | Vinayakumar B
YARN-3950 | Add unique YARN_SHELL_ID environment variable to DistributedShell | Major | applications/distributed-shell | Robert Kanter | Robert Kanter
YARN-2768 | Avoid cloning Resource in FSAppAttempt#updateDemand | Minor | fairscheduler | Hong Zhiguo | Hong Zhiguo
HDFS-8816 | Improve visualization for the Datanode tab in the NN UI | Major | . | Haohui Mai | Haohui Mai
HDFS-8821 | Explain message “Operation category X is not supported in state standby” | Minor | . | Gautam Gopalakrishnan | Gautam Gopalakrishnan
HADOOP-12271 | Hadoop Jar Error Should Be More Explanatory | Minor | . | Jesse Anderson | Josh Elser
HADOOP-12183 | Annotate the HTrace span created by FsShell with the command-line arguments passed by the user | Minor | tracing | Masatake Iwasaki | Masatake Iwasaki
YARN-3978 | Configurably turn off the saving of container info in Generic AHS | Major | timelineserver, yarn | Eric Payne | Eric Payne
YARN-3965 | Add startup timestamp to nodemanager UI | Minor | nodemanager | Hong Zhiguo | Hong Zhiguo
HADOOP-12280 | Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded | Minor | test | Masatake Iwasaki | Masatake Iwasaki
HDFS-8815 | DFS getStoragePolicy implementation using single RPC call | Major | hdfs-client | Arpit Agarwal | Surendra Singh Lilhore
YARN-3961 | Expose pending, running and reserved containers of a queue in REST api and yarn top | Major | capacityscheduler, fairscheduler, webapp | Anubhav Dhoot | Anubhav Dhoot
YARN-4019 | Add JvmPauseMonitor to ResourceManager and NodeManager | Major | nodemanager, resourcemanager | Robert Kanter | Robert Kanter
MAPREDUCE-6443 | Add JvmPauseMonitor to Job History Server | Major | jobhistoryserver | Robert Kanter | Robert Kanter
HDFS-8887 | Expose storage type and storage ID in BlockLocation | Major | . | Andrew Wang | Andrew Wang
HADOOP-12318 | Expose underlying LDAP exceptions in SaslPlainServer | Minor | security | Mike Yoder | Mike Yoder
HADOOP-12295 | Improve NetworkTopology#InnerNode#remove logic | Major | . | Yi Liu | Yi Liu
HDFS-7649 | Multihoming docs should emphasize using hostnames in configurations | Major | documentation | Arpit Agarwal | Brahma Reddy Battula
YARN-4055 | Report node resource utilization in heartbeat | Major | nodemanager | Íñigo Goiri | Íñigo Goiri
HDFS-8713 | Convert DatanodeDescriptor to use SLF4J logging | Trivial | . | Andrew Wang | Andrew Wang
HDFS-8883 | NameNode Metrics : Add FSNameSystem lock Queue Length | Major | namenode | Anu Engineer | Anu Engineer
HDFS-6407 | Add sorting and pagination in the datanode tab of the NN Web UI | Critical | namenode | Nathan Roberts | Haohui Mai
HDFS-8880 | NameNode metrics logging | Major | namenode | Arpit Agarwal | Arpit Agarwal
YARN-4057 | If ContainersMonitor is not enabled, only print related log info one time | Minor | nodemanager | Jun Gong | Jun Gong
HADOOP-12050 | Enable MaxInactiveInterval for hadoop http auth token | Major | security | Benoy Antony | H Lu
HDFS-8435 | Support CreateFlag in WebHdfs | Major | webhdfs | Vinoth Sathappan | Jakob Homan
HDFS-8911 | NameNode Metric : Add Editlog counters as a JMX metric | Major | namenode | Anu Engineer | Anu Engineer
HDFS-8917 | Cleanup BlockInfoUnderConstruction from comments and tests | Minor | namenode | Zhe Zhang | Zhe Zhang
HDFS-8884 | Fail-fast check in BlockPlacementPolicyDefault#chooseTarget | Major | . | Yi Liu | Yi Liu
HDFS-8828 | Utilize Snapshot diff report to build diff copy list in distcp | Major | distcp, snapshots | Yufei Gu | Yufei Gu
HDFS-8924 | Add pluggable interface for reading replicas in DFSClient | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe
HDFS-8928 | Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array | Minor | namenode | Zhe Zhang | Jing Zhao
HDFS-2390 | dfsadmin -setBalancerBandwidth doesnot validate -ve value | Minor | balancer & mover | Rajit Saha | Gautam Gopalakrishnan
HDFS-8983 | NameNode support for protected directories | Major | namenode | Arpit Agarwal | Arpit Agarwal
HDFS-8946 | Improve choosing datanode storage for block placement | Major | namenode | Yi Liu | Yi Liu
HDFS-8965 | Harden edit log reading code against out of memory errors | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-12368 | Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract | Trivial | . | Andrew Wang | Andrew Wang
HADOOP-12367 | Move TestFileUtil’s test resources to resources folder | Minor | . | Andrew Wang | Andrew Wang
HADOOP-12369 | Point hadoop-project/pom.xml java.security.krb5.conf within target folder | Minor | . | Andrew Wang | Andrew Wang
HDFS-328 | Improve fs -setrep error message for invalid replication factors | Major | namenode | Tsz Wo Nicholas Sze | Daniel Templeton
HADOOP-5323 | Trash documentation should describe its directory structure and configurations | Minor | documentation | Suman Sehgal | Weiwei Yang
HDFS-9021 | Use a yellow elephant rather than a blue one in diagram | Minor | . | Andrew Wang | Andrew Wang
HADOOP-12358 | Add -safely flag to rm to prompt when deleting many files | Major | fs | Xiaoyu Yao | Xiaoyu Yao
YARN-4024 | YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat | Major | resourcemanager | Wangda Tan | Hong Zhiguo
HADOOP-12384 | Add “-direct” flag option for fs copy so that user can choose not to create “._COPYING_” file | Major | fs | Chen He | J.Andreina
HDFS-9019 | Adding informative message to sticky bit permission denied exception | Minor | security | Thejas M Nair | Xiaoyu Yao
HDFS-8384 | Allow NN to startup if there are files having a lease but are not under construction | Minor | namenode | Tsz Wo Nicholas Sze | Jing Zhao
HDFS-8929 | Add a metric to expose the timestamp of the last journal | Major | journal-node | Akira Ajisaka | Surendra Singh Lilhore
HDFS-7116 | Add a command to get the balancer bandwidth | Major | balancer & mover | Akira Ajisaka | Rakesh R
YARN-4086 | Allow Aggregated Log readers to handle HAR files | Major | . | Robert Kanter | Robert Kanter
HDFS-8974 | Convert docs in xdoc format to markdown | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
YARN-4145 | Make RMHATestBase abstract so its not run when running all tests under that namespace | Minor | . | Anubhav Dhoot | Anubhav Dhoot
HADOOP-12324 | Better exception reporting in SaslPlainServer | Minor | security | Mike Yoder | Mike Yoder
YARN-2005 | Blacklisting support for scheduling AMs | Major | resourcemanager | Jason Lowe | Anubhav Dhoot
HDFS-8829 | Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning | Major | datanode | He Tianyi | He Tianyi
HDFS-9065 | Include commas on # of files, blocks, total filesystem objects in NN Web UI | Minor | namenode | Daniel Templeton | Daniel Templeton
HADOOP-12413 | AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. | Major | security | zhihai xu | zhihai xu
HDFS-8953 | DataNode Metrics logging | Major | . | Kanaka Kumar Avvaru | Kanaka Kumar Avvaru
YARN-4158 | Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers | Minor | nodemanager | zhihai xu | zhihai xu
YARN-4149 | yarn logs -am should provide an option to fetch all the log files | Major | client, nodemanager | Varun Vasudev | Varun Vasudev
HDFS-9082 | Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG | Minor | webhdfs | Santhosh G Nayak | Santhosh G Nayak
YARN-4135 | Improve the assertion message in MockRM while failing after waiting for the state. | Trivial | . | nijel | nijel
MAPREDUCE-6478 | Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob(). | Major | . | Junping Du | Junping Du
HADOOP-12404 | Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. | Minor | conf | zhihai xu | zhihai xu
HADOOP-12428 | Fix inconsistency between log-level guards and statements | Minor | . | Jackie Chang | Jagadesh Kiran N
YARN-4095 | Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. | Major | nodemanager | zhihai xu | zhihai xu
HDFS-5795 | RemoteBlockReader2#checkSuccess() shoud print error status | Trivial | . | Brandon Li | Xiao Chen
HDFS-9112 | Improve error message for Haadmin when multiple name service IDs are configured | Major | tools | Anu Engineer | Anu Engineer
HDFS-9132 | Pass genstamp to ReplicaAccessorBuilder | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe
HADOOP-12442 | Display help if the command option to "hdfs dfs " is not valid | Minor | . | nijel | nijel
HADOOP-11984 | Enable parallel JUnit tests in pre-commit. | Major | build, scripts, test | Chris Nauroth | Chris Nauroth
MAPREDUCE-6471 | Document distcp incremental copy | Major | distcp | Arpit Agarwal | Neelesh Srinivas Salian
HDFS-9148 | Incorrect assert message in TestWriteToReplica#testWriteToTemporary | Trivial | test | Tony Wu | Tony Wu
HDFS-8859 | Improve DataNode ReplicaMap memory footprint to save about 45% | Major | datanode | Yi Liu | Yi Liu
HDFS-8696 | Make the lower and higher watermark in the DN Netty server configurable | Major | webhdfs | Xiaobing Zhou | Xiaobing Zhou
YARN-3727 | For better error recovery, check if the directory exists before using it for localization. | Major | nodemanager | zhihai xu | zhihai xu
HDFS-9175 | Change scope of ‘AccessTokenProvider.getAccessToken()’ and ‘CredentialBasedAccessTokenProvider.getCredential()’ abstract methods to public | Major | webhdfs | Santhosh G Nayak | Santhosh G Nayak
HADOOP-12458 | Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common | Minor | documentation | Neelesh Srinivas Salian | Neelesh Srinivas Salian
HDFS-9151 | Mover should print the exit status/reason on console like balancer tool. | Minor | balancer & mover | Archana T | Surendra Singh Lilhore
HADOOP-12350 | WASB Logging: Improve WASB Logging around deletes, reads and writes | Major | tools | Dushyanth | Dushyanth
HADOOP-12284 | UserGroupInformation doAs can throw misleading exception | Trivial | security | Aaron Dossett | Aaron Dossett
YARN-4228 | FileSystemRMStateStore use IOUtils#close instead of fs#close | Minor | . | Bibin A Chundatt | Bibin A Chundatt
YARN-3943 | Use separate threshold configurations for disk-full detection and disk-not-full detection. | Critical | nodemanager | zhihai xu | zhihai xu
MAPREDUCE-6479 | Add missing mapred job command options in mapreduce document | Major | documentation | nijel | nijel
HADOOP-11104 | org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking | Minor | . | Ray Chiang | Ray Chiang
HDFS-9181 | Better handling of exceptions thrown during upgrade shutdown | Minor | . | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9110 | Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency | Minor | . | Charlie Helin | Charlie Helin
HDFS-9221 | HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array | Major | performance | Staffan Friberg | Staffan Friberg
HDFS-8988 | Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap | Major | . | Yi Liu | Yi Liu
HDFS-9139 | Enable parallel JUnit tests for HDFS Pre-commit | Major | test | Vinayakumar B | Vinayakumar B
HDFS-9145 | Tracking methods that hold FSNamesytemLock for too long | Major | namenode | Jing Zhao | Mingliang Liu
HADOOP-10775 | Shell operations to fail with meaningful errors on windows if winutils.exe not found | Minor | util | Steve Loughran | Steve Loughran
YARN-4253 | Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor | Major | . | Sidharta Seethana | Sidharta Seethana
YARN-4252 | Log container-executor invocation details when exit code is non-zero | Minor | nodemanager | Sidharta Seethana | Sidharta Seethana
HDFS-9238 | Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile() | Trivial | test | Tony Wu | Tony Wu
HDFS-9188 | Make block corruption related tests FsDataset-agnostic. | Major | test | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-9205 | Do not schedule corrupt blocks for replication | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-12481 | JWTRedirectAuthenticationHandler doesn’t Retain Original Query String | Major | security | Larry McCay | Larry McCay
HDFS-9257 | improve error message for “Absolute path required” in INode.java to contain the rejected path | Trivial | namenode | Marcell Szabo | Marcell Szabo
HDFS-9253 | Refactor tests of libhdfs into a directory | Major | . | Haohui Mai | Haohui Mai
HADOOP-12450 | UserGroupInformation should not log at WARN level if no groups are found | Minor | security | Elliott Clark | Elliott Clark
HADOOP-12460 | Add overwrite option for ‘get’ shell command | Major | . | Keegan Witt | Jagadesh Kiran N
HDFS-9250 | Add Precondition check to LocatedBlock#addCachedLoc | Major | namenode | Xiao Chen | Xiao Chen
HDFS-9251 | Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code. | Major | test | Lei (Eddy) Xu | Lei (Eddy) Xu
MAPREDUCE-6489 | Fail fast rogue tasks that write too much to local disk | Major | task | Maysam Yabandeh | Maysam Yabandeh
HDFS-8647 | Abstract BlockManager’s rack policy into BlockPlacementPolicy | Major | . | Ming Ma | Brahma Reddy Battula
HDFS-7087 | Ability to list /.reserved | Major | . | Andrew Wang | Xiao Chen
HDFS-9280 | Document NFS gateway export point parameter | Trivial | documentation | Zhe Zhang | Xiao Chen
HADOOP-12334 | Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries | Major | tools | Gaurav Kanade | Gaurav Kanade
HADOOP-7266 | Deprecate metrics v1 | Blocker | metrics | Luke Lu | Akira Ajisaka
YARN-2913 | Fair scheduler should have ability to set MaxResourceDefault for each queue | Major | . | Siqi Li | Siqi Li
HDFS-9264 | Minor cleanup of operations on FsVolumeList#volumes | Minor | . | Walter Su | Walter Su
HDFS-8808 | dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby | Major | . | Gautam Gopalakrishnan | Zhe Zhang
HDFS-9297 | Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile() | Trivial | test | Tony Wu | Tony Wu
HDFS-4015 | Safemode should count and report orphaned blocks | Major | namenode | Todd Lipcon | Anu Engineer
YARN-3528 | Tests with 12345 as hard-coded port break jenkins | Blocker | . | Steve Loughran | Brahma Reddy Battula
YARN-4285 | Display resource usage as percentage of queue and cluster in the RM UI | Major | resourcemanager | Varun Vasudev | Varun Vasudev
HDFS-7284 | Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas | Major | namenode | Hu Liu, | Wei-Chiu Chuang
HADOOP-12472 | Make GenericTestUtils.assertExceptionContains robust | Minor | test | Steve Loughran | Steve Loughran
HDFS-9291 | Fix TestInterDatanodeProtocol to be FsDataset-agnostic. | Minor | test | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-8945 | Update the description about replica placement in HDFS Architecture documentation | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-9292 | Make TestFileConcorruption independent to underlying FsDataset Implementation. | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-9259 | Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario | Major | . | Ming Ma | Mingliang Liu
HDFS-9299 | Give ReplicationMonitor a readable thread name | Trivial | namenode | Staffan Friberg | Staffan Friberg
HDFS-9307 | fuseConnect should be private to fuse_connect.c | Trivial | fuse-dfs | Colin P. McCabe | Mingliang Liu
HADOOP-12520 | Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. | Major | fs/azure, test | Chris Nauroth | Chris Nauroth
HDFS-9311 | Support optional offload of NameNode HA service health checks to a separate RPC server. | Major | ha, namenode | Chris Nauroth | Chris Nauroth
HDFS-9255 | Consolidate block recovery related implementation into a single class | Minor | datanode | Walter Su | Walter Su
YARN-2573 | Integrate ReservationSystem with the RM failover mechanism | Major | capacityscheduler, fairscheduler, resourcemanager | Subru Krishnan | Subru Krishnan
HDFS-6200 | Create a separate jar for hdfs-client | Major | build | Haohui Mai | Haohui Mai
HDFS-8545 | Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path | Minor | . | J.Andreina | J.Andreina
HDFS-9229 | Expose size of NameNode directory as a metric | Minor | namenode | Zhe Zhang | Surendra Singh Lilhore
YARN-4310 | FairScheduler: Log skipping reservation messages at DEBUG level | Minor | fairscheduler | Arun Suresh | Arun Suresh
HDFS-9312 | Fix TestReplication to be FsDataset-agnostic. | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-9308 | Add truncateMeta() and deleteMeta() to MiniDFSCluster | Minor | test | Tony Wu | Tony Wu
HDFS-9331 | Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use | Trivial | test | Tony Wu | Tony Wu
HDFS-9363 | Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica. | Minor | test | Tony Wu | Tony Wu
HDFS-9282 | Make data directory count and storage raw capacity related tests FsDataset-agnostic | Minor | test | Tony Wu | Tony Wu
HADOOP-12344 | Improve validateSocketPathSecurity0 error message | Trivial | net | Casey Brotherton | Casey Brotherton
HDFS-9398 | Make ByteArraryManager log message in one-line format | Minor | hdfs-client | Mingliang Liu | Mingliang Liu
HDFS-9234 | WebHdfs : getContentSummary() should give quota for storage types | Major | webhdfs | Surendra Singh Lilhore | Surendra Singh Lilhore
HDFS-9369 | Use ctest to run tests for hadoop-hdfs-native-client | Minor | . | Haohui Mai | Haohui Mai
HADOOP-12562 | Make hadoop dockerfile usable by Yetus | Major | build | Allen Wittenauer | Allen Wittenauer
YARN-4287 | Capacity Scheduler: Rack Locality improvement | Major | capacityscheduler | Nathan Roberts | Nathan Roberts
MAPREDUCE-5485 | Allow repeating job commit by extending OutputCommitter API | Critical | . | Nemon Lou | Junping Du
MAPREDUCE-6499 | Add elapsed time for retired job in JobHistoryServer WebUI | Major | webapps | Yiqun Lin | Yiqun Lin
HDFS-9252 | Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp. | Major | . | Lei (Eddy) Xu | Lei (Eddy) Xu
HADOOP-12568 | Update core-default.xml to describe posixGroups support | Minor | documentation | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4279 | Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable | Minor | client | Steve Loughran | Steve Loughran
HADOOP-12575 | Add build instruction for docker toolbox instead of boot2docker | Trivial | documentation | Kai Sasaki | Kai Sasaki
HDFS-8056 | Decommissioned dead nodes should continue to be counted as dead after NN restart | Major | . | Ming Ma | Ming Ma
HADOOP-11901 | BytesWritable fails to support 2G chunks due to integer overflow | Major | . | Reynold Xin | Reynold Xin
HDFS-9439 | Include status of closeAck into exception message in DataNode#run | Trivial | . | Xiao Chen | Xiao Chen
HDFS-9402 | Switch DataNode.LOG to use slf4j | Minor | . | Walter Su | Walter Su
HDFS-3302 | Review and improve HDFS trash documentation | Major | documentation | Harsh J | Madhu Kiran
HADOOP-10035 | Cleanup TestFilterFileSystem | Major | . | Suresh Srinivas | Suresh Srinivas
HADOOP-10555 | Add offset support to MurmurHash | Trivial | . | Sergey Shelukhin | Sergey Shelukhin
HADOOP-10068 | Improve log4j regex in testFindContainingJar | Trivial | . | Robert Rati | Robert Rati
HDFS-9024 | Deprecate the TotalFiles metric | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-7988 | Replace usage of ExactSizeInputStream with LimitInputStream. | Minor | . | Chris Nauroth | Walter Su
HDFS-9314 | Improve BlockPlacementPolicyDefault’s picking of excess replicas | Major | . | Ming Ma | Xiao Chen
MAPREDUCE-5870 | Support for passing Job priority through Application Submission Context in Mapreduce Side | Major | client | Sunil Govindan | Sunil Govindan
HDFS-9434 | Recommission a datanode with 500k blocks may pause NN for 30 seconds | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-4132 | Separate configs for nodemanager to resourcemanager connection timeout and retries | Major | nodemanager | Chang Li | Chang Li
HDFS-8512 | WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info | Major | webhdfs | Sumana Sathish | Xiaoyu Yao
HADOOP-12600 | FileContext and AbstractFileSystem should be annotated as a Stable interface. | Blocker | fs | Chris Nauroth | Chris Nauroth
HDFS-9269 | Update the documentation and wrapper for fuse-dfs | Minor | fuse-dfs | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9485 | Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block | Minor | namenode | Mingliang Liu | Mingliang Liu
HDFS-9490 | MiniDFSCluster should change block generation stamp via FsDatasetTestUtils | Minor | test | Tony Wu | Tony Wu
HDFS-8831 | Trash Support for deletion in HDFS encryption zone | Major | encryption | Xiaoyu Yao | Xiaoyu Yao
HDFS-9474 | TestPipelinesFailover should not fail when printing debug message | Major | . | Yongjun Zhang | John Zhuge
YARN-3456 | Improve handling of incomplete TimelineEntities | Minor | timelineserver | Steve Loughran | Varun Saxena
HDFS-9527 | The return type of FSNamesystem.getBlockCollection should be changed to INodeFile | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-9472 | concat() API does not give proper exception messages on ./reserved relative path | Major | namenode | Rakesh R | Rakesh R
HDFS-9532 | Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction | Trivial | datanode | Yongjun Zhang | Yongjun Zhang
HDFS-9528 | Cleanup namenode audit/log/exception messages | Minor | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8860 | Remove unused Replica copyOnWrite code | Major | . | Lei (Eddy) Xu | Lei (Eddy) Xu
MAPREDUCE-6436 | JobHistory cache issue | Blocker | . | Ryu Kobayashi | Kai Sasaki
HADOOP-12639 | Imrpove JavaDoc for getTrimmedStrings | Trivial | util | BELUGA BEHR | BELUGA BEHR
HDFS-9557 | Reduce object allocation in PB conversion | Major | hdfs-client | Daryn Sharp | Daryn Sharp
YARN-4207 | Add a non-judgemental YARN app completion status | Major | . | Sergey Shelukhin | Rich Haase
HDFS-9198 | Coalesce IBR processing in the NN | Major | namenode | Daryn Sharp | Daryn Sharp
HDFS-9552 | Document types of permission checks performed for HDFS operations. | Major | documentation | Chris Nauroth | Chris Nauroth
HADOOP-12570 | HDFS Secure Mode Documentation updates | Major | documentation | Arpit Agarwal | Arpit Agarwal
YARN-4480 | Clean up some inappropriate imports | Major | . | Kai Zheng | Kai Zheng
YARN-4290 | Add -showDetails option to YARN Nodes CLI to print all nodes reports information | Major | client | Wangda Tan | Sunil Govindan
YARN-4400 | AsyncDispatcher.waitForDrained should be final | Trivial | yarn | Daniel Templeton | Daniel Templeton
MAPREDUCE-6584 | Remove trailing whitespaces from mapred-default.xml | Major | documentation | Akira Ajisaka | Akira Ajisaka
HADOOP-12686 | Update FileSystemShell documentation to mention the meaning of each columns of fs -du | Minor | documentation, fs | Daisuke Kobayashi | Daisuke Kobayashi
YARN-4544 | All the log messages about rolling monitoring interval are shown with WARN level | Minor | log-aggregation, nodemanager | Takashi Ohnishi | Takashi Ohnishi
YARN-4438 | Implement RM leader election with curator | Major | . | Jian He | Jian He
HDFS-9630 | DistCp minor refactoring and clean up | Minor | distcp | Kai Zheng | Kai Zheng
YARN-4582 | Label-related invalid resource request exception should be able to properly handled by application | Major | scheduler | Bibin A Chundatt | Bibin A Chundatt
HDFS-9569 | Log the name of the fsimage being loaded for better supportability | Trivial | namenode | Yongjun Zhang | Yongjun Zhang
MAPREDUCE-6473 | Job submission can take a long time during Cluster initialization | Major | performance | Kuhu Shukla | Kuhu Shukla
HDFS-9415 | Document dfs.cluster.administrators and dfs.permissions.superusergroup | Major | documentation | Arpit Agarwal | Xiaobing Zhou
HDFS-6054 | MiniQJMHACluster should not use static port to avoid binding failure in unit test | Major | test | Brandon Li | Yongjun Zhang
YARN-4492 | Add documentation for preemption supported in Capacity scheduler | Minor | capacity scheduler | Naganarasimha G R | Naganarasimha G R
YARN-4371 | “yarn application -kill” should take multiple application ids | Major | . | Tsuyoshi Ozawa | Sunil Govindan
HDFS-9653 | Expose the number of blocks pending deletion through dfsadmin report command | Major | hdfs-client, tools | Weiwei Yang | Weiwei Yang
HADOOP-12731 | Remove useless boxing/unboxing code | Minor | performance | Kousuke Saruta | Kousuke Saruta
HDFS-9654 | Code refactoring for HDFS-8578 | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-9706 | Log more details in debug logs in BlockReceiver’s constructor | Minor | . | Xiao Chen | Xiao Chen
HDFS-9638 | Improve DistCp Help and documentation | Minor | distcp | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9566 | Remove expensive ‘BlocksMap#getStorages(Block b, final DatanodeStorage.State state)’ method | Major | namenode | Daryn Sharp | Daryn Sharp
HDFS-9721 | Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference | Major | . | Xiao Chen | Xiao Chen
HDFS-9669 | TcpPeerServer should respect ipc.server.listen.queue.size | Major | . | Elliott Clark | Elliott Clark
HDFS-9715 | Check storage ID uniqueness on datanode startup | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-4662 | Document some newly added metrics | Major | . | Jian He | Jian He
HDFS-9629 | Update the footer of Web UI to show year 2016 | Major | . | Xiao Chen | Xiao Chen
MAPREDUCE-6566 | Add retry support to mapreduce CLI tool | Major | . | Varun Vasudev | Varun Vasudev
HDFS-9726 | Refactor IBR code to a new class | Minor | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-12772 | NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid ‘loc’ values | Minor | . | Kuhu Shukla | Kuhu Shukla
HADOOP-12758 | Extend CSRF Filter with UserAgent Checks | Major | security | Larry McCay | Larry McCay
HDFS-9686 | Remove useless boxing/unboxing code | Minor | performance | Kousuke Saruta | Kousuke Saruta
MAPREDUCE-6626 | Reuse ObjectMapper instance in MapReduce | Minor | performance | Yiqun Lin | Yiqun Lin
HADOOP-12788 | OpensslAesCtrCryptoCodec should log which random number generator is used. | Minor | . | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12764 | Increase default value of KMS maxHttpHeaderSize and make it configurable | Minor | . | Zhe Zhang | Zhe Zhang
HADOOP-12776 | Remove getaclstatus call for non-acl commands in getfacl. | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-9768 | Reuse objectMapper instance in HDFS to improve the performance | Major | performance | Yiqun Lin | Yiqun Lin
HDFS-9644 | Update encryption documentation to reflect nested EZs | Major | documentation, encryption | Zhe Zhang | Zhe Zhang
HDFS-9700 | DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol | Major | hdfs-client | Gary Helmling | Gary Helmling
HDFS-9797 | Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level | Minor | hdfs-client | Íñigo Goiri | Íñigo Goiri
YARN-4682 | AMRM client to log when AMRM token updated | Major | client | Steve Loughran | Prabhu Joseph
HADOOP-12805 | Annotate CanUnbuffer with @InterfaceAudience.Public | Major | . | Ted Yu | Ted Yu
YARN-4690 | Skip object allocation in FSAppAttempt#getResourceUsage when possible | Major | . | Ming Ma | Ming Ma
HADOOP-10865 | Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases | Minor | util | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-4946 | Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable | Major | namenode | James Kinley | Nathan Roberts
HADOOP-11031 | Design Document for Credential Provider API | Major | site | Larry McCay | Larry McCay
HADOOP-12828 | Print user when services are started | Trivial | . | Brandon Li | Wei-Chiu Chuang
HADOOP-12794 | Support additional compression levels for GzipCodec | Major | io | Ravi Mutyala | Ravi Mutyala
HDFS-9425 | Expose number of blocks per volume as a metric | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12668 | Support excluding weak Ciphers in HttpServer2 through ssl-server.xml | Critical | security | Vijay Singh | Vijay Singh
HADOOP-12555 | WASB to read credentials from a credential provider | Minor | fs/azure | Chris Nauroth | Larry McCay
HDFS-8578 | On upgrade, Datanode should process all storage/data dirs in parallel | Critical | datanode | Raju Bairishetti | Vinayakumar B
HADOOP-12535 | Run FileSystem contract tests with hadoop-azure. | Major | fs/azure, test | Chris Nauroth | madhumita chakraborty
HDFS-9854 | Log cipher suite negotiation more verbosely | Major | encryption | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9843 | Document distcp options required for copying between encrypted locations | Major | distcp, documentation, encryption | Xiaoyu Yao | Xiaoyu Yao
HADOOP-12824 | Collect network and disk usage on the node running Windows | Major | . | Íñigo Goiri | Íñigo Goiri
YARN-4720 | Skip unnecessary NN operations in log aggregation | Major | . | Ming Ma | Jun Gong
HDFS-9831 | Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122 | Major | documentation, webhdfs | Xiaoyu Yao | Xiaobing Zhou
HDFS-9710 | Change DN to send block receipt IBRs in batches | Major | datanode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-6622 | Add capability to set JHS job cache to a task-based limit | Critical | jobhistoryserver | Ray Chiang | Ray Chiang
YARN-4671 | There is no need to acquire CS lock when completing a container | Major | . | MENG DING | MENG DING
HADOOP-12853 | Change WASB documentation regarding page blob support | Minor | fs/azure | madhumita chakraborty | madhumita chakraborty
HDFS-9887 | WebHdfs socket timeouts should be configurable | Major | fs, webhdfs | Austin Donnelly | Austin Donnelly
HADOOP-12859 | Disable hiding field style checks in class setters | Major | . | Kai Zheng | Kai Zheng
HDFS-9534 | Add CLI command to clear storage policy from a path. | Major | tools | Chris Nauroth | Xiaobing Zhou
HADOOP-12793 | Write a new group mapping service guide | Major | documentation | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12470 | In-page TOC of documentation should be automatically generated by doxia macro | Major | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-9889 | Update balancer/mover document about HDFS-6133 feature | Minor | . | Yongjun Zhang | Yongjun Zhang
MAPREDUCE-6648 | Add yarn.app.mapreduce.am.log.level to mapred-default.xml | Trivial | documentation | Harsh J | Harsh J
HDFS-9906 | Remove spammy log spew when a datanode is restarted | Major | namenode | Elliott Clark | Brahma Reddy Battula
HADOOP-12901 | Add warning log when KMSClientProvider cannot create a connection to the KMS server | Minor | . | Xiao Chen | Xiao Chen
HADOOP-12789 | log classpath of ApplicationClassLoader at INFO level | Minor | util | Sangjin Lee | Sangjin Lee
HDFS-9882 | Add heartbeatsTotal in Datanode metrics | Minor | datanode | Hua Liu | Hua Liu
HADOOP-12860 | Expand section “Data Encryption on HTTP” in SecureMode documentation | Minor | . | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4465 | SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled | Minor | . | Bibin A Chundatt | Bibin A Chundatt
HADOOP-12904 | Update Yetus to 0.2.0 | Blocker | build | Allen Wittenauer | Allen Wittenauer
HADOOP-12798 | Update changelog and release notes (2016-03-04) | Major | documentation | Allen Wittenauer | Allen Wittenauer
HADOOP-12905 | Clean up CHANGES.txt RAT exclusions from pom.xml files. | Trivial | build | Chris Nauroth | Chris Nauroth
HDFS-9927 | Document the new OIV ReverseXML processor | Minor | documentation | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9942 | Add an HTrace span when refreshing the groups for a username | Major | . | Colin P. McCabe | Colin P. McCabe
HDFS-9941 | Do not log StandbyException on NN, other minor logging fixes | Major | namenode | Arpit Agarwal | Arpit Agarwal
HADOOP-12923 | Move the test code in ipc.Client to test | Minor | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-9405 | Warmup NameNode EDEK caches in background thread | Major | encryption, namenode | Zhe Zhang | Xiao Chen
HDFS-9951 | Use string constants for XML tags in OfflineImageReconstructor | Minor | . | Yiqun Lin | Yiqun Lin
HADOOP-12947 | Update documentation Hadoop Groups Mapping to add static group mapping, negative cache | Minor | documentation, security | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4117 | End to end unit test with mini YARN cluster for AMRMProxy Service | Major | nodemanager, resourcemanager | Kishore Chaliparambil | Giovanni Matteo Fumarola
HADOOP-10965 | Print fully qualified path in CommandWithDestination error messages | Minor | . | André Kelpe | John Zhuge
MAPREDUCE-6663 | [NNBench] Refactor nnbench as a Tool implementation. | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12886 | Exclude weak ciphers in SSLFactory through ssl-server.xml | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4884 | Fix missing documentation about rmadmin command regarding node labels | Minor | . | Kai Sasaki | Kai Sasaki
HADOOP-12916 | Allow RPC scheduler/callqueue backoff using response times | Major | ipc | Xiaoyu Yao | Xiaoyu Yao
HADOOP-12950 | ShutdownHookManager should have a timeout for each of the Registered shutdown hook | Major | . | Xiaoyu Yao | Xiaoyu Yao
HADOOP-11661 | Deprecate FileUtil#copyMerge | Major | util | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-11687 | Ignore x-* and response headers when copying an Amazon S3 object | Major | fs/s3 | Denis Jannot | Harsh J
HADOOP-11212 | NetUtils.wrapException to handle SocketException explicitly | Major | util | Steve Loughran | Steve Loughran
HADOOP-12672 | RPC timeout should not override IPC ping interval | Major | ipc | Masatake Iwasaki | Masatake Iwasaki
HDFS-10235 | [NN UI] Last contact for Live Nodes should be relative time | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-8813 | RPC Server and Client classes need InterfaceAudience and InterfaceStability annotations | Trivial | ipc | Brandon Li | Brandon Li
YARN-4756 | Unnecessary wait in Node Status Updater during reboot | Major | . | Eric Badger | Eric Badger
HADOOP-12951 | Improve documentation on KMS ACLs and delegation tokens | Major | . | Xiao Chen | Xiao Chen
HADOOP-12994 | Specify PositionedReadable, add contract tests, fix problems | Major | fs | Steve Loughran | Steve Loughran
YARN-4630 | Remove useless boxing/unboxing code | Minor | yarn | Kousuke Saruta | Kousuke Saruta
HDFS-10279 | Improve validation of the configured number of tolerated failed volumes | Major | . | Yiqun Lin | Yiqun Lin
HADOOP-12822 | Change “Metrics intern cache overflow” log level from WARN to INFO | Minor | metrics | Akira Ajisaka | Andras Bokor
HADOOP-12969 | Mark IPC.Client and IPC.Server as @Public, @Evolving | Minor | ipc | Xiaobing Zhou | Xiaobing Zhou
HADOOP-12963 | Allow using path style addressing for accessing the s3 endpoint | Minor | fs/s3 | Andrew Baptist | Stephen Montgomery
HDFS-10280 | Document new dfsadmin command -evictWriters | Minor | documentation | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-10292 | Add block id when client got Unable to close file exception | Minor | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-9412 | getBlocks occupies FSLock and takes too long to complete | Major | balancer & mover, namenode | He Tianyi | He Tianyi
HDFS-10302 | BlockPlacementPolicyDefault should use default replication considerload value | Trivial | . | Yiqun Lin | Yiqun Lin
HDFS-10264 | Logging improvements in FSImageFormatProtobuf.Saver | Major | namenode | Konstantin Shvachko | Xiaobing Zhou
HADOOP-12985 | Support MetricsSource interface for DecayRpcScheduler Metrics | Major | . | Xiaoyu Yao | Xiaoyu Yao
HDFS-9894 | Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives | Major | . | Xiaobing Zhou | Xiaobing Zhou
HADOOP-12891 | S3AFileSystem should configure Multipart Copy threshold and chunk size | Major | fs/s3 | Andrew Olson | Andrew Olson
HADOOP-13033 | Add missing Javadoc enries to Interns.java | Minor | metrics | Andras Bokor | Andras Bokor
HDFS-10298 | Document the usage of distcp -diff option | Major | distcp, documentation | Akira Ajisaka | Takashi Ohnishi
HADOOP-13039 | Add documentation for configuration property ipc.maximum.data.length for controlling maximum RPC message size. | Major | documentation | Chris Nauroth | Mingliang Liu
HDFS-10330 | Add Corrupt Blocks Information in Metasave Output | Major | . | Kuhu Shukla | Kuhu Shukla
HADOOP-5470 | RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file | Minor | util | Colin Evans | Andras Bokor
HDFS-3702 | Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client | Minor | hdfs-client | Nicolas Liochon | Lei (Eddy) Xu
HDFS-10297 | Increase default balance bandwidth and concurrent moves | Minor | balancer & mover | John Zhuge | John Zhuge
HADOOP-12957 | Limit the number of outstanding async calls | Major | ipc | Xiaobing Zhou | Xiaobing Zhou
HDFS-9902 | Support different values of dfs.datanode.du.reserved per storage type | Major | datanode | Pan Yuxuan | Brahma Reddy Battula
HADOOP-13103 | Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException | Minor | security | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
MAPREDUCE-6678 | Allow ShuffleHandler readahead without drop-behind | Major | nodemanager | Nathan Roberts | Nathan Roberts
HADOOP-12982 | Document missing S3A and S3 properties | Minor | documentation, fs/s3, tools | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4995 | FairScheduler: Display per-queue demand on the scheduler page | Minor | . | xupeng | xupeng
HADOOP-12868 | Fix hadoop-openstack undeclared and unused dependencies | Major | tools | Allen Wittenauer | Masatake Iwasaki
HADOOP-12971 | FileSystemShell doc should explain relative path | Critical | documentation | John Zhuge | John Zhuge
HADOOP-13148 | TestDistCpViewFs to include IOExceptions in test error reports | Minor | tools/distcp | Steve Loughran | Steve Loughran
HADOOP-13146 | Refactor RetryInvocationHandler | Minor | io | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-10383 | Safely close resources in DFSTestUtil | Major | test | Mingliang Liu | Mingliang Liu
YARN-4002 | make ResourceTrackerService.nodeHeartbeat more concurrent | Critical | . | Hong Zhiguo | Hong Zhiguo
HDFS-10417 | Improve error message from checkBlockLocalPathAccess | Minor | datanode | Tianyin Xu | Tianyin Xu
HADOOP-13168 | Support Future.get with timeout in ipc async calls | Major | ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-13145 | In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. | Major | tools/distcp | Chris Nauroth | Chris Nauroth
HADOOP-13198 | Add support for OWASP’s dependency-check | Minor | build, security | Mike Yoder | Mike Yoder
HDFS-10217 | show ‘blockScheduled’ tooltip in datanodes table. | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-13199 | Add doc for distcp -filters | Trivial | documentation | John Zhuge | John Zhuge
HADOOP-13193 | Upgrade to Apache Yetus 0.3.0 | Major | build, documentation, test | Allen Wittenauer | Kengo Seki
HADOOP-13197 | Add non-decayed call metrics for DecayRpcScheduler | Major | ipc, metrics | Xiaoyu Yao | Xiaoyu Yao
HDFS-10341 | Add a metric to expose the timeout number of pending replication blocks | Major | . | Akira Ajisaka | Akira Ajisaka
HADOOP-13105 | Support timeouts in LDAP queries in LdapGroupsMapping. | Major | security | Chris Nauroth | Mingliang Liu
HADOOP-12807 | S3AFileSystem should read AWS credentials from environment variables | Minor | fs/s3 | Tobin Baker | Tobin Baker
MAPREDUCE-5044 | Have AM trigger jstack on task attempts that timeout before killing them | Major | mr-am | Jason Lowe | Eric Payne
HADOOP-10048 | LocalDirAllocator should avoid holding locks while accessing the filesystem | Major | . | Jason Lowe | Jason Lowe
MAPREDUCE-6714 | Refactor UncompressedSplitLineReader.fillBuffer() | Major | . | Daniel Templeton | Daniel Templeton
HADOOP-12943 | Add -w -r options in dfs -test command | Major | fs, scripts, tools | Weiwei Yang | Weiwei Yang
HDFS-10493 | Add links to datanode web UI in namenode datanodes page | Major | namenode, ui | Weiwei Yang | Weiwei Yang
HADOOP-13296 | Cleanup javadoc for Path | Minor | documentation | Daniel Templeton | Daniel Templeton
HDFS-7597 | DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping | Critical | webhdfs | Daryn Sharp | Daryn Sharp
HADOOP-13307 | add rsync to Dockerfile so that precommit archive works | Trivial | build | Allen Wittenauer | Allen Wittenauer
HADOOP-13067 | cleanup the dockerfile | Major | . | Allen Wittenauer | Allen Wittenauer
HADOOP-13227 | AsyncCallHandler should use an event driven architecture to handle async calls | Major | io, ipc | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-13263 | Reload cached groups in background after expiry | Major | . | Stephen O’Donnell | Stephen O’Donnell
HDFS-10440 | Improve DataNode web UI | Major | datanode, ui | Weiwei Yang | Weiwei Yang
HADOOP-13239 | Deprecate s3:// in branch-2 | Major | fs/s3 | Mingliang Liu | Mingliang Liu
HDFS-10582 | Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc | Minor | documentation | Pan Yuxuan | Pan Yuxuan
HDFS-10488 | Update WebHDFS documentation regarding CREATE and MKDIR default permissions | Minor | documentation, webhdfs | Wellington Chevreuil | Wellington Chevreuil
HDFS-10300 | TestDistCpSystem should share MiniDFSCluster | Trivial | test | John Zhuge | John Zhuge
HADOOP-13290 | Appropriate use of generics in FairCallQueue | Major | ipc | Konstantin Shvachko | Jonathan Hung
HADOOP-13289 | Remove unused variables in TestFairCallQueue | Minor | test | Konstantin Shvachko | Ye Zhou
HDFS-10628 | Log HDFS Balancer exit message to its own log | Minor | balancer & mover | Jiayi Zhou | Jiayi Zhou
HADOOP-13298 | Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/ | Minor | . | Xiao Chen | Tsuyoshi Ozawa
YARN-4883 | Make consistent operation name in AdminService | Minor | resourcemanager | Kai Sasaki | Kai Sasaki
YARN-1126 | Add validation of users input nodes-states options to nodes CLI | Major | . | Wei Yan | Wei Yan
HDFS-10287 | MiniDFSCluster should implement AutoCloseable | Minor | test | John Zhuge | Andras Bokor
HDFS-10225 | DataNode hot swap drives should disallow storage type changes. | Major | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-10660 | Expose storage policy apis via HDFSAdmin interface | Major | . | Rakesh R | Rakesh R
HDFS-9937 | Update dfsadmin command line help and HdfsQuotaAdminGuide | Minor | . | Wei-Chiu Chuang | Kai Sasaki
HDFS-10667 | Report more accurate info about data corruption location | Major | datanode, hdfs | Yongjun Zhang | Yuanbo Liu
HDFS-10676 | Add namenode metric to measure time spent in generating EDEKs | Major | namenode | Hanisha Koneru | Hanisha Koneru
MAPREDUCE-6746 | Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets | Minor | . | Vincent Poon | Vincent Poon
HDFS-10703 | HA NameNode Web UI should show last checkpoint time | Minor | ui | John Zhuge | John Zhuge
MAPREDUCE-6729 | Accurately compute the test execute time in DFSIO | Minor | benchmarks, performance, test | zhangminglei | zhangminglei
HADOOP-13444 | Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets | Minor | . | Vincent Poon | Vincent Poon
YARN-5456 | container-executor support for FreeBSD, NetBSD, and others if conf path is absolute | Major | nodemanager, security | Allen Wittenauer | Allen Wittenauer
MAPREDUCE-6730 | Use StandardCharsets instead of String overload in TextOutputFormat | Minor | . | Sahil Kang | Sahil Kang
HDFS-10707 | Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets | Minor | . | Vincent Poon | Vincent Poon
HADOOP-13442 | Optimize UGI group lookups | Major | . | Daryn Sharp | Daryn Sharp
HADOOP-13466 | Add an AutoCloseableLock class | Major | . | Chen Liang | Chen Liang
YARN-5483 | Optimize RMAppAttempt#pullJustFinishedContainers | Major | . | sandflee | sandflee
HADOOP-13190 | Mention LoadBalancingKMSClientProvider in KMS HA documentation | Major | documentation, kms | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-10677 | Über-jira: Enhancements to NNThroughputBenchmark tool | Major | benchmarks, tools | Mingliang Liu | Mingliang Liu
HDFS-10342 | BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt | Major | hdfs | Daryn Sharp | Kuhu Shukla
HDFS-10682 | Replace FsDatasetImpl object lock with a separate lock object | Major | datanode | Chen Liang | Chen Liang
HADOOP-13503 | Improve SaslRpcClient failure logging | Major | security | Xiaobing Zhou | Xiaobing Zhou
HADOOP-13527 | Add Spark to CallerContext LimitedPrivate scope | Minor | ipc | Weiqing Yang | Weiqing Yang
MAPREDUCE-6587 | Remove unused params in connection-related methods of Fetcher | Minor | . | Yiqun Lin | Yiqun Lin
HADOOP-13538 | Deprecate getInstance and initialize methods with Path in TrashPolicy | Minor | . | Yiqun Lin | Yiqun Lin
HDFS-8986 | Add option to -du to calculate directory space usage excluding snapshots | Major | snapshots | Gautam Gopalakrishnan | Xiao Chen
HDFS-10798 | Make the threshold of reporting FSNamesystem lock contention configurable | Major | logging, namenode | Zhe Zhang | Erik Krogen
YARN-5550 | TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN | Minor | client, test | Jonathan Hung | Jonathan Hung
HDFS-10814 | Add assertion for getNumEncryptionZones when no EZ is created | Minor | test | Vinitha Reddy Gankidi | Vinitha Reddy Gankidi
HDFS-10817 | Add Logging for Long-held NN Read Locks | Major | logging, namenode | Erik Krogen | Erik Krogen
HADOOP-13465 | Design Server.Call to be extensible for unified call queue | Major | ipc | Daryn Sharp | Daryn Sharp
HDFS-10833 | Fix JSON errors in WebHDFS.md examples | Trivial | documentation | Andrew Wang | Andrew Wang
HDFS-10742 | Measure lock time in FsDatasetImpl | Major | datanode | Chen Liang | Chen Liang
HDFS-10831 | Add log when URLConnectionFactory.openConnection failed | Minor | webhdfs | yunjiong zhao | yunjiong zhao
HADOOP-13598 | Add eol=lf for unix format files in .gitattributes | Major | . | Akira Ajisaka | Yiqun Lin
HADOOP-13580 | If user is unauthorized, log “unauthorized” instead of “Invalid signed text:” | Minor | security | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-10489 | Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones | Minor | . | Xiao Chen | Xiao Chen
YARN-5540 | scheduler spends too much time looking at empty priorities | Major | capacity scheduler, fairscheduler, resourcemanager | Nathan Roberts | Jason Lowe
HADOOP-13169 | Randomize file list in SimpleCopyListing | Minor | tools/distcp | Rajesh Balamohan | Rajesh Balamohan
HDFS-10875 | Optimize du -x to cache intermediate result | Major | snapshots | Xiao Chen | Xiao Chen
YARN-4591 | YARN Web UIs should provide a robots.txt | Trivial | . | Lars Francke | Sidharta Seethana
YARN-5622 | TestYarnCLI.testGetContainers fails due to mismatched date formats | Minor | . | Eric Badger | Eric Badger
HDFS-10876 | Dispatcher#dispatch should log IOException stacktrace | Trivial | balancer & mover | Wei-Chiu Chuang | Manoj Govindassamy
YARN-3692 | Allow REST API to set a user generated message when killing an application | Major | . | Rajat Jain | Rohith Sharma K S
HDFS-10869 | Remove the unused method InodeId#checkId() | Major | namenode | Jagadesh Kiran N | Jagadesh Kiran N
YARN-3877 | YarnClientImpl.submitApplication swallows exceptions | Minor | client | Steve Loughran | Varun Saxena
HADOOP-13658 | Replace config key literal strings with config key names I: hadoop common | Minor | conf | Chen Liang | Chen Liang
HADOOP-13537 | Support external calls in the RPC call queue | Major | ipc | Daryn Sharp | Daryn Sharp
HADOOP-13317 | Add logs to KMS server-side to improve supportability | Minor | kms | Xiao Chen | Suraj Acharya
HDFS-10940 | Reduce performance penalty of block caching when not used | Major | namenode | Daryn Sharp | Daryn Sharp
YARN-4855 | Should check if node exists when replace nodelabels | Minor | . | Tao Jie | Tao Jie
HDFS-10690 | Optimize insertion/removal of replica in ShortCircuitCache | Major | hdfs-client | Fenghua Hu | Fenghua Hu
HADOOP-13685 | Document -safely option of rm command. | Major | . | Xiaoyu Yao | Xiaoyu Yao
MAPREDUCE-6741 | add MR support to redact job conf properties | Major | mrv2 | Haibo Chen | Haibo Chen
HDFS-10963 | Reduce log level when network topology cannot find enough datanodes. | Minor | . | Xiao Chen | Xiao Chen
HADOOP-13323 | Downgrade stack trace on FS load from Warn to debug | Minor | fs | Steve Loughran | Steve Loughran
HADOOP-13150 | Avoid use of toString() in output of HDFS ACL shell commands. | Minor | . | Chris Nauroth | Chris Nauroth
HADOOP-13689 | Do not attach javadoc and sources jars during non-dist build | Major | . | Andrew Wang | Andrew Wang
HADOOP-13641 | Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation | Minor | . | Xiao Chen | Huafeng Wang
HDFS-10933 | Refactor TestFsck | Minor | . | Takanobu Asanuma | Takanobu Asanuma
HADOOP-13684 | Snappy may complain Hadoop is built without snappy if libhadoop is not found. | Minor | . | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-13698 | Document caveat for KeyShell when underlying KeyProvider does not delete a key | Minor | documentation, kms | Xiao Chen | Xiao Chen
HDFS-10789 | Route webhdfs through the RPC call queue | Major | ipc, webhdfs | Daryn Sharp | Daryn Sharp
HDFS-10903 | Replace config key literal strings with config key names II: hadoop hdfs | Minor | . | Mingliang Liu | Chen Liang
HADOOP-13710 | Supress CachingGetSpaceUsed from logging interrupted exception stacktrace | Minor | fs | Wei-Chiu Chuang | Hanisha Koneru
YARN-5599 | Publish AM launch command to ATS | Major | . | Daniel Templeton | Rohith Sharma K S
HDFS-11012 | Unnecessary INFO logging on DFSClients for InvalidToken | Minor | fs | Harsh J | Harsh J
HDFS-11003 | Expose “XmitsInProgress” through DataNodeMXBean | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-13724 | Fix a few typos in site markdown documents | Minor | documentation | Andrew Wang | Ding Fei
HDFS-11009 | Add a tool to reconstruct block meta file from CLI | Major | datanode | Xiao Chen | Xiao Chen
HDFS-9480 | Expose nonDfsUsed via StorageTypeStats | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12082 | Support multiple authentication schemes via AuthenticationFilter | Major | security | Hrishikesh Gadre | Hrishikesh Gadre
HADOOP-13669 | KMS Server should log exceptions before throwing | Major | kms | Xiao Chen | Suraj Acharya
HADOOP-13502 | Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. | Minor | test | Chris Nauroth | Chris Nauroth
HADOOP-13017 | Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0 | Major | fs, io | Steve Loughran | Steve Loughran
HDFS-11069 | Tighten the authorization of datanode RPC | Major | datanode, security | Kihwal Lee | Kihwal Lee
HDFS-11055 | Update default-log4j.properties for httpfs to imporve test logging | Major | httpfs, test | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4963 | capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable | Major | capacityscheduler | Nathan Roberts | Nathan Roberts
HDFS-11047 | Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode | Major | datanode | Xiaobing Zhou | Xiaobing Zhou
MAPREDUCE-6799 | Document mapreduce.jobhistory.webapp.https.address in mapred-default.xml | Minor | documentation, jobhistoryserver | Akira Ajisaka | Yiqun Lin
HADOOP-12325 | RPC Metrics : Add the ability track and log slow RPCs | Major | ipc, metrics | Anu Engineer | Anu Engineer
HDFS-11074 | Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage | Major | datanode | Arpit Agarwal | Hanisha Koneru
MAPREDUCE-6795 | Update the document for JobConf#setNumReduceTasks | Major | documentation | Akira Ajisaka | Yiqun Lin
HADOOP-13603 | Ignore package line length checkstyle rule | Major | build | Shane Kumpf | Shane Kumpf
HADOOP-13583 | Incorporate checkcompatibility script which runs Java API Compliance Checker | Major | scripts | Andrew Wang | Andrew Wang
HDFS-11080 | Update HttpFS to use ConfigRedactor | Major | . | Sean Mackrory | Sean Mackrory
YARN-5697 | Use CliParser to parse options in RMAdminCLI | Major | resourcemanager | Tao Jie | Tao Jie
HADOOP-12453 | Support decoding KMS Delegation Token with its own Identifier | Major | kms, security | Xiaoyu Yao | Xiaoyu Yao
HADOOP-7930 | Kerberos relogin interval in UserGroupInformation should be configurable | Major | security | Alejandro Abdelnur | Robert Kanter
YARN-5720 | Update document for “rmadmin -replaceLabelOnNode” | Minor | . | Tao Jie | Tao Jie
HADOOP-13782 | Make MutableRates metrics thread-local write, aggregate-on-read | Major | metrics | Erik Krogen | Erik Krogen
HADOOP-13590 | Retry until TGT expires even if the UGI renewal thread encountered exception | Major | security | Xiao Chen | Xiao Chen
HDFS-11120 | TestEncryptionZones should waitActive | Minor | test | Xiao Chen | John Zhuge
HDFS-10941 | Improve BlockManager#processMisReplicatesAsync log | Major | namenode | Xiaoyu Yao | Chen Liang
HADOOP-13810 | Add a test to verify that Configuration handles &-encoded characters | Minor | test | Steve Loughran | Steve Loughran
HADOOP-13742 | Expose “NumOpenConnectionsPerUser” as a metric | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-13646 | Remove outdated overview.html | Minor | . | Akira Ajisaka | Brahma Reddy Battula
HADOOP-13166 | add getFileStatus(“/”) test to AbstractContractGetFileStatusTest | Minor | fs, test | Steve Loughran | Steve Loughran
HADOOP-11603 | Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized | Minor | metrics | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-10776 | Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects | Blocker | . | Robert Joseph Evans | Vinod Kumar Vavilapalli
HDFS-11175 | Document uppercase key names are not supported in TransparentEncryption.md | Minor | documentation | Yuanbo Liu | Yiqun Lin
HADOOP-13790 | Make qbt script executable | Trivial | scripts | Andrew Wang | Andrew Wang
HDFS-8674 | Improve performance of postponed block scans | Critical | namenode | Daryn Sharp | Daryn Sharp
HDFS-10581 | Hide redundant table on NameNode WebUI when no nodes are decomissioning | Trivial | hdfs, ui | Weiwei Yang | Weiwei Yang
HDFS-11217 | Annotate NameNode and DataNode MXBean interfaces as Private/Stable | Major | . | Akira Ajisaka | Jagadesh Kiran N
HADOOP-13900 | Remove snapshot version of SDK dependency from Azure Data Lake Store File System | Major | fs/adl | Vishwajeet Dusane | Vishwajeet Dusane
HDFS-11249 | Redundant toString() in DFSConfigKeys.java | Trivial | . | Akira Ajisaka | Jagadesh Kiran N
YARN-5882 | Test only changes from YARN-4126 | Major | . | Andrew Wang | Jian He
HDFS-11262 | Remove unused variables in FSImage.java | Trivial | . | Akira Ajisaka | Jagadesh Kiran N
YARN-4994 | Use MiniYARNCluster with try-with-resources in tests | Trivial | test | Andras Bokor | Andras Bokor
YARN-5709 | Cleanup leader election configs and pluggability | Critical | resourcemanager | Karthik Kambatla | Karthik Kambatla
HDFS-9483 | Documentation does not cover use of “swebhdfs” as URL scheme for SSL-secured WebHDFS. | Major | documentation | Chris Nauroth | Surendra Singh Lilhore
HDFS-11292 | log lastWrittenTxId etc info in logSyncAll | Major | hdfs | Yongjun Zhang | Yongjun Zhang
HADOOP-13956 | Read ADLS credentials from Credential Provider | Critical | fs/adl | John Zhuge | John Zhuge
HADOOP-13962 | Update ADLS SDK to 2.1.4 | Major | fs/adl | John Zhuge | John Zhuge
HADOOP-13606 | swift FS to add a service load metadata file | Major | fs/swift | Steve Loughran | Steve Loughran
HADOOP-13037 | Refactor Azure Data Lake Store as an independent FileSystem | Major | fs/adl | Shrikant Naidu | Vishwajeet Dusane
HADOOP-13946 | Document how HDFS updates timestamps in the FS spec; compare with object stores | Minor | documentation, fs | Steve Loughran | Steve Loughran
HDFS-10601 | Improve log message to include hostname when the NameNode is in safemode | Minor | . | Kuhu Shukla | Kuhu Shukla
HADOOP-11694 | Über-jira: S3a phase II: robustness, scale and performance | Major | fs/s3 | Steve Loughran | Steve Loughran
HDFS-8873 | Allow the directoryScanner to be rate-limited | Major | datanode | Nathan Roberts | Daniel Templeton
HADOOP-12825 | Log slow name resolutions | Major | . | Sidharta Seethana | Sidharta Seethana
HDFS-8865 | Improve quota initialization performance | Major | . | Kihwal Lee | Kihwal Lee
HADOOP-12806 | Hadoop fs s3a lib not working with temporary credentials in AWS Lambda | Major | fs/s3 | Nikolaos Tsipas |

### BUG FIXES:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
HADOOP-8818 | Should use equals() rather than == to compare String or Text in MD5MD5CRC32FileChecksum and TFileDumper | Minor | fs, io | Brandon Li | Brandon Li
HADOOP-8436 | NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured | Major | fs | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-9121 | InodeTree.java has redundant check for vName while throwing exception | Major | fs | Arup Malakar | Arup Malakar
HADOOP-9242 | Duplicate surefire plugin config in hadoop-common | Major | test | Andrey Klochkov | Andrey Klochkov
HADOOP-8419 | GzipCodec NPE upon reset with IBM JDK | Major | io | Luke Lu | Yu Li
HDFS-4366 | Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks | Major | . | Derek Dagit | Derek Dagit
HADOOP-11559 | Add links to RackAwareness and InterfaceClassification to site index | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11581 | Fix Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-11568 | Description on usage of classpath in hadoop command is incomplete. | Trivial | tools | Archana T | Archana T
HADOOP-10027 | *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField | Minor | native | Eric Abbott | Hui Zheng
HDFS-5356 | MiniDFSCluster shoud close all open FileSystems when shutdown() | Critical | test | haosdent | Rakesh R
YARN-3197 | Confusing log generated by CapacityScheduler | Minor | capacityscheduler | Hitesh Shah | Varun Saxena
YARN-3243 | CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. | Major | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan
YARN-3305 | AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation | Major | scheduler | Rohith Sharma K S | Rohith Sharma K S
YARN-3205 | FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. | Major | resourcemanager | zhihai xu | zhihai xu
MAPREDUCE-5807 | Print usage for TeraSort job. | Trivial | examples | Rohith Sharma K S | Rohith Sharma K S
YARN-3351 | AppMaster tracking URL is broken in HA | Major | webapp | Anubhav Dhoot | Anubhav Dhoot
HDFS-7867 | Update action param from “start” to “prepare” in rolling upgrade javadoc | Trivial | . | J.Andreina | J.Andreina
MAPREDUCE-6281 | Fix javadoc in Terasort | Trivial | . | Albert Chu | Albert Chu
YARN-3269 | Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path | Major | . | Xuan Gong | Xuan Gong
MAPREDUCE-6213 | NullPointerException caused by job history server addr not resolvable | Minor | applicationmaster | Peng Zhang | Peng Zhang
MAPREDUCE-5448 | MapFileOutputFormat#getReaders bug with invisible files/folders | Minor | mrv2 | Maysam Yabandeh | Maysam Yabandeh
MAPREDUCE-6242 | Progress report log is incredibly excessive in application master | Major | applicationmaster | Jian Fang | Varun Saxena
HDFS-3325 | When configuring “dfs.namenode.safemode.threshold-pct” to a value greater or equal to 1 there is mismatch in the UI report | Minor | . | J.Andreina | J.Andreina
YARN-3383 | AdminService should use “warn” instead of “info” to log exception when operation fails | Major | resourcemanager | Wangda Tan | Li Lu
YARN-3397 | yarn rmadmin should skip -failover | Minor | resourcemanager | J.Andreina | J.Andreina
HADOOP-11724 | DistCp throws NPE when the target directory is root. | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3400 | [JDK 8] Build Failure due to unreported exceptions in RPCUtil | Major | . | Robert Kanter | Robert Kanter
HDFS-7990 | IBR delete ack should not be delayed | Major | namenode | Daryn Sharp | Daryn Sharp
HADOOP-11760 | Fix typo of javadoc in DistCp | Trivial | . | Chen He | Brahma Reddy Battula
MAPREDUCE-6294 | Remove an extra parameter described in Javadoc of TockenCache | Trivial | . | Chen He | Brahma Reddy Battula
HDFS-7501 | TransactionsSinceLastCheckpoint can be negative on SBNs | Major | namenode | Harsh J | Gautam Gopalakrishnan
HDFS-8002 | Website refers to /trash directory | Major | documentation | Mike Drob | Brahma Reddy Battula
HDFS-7261 | storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState() | Major | . | Ted Yu | Brahma Reddy Battula
HDFS-7997 | The first non-existing xattr should also throw IOException | Minor | . | zhouyingchao | zhouyingchao
HDFS-6945 | BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed | Critical | namenode | Akira Ajisaka | Akira Ajisaka
YARN-3425 | NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed | Minor | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-7922 | ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors | Major | . | Rakesh R | Rakesh R
HDFS-8026 | Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk | Minor | . | Colin P. McCabe | Colin P. McCabe
YARN-3415 | Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue | Critical | fairscheduler | Rohit Agarwal | zhihai xu
HADOOP-11797 | releasedocmaker.py needs to put ASF headers on output | Major | build | Allen Wittenauer | Allen Wittenauer
HADOOP-11800 | Clean up some test methods in TestCodec.java | Major | test | Akira Ajisaka | Brahma Reddy Battula
MAPREDUCE-4844 | Counters / AbstractCounters have constant references not declared final | Major | . | Gera Shegalov | Brahma Reddy Battula
YARN-3435 | AM container to be allocated Appattempt AM container shown as null | Trivial | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
YARN-3429 | TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken | Major | test | zhihai xu | zhihai xu
HDFS-5215 | dfs.datanode.du.reserved is not considered while computing available space | Major | datanode | Brahma Reddy Battula | Brahma Reddy Battula
YARN-3457 | NPE when NodeManager.serviceInit fails and stopRecoveryStore called | Minor | nodemanager | Bibin A Chundatt | Bibin A Chundatt
YARN-3459 | Fix failiure of TestLog4jWarningErrorMetricsAppender | Blocker | . | Li Lu | Varun Vasudev
HDFS-8046 | Allow better control of getContentSummary | Major | . | Kihwal Lee | Kihwal Lee
YARN-2890 | MiniYarnCluster should turn on timeline service if configured to do so | Major | . | Mit Desai | Mit Desai
HDFS-7725 | Incorrect “nodes in service” metrics caused all writes to fail | Major | . | Ming Ma | Ming Ma
HDFS-8096 | DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers | Major | datanode | Vinayakumar B | Vinayakumar B
YARN-3465 | Use LinkedHashMap to preserve order of resource requests | Major | nodemanager | zhihai xu | zhihai xu
HDFS-8099 | Change “DFSInputStream has been closed already” message to debug log level | Minor | hdfs-client | Charles Lamb | Charles Lamb
HDFS-8091 | ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to client | Major | namenode | Arun Suresh | Arun Suresh
MAPREDUCE-6266 | Job#getTrackingURL should consistently return a proper URL | Minor | . | Ray Chiang | Ray Chiang
HDFS-8081 | Split getAdditionalBlock() into two methods. | Major | . | Konstantin Shvachko | Konstantin Shvachko
HDFS-7939 | Two fsimage_rollback_* files are created which are not deleted after rollback. | Critical | . | J.Andreina | J.Andreina
MAPREDUCE-6314 | TestPipeApplication fails on trunk | Major | test | Varun Vasudev | Varun Vasudev
YARN-3466 | Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column | Major | resourcemanager, webapp | Jason Lowe | Jason Lowe
HDFS-7931 | DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled | Minor | hdfs-client | Arun Suresh | Arun Suresh
HDFS-8111 | NPE thrown when invalid FSImage filename given for “hdfs oiv_legacy” cmd | Minor | tools | Archana T | Surendra Singh Lilhore
HADOOP-11811 | Fix typos in hadoop-project/pom.xml and TestAccessControlList | Minor | . | Chen He | Brahma Reddy Battula
YARN-3382 | Some of UserMetricsInfo metrics are incorrectly set to root queue metrics | Major | webapp | Rohit Agarwal | Rohit Agarwal
YARN-3472 | Possible leak in DelegationTokenRenewer#allTokens | Major | . | Jian He | Rohith Sharma K S
YARN-3394 | WebApplication proxy documentation is incomplete | Minor | resourcemanager | Bibin A Chundatt | Naganarasimha G R
HADOOP-11819 | HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. | Minor | . | Rohith Sharma K S | Rohith Sharma K S
HDFS-6666 | Abort NameNode and DataNode startup if security is enabled but block access token is not enabled. | Minor | datanode, namenode, security | Chris Nauroth | Vijay Bhat
HDFS-8055 | NullPointerException when topology script is missing. | Major | namenode | Anu Engineer | Anu Engineer
YARN-3266 | RMContext inactiveNodes should have NodeId as map key | Major | resourcemanager | Chengbing Liu | Chengbing Liu
YARN-3436 | Fix URIs in documention of YARN web service REST APIs | Minor | documentation, resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-8127 | NameNode Failover during HA upgrade can cause DataNode to finalize upgrade | Blocker | ha | Jing Zhao | Jing Zhao
YARN-3462 | Patches applied for YARN-2424 are inconsistent between trunk and branch-2 | Major | . | Sidharta Seethana | Naganarasimha G R
HDFS-8151 | Always use snapshot path as source when invalid snapshot names are used for diff based distcp | Minor | distcp | Sushmitha Sreenivasan | Jing Zhao
HDFS-7934 | Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN | Critical | documentation | J.Andreina | J.Andreina
HDFS-8149 | The footer of the Web UI “Hadoop, 2014” is old | Major | . | Akira Ajisaka | Brahma Reddy Battula
HDFS-8142 | DistributedFileSystem encryption zone commands should resolve relative paths | Major | . | Rakesh R | Rakesh R
MAPREDUCE-6300 | Task list sort by task id broken | Minor | . | Siqi Li | Siqi Li
YARN-3021 | YARN’s delegation-token handling disallows certain trust setups to operate properly over DistCp | Major | security | Harsh J | Yongjun Zhang
HDFS-8153 | Error Message points to wrong parent directory in case of path component name length error | Major | namenode | Anu Engineer | Anu Engineer
YARN-3493 | RM fails to come up with error “Failed to load/recover state” when mem settings are changed | Critical | yarn | Sumana Sathish | Jian He
HDFS-8043 | NPE in MiniDFSCluster teardown | Major | test | Steve Loughran | Brahma Reddy Battula
HDFS-8173 | NPE thrown at DataNode shutdown when HTTP server was not able to create | Minor | datanode | Archana T | Surendra Singh Lilhore
YARN-3497 | ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy | Major | client | Jason Lowe | Jason Lowe
MAPREDUCE-6238 | MR2 can’t run local jobs with -libjars command options which is a regression from MR1 | Critical | mrv2 | zhihai xu | zhihai xu
HDFS-8179 | DFSClient#getServerDefaults returns null within 1 hour of system start | Blocker | . | Xiaoyu Yao | Xiaoyu Yao
HDFS-7993 | Provide each Replica details in fsck | Major | . | Ming Ma | J.Andreina
HDFS-8163 | Using monotonicNow for block report scheduling causes test failures on recently restarted systems | Blocker | datanode | Arpit Agarwal | Arpit Agarwal
HADOOP-11704 | DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize() | Major | . | Anubhav Dhoot | Anubhav Dhoot
YARN-3495 | Confusing log generated by FairScheduler | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
MAPREDUCE-6293 | Set job classloader on uber-job’s LocalContainerLauncher event thread | Major | mr-am | Sangjin Lee | Sangjin Lee
HADOOP-11846 | TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8 | Major | build, security | Steve Loughran | Larry McCay
HADOOP-11859 | PseudoAuthenticationHandler fails with httpcomponents v4.4 | Major | . | Eugene Koifman | Eugene Koifman
MAPREDUCE-6330 | Fix typo in Task Attempt API’s URL in documentations | Minor | documentation | Ryu Kobayashi | Ryu Kobayashi
HADOOP-11848 | Incorrect arguments to sizeof in DomainSocket.c | Major | native | Malcolm Kavalsky | Malcolm Kavalsky
HADOOP-11868 | Invalid user logins trigger large backtraces in server log | Major | . | Chang Li | Chang Li
HADOOP-11861 | test-patch.sh rewrite addendum patch | Major | build | Anu Engineer | Allen Wittenauer
HADOOP-11864 | JWTRedirectAuthenticationHandler breaks java8 javadocs | Major | build | Steve Loughran | Larry McCay
HDFS-4448 | Allow HA NN to start in secure mode with wildcard address configured | Major | ha, namenode, security | Aaron T. Myers | Aaron T. Myers
YARN-3522 | DistributedShell uses the wrong user to put timeline data | Blocker | timelineserver | Zhijie Shen | Zhijie Shen
HDFS-8147 | Mover should not schedule two replicas to the same DN storage | Major | balancer & mover | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-11872 | “hadoop dfs” command prints message about using “yarn jar” on Windows(branch-2 only) | Minor | scripts | Varun Vasudev | Varun Vasudev
HADOOP-11730 | Regression: s3n read failure recovery broken | Major | fs/s3 | Takenori Sato | Takenori Sato
YARN-3516 | killing ContainerLocalizer action doesn’t take effect when private localizer receives FETCH_FAILURE status. | Minor | nodemanager | zhihai xu | zhihai xu
HADOOP-11802 | DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm | Major | . | Eric Payne | Colin P. McCabe
HDFS-8070 | Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode | Blocker | caching | Gopal V | Colin P. McCabe
HDFS-8217 | During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. | Major | datanode | Vinayakumar B | Vinayakumar B
HDFS-8231 | StackTrace displayed at client while QuotaByStorageType exceeds | Major | hdfs-client | J.Andreina | J.Andreina
HDFS-8191 | Fix byte to integer casting in SimulatedFSDataset#simulatedByte | Minor | . | Zhe Zhang | Zhe Zhang
YARN-3387 | Previous AM’s container complete message couldn’t pass to current am if am restarted and rm changed | Critical | resourcemanager | sandflee | sandflee
HADOOP-11876 | Refactor code to make it more readable, minor maybePrintStats bug | Trivial | tools/distcp | Zoran Dimitrijevic | Zoran Dimitrijevic
YARN-3444 | Fix typo capabililty | Trivial | applications/distributed-shell | Gabor Liptak | Gabor Liptak
YARN-3537 | NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked | Major | nodemanager | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-8211 | DataNode UUID is always null in the JMX counter | Major | datanode | Anu Engineer | Anu Engineer
MAPREDUCE-6333 | TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297 | Major | . | Siqi Li | Siqi Li
HDFS-8206 | Fix the typos in hadoop-hdfs-httpfs | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
YARN-3464 | Race condition in LocalizerRunner kills localizer before localizing all resources | Critical | nodemanager | zhihai xu | zhihai xu
MAPREDUCE-6252 | JobHistoryServer should not fail when encountering a missing directory | Major | jobhistoryserver | Craig Welch | Craig Welch
YARN-3530 | ATS throws exception on trying to filter results without otherinfo. | Critical | timelineserver | Sreenath Somarajapuram | Zhijie Shen
HDFS-8205 | CommandFormat#parse() should not parse option as value of option | Blocker | . | Peter Shi | Peter Shi
HADOOP-11870 | [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues | Major | build | Robert Kanter | Robert Kanter
MAPREDUCE-6324 | Uber jobs fail to update AMRM token when it rolls over | Blocker | mr-am | Jason Lowe | Jason Lowe
HDFS-8232 | Missing datanode counters when using Metrics2 sink interface | Major | datanode | Anu Engineer | Anu Engineer
MAPREDUCE-6334 | Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler | Blocker | . | Eric Payne | Eric Payne
HDFS-8273 | FSNamesystem#Delete() should not call logSync() when holding the lock | Blocker | namenode | Jing Zhao | Haohui Mai
YARN-3485 | FairScheduler headroom calculation doesn’t consider maxResources for Fifo and FairShare policies | Critical | fairscheduler | Karthik Kambatla | Karthik Kambatla
HDFS-8269 | getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime | Blocker | . | Yesha Vora | Haohui Mai
YARN-3517 | RM web ui for dumping scheduler logs should be for admins only | Blocker | resourcemanager, security | Varun Vasudev | Varun Vasudev
HDFS-8214 | Secondary NN Web UI shows wrong date for Last Checkpoint | Major | namenode | Charles Lamb | Charles Lamb
YARN-3533 | Test: Fix launchAM in MockRM to wait for attempt to be scheduled | Major | yarn | Anubhav Dhoot | Anubhav Dhoot
MAPREDUCE-6339 | Job history file is not flushed correctly because isTimerActive flag is not set true when flushTimerTask is scheduled. | Critical | mrv2 | zhihai xu | zhihai xu
HADOOP-11821 | Fix findbugs warnings in hadoop-sls | Major | tools | Akira Ajisaka | Brahma Reddy Battula
YARN-3564 | Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly | Major | . | Jian He | Jian He
HADOOP-11891 | OsSecureRandom should lazily fill its reservoir | Major | security | Arun Suresh | Arun Suresh
HADOOP-11866 | increase readability and reliability of checkstyle, shellcheck, and whitespace reports | Minor | . | Naganarasimha G R | Allen Wittenauer
HDFS-8292 | Move conditional in fmt_time from dfs-dust.js to status.html | Minor | namenode | Charles Lamb | Charles Lamb
HDFS-8300 | Fix unit test failures and findbugs warning caused by HDFS-8283 | Major | . | Jing Zhao | Jing Zhao
HDFS-8276 | LazyPersistFileScrubber should be disabled if scrubber interval configured zero | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-11889 | Make checkstyle runnable from root project | Major | build, test | Gera Shegalov | Gera Shegalov
HDFS-8213 | DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace | Critical | . | Billie Rinaldi | Colin P. McCabe
HDFS-8229 | LAZY_PERSIST file gets deleted after NameNode restart. | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore
YARN-2893 | AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream | Major | resourcemanager | Gera Shegalov | zhihai xu
HADOOP-11491 | HarFs incorrectly declared as requiring an authority | Critical | fs | Gera Shegalov | Brahma Reddy Battula
HADOOP-11900 | Add failIfNoTests=false to hadoop-build-tools pom | Major | test | Gera Shegalov | Gera Shegalov
MAPREDUCE-6345 | Documentation fix for when CRLA is enabled for MRAppMaster logs | Trivial | documentation | Rohit Agarwal | Rohit Agarwal
YARN-2454 | Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. | Major | . | Xu Yang | Xu Yang
YARN-1993 | Cross-site scripting vulnerability in TextView.java | Major | webapp | Ted Yu | Kenji Kikushima
MAPREDUCE-5905 | CountersStrings.toEscapedCompactStrings outputs unnecessary “null” strings | Minor | . | Akira Ajisaka | Akira Ajisaka
MAPREDUCE-6349 | Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS | Minor | . | Ray Chiang | Ray Chiang
HADOOP-9658 | SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded | Major | . | Zhijie Shen | Zhijie Shen
YARN-3097 | Logging of resource recovery on NM restart has redundancies | Minor | nodemanager | Jason Lowe | Eric Payne
HDFS-8290 | WebHDFS calls before namesystem initialization can cause NullPointerException. | Minor | webhdfs | Chris Nauroth | Chris Nauroth
MAPREDUCE-5649 | Reduce cannot use more than 2G memory for the final merge | Major | mrv2 | stanley shi | Gera Shegalov
MAPREDUCE-6259 | IllegalArgumentException due to missing job submit time | Major | jobhistoryserver | zhihai xu | zhihai xu
YARN-3375 | NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner | Minor | nodemanager | Devaraj K | Devaraj K
YARN-2725 | Adding test cases of retrying requests about ZKRMStateStore | Major | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
MAPREDUCE-6165 | [JDK8] TestCombineFileInputFormat failed on JDK8 | Minor | . | Wei Yan | Akira Ajisaka
HADOOP-11328 | ZKFailoverController does not log Exception when doRun raises errors | Major | ha | Tianyin Xu | Tianyin Xu
HADOOP-11916 | TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug | Minor | . | Ming Ma | Ming Ma
YARN-3552 | RM Web UI shows -1 running containers for completed apps | Trivial | webapp | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11120 | hadoop fs -rmr gives wrong advice | Major | . | Allen Wittenauer | Juliet Hougland
YARN-3396 | Handle URISyntaxException in ResourceLocalizationService | Major | nodemanager | Chengbing Liu | Brahma Reddy Battula
YARN-2123 | Progress bars in Web UI always at 100% due to non-US locale | Major | webapp | Johannes Simon | Akira Ajisaka
HDFS-8305 | HDFS INotify: the destination field of RenameOp should always end with the file name | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-11917 | test-patch.sh should work with ${BASEDIR}/patchprocess setups | Blocker | . | Allen Wittenauer | Allen Wittenauer
HDFS-7847 | Modify NNThroughputBenchmark to be able to operate on a remote NameNode | Major | . | Colin P. McCabe | Charles Lamb
HDFS-8219 | setStoragePolicy with folder behavior is different after cluster restart | Major | . | Peter Shi | Surendra Singh Lilhore
HADOOP-11898 | add nfs3 and portmap starting command in hadoop-daemon.sh in branch-2 | Minor | bin, nfs | Brandon Li | Brandon Li
HADOOP-11926 | test-patch.sh mv does wrong math | Major | . | Allen Wittenauer | Allen Wittenauer
HADOOP-11912 | Extra configuration key used in TraceUtils should respect prefix | Minor | . | Masatake Iwasaki | Masatake Iwasaki
YARN-3582 | NPE in WebAppProxyServlet | Major | . | Jian He | Jian He
HDFS-2484 | checkLease should throw FileNotFoundException when file does not exist | Major | namenode | Konstantin Shvachko | Rakesh R
YARN-3385 | Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion. | Critical | resourcemanager | zhihai xu | zhihai xu
HDFS-7833 | DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. | Major | datanode | Chris Nauroth | Lei (Eddy) Xu
YARN-3577 | Misspelling of threshold in log4j.properties for tests | Minor | test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-8325 | Misspelling of threshold in log4j.properties for tests | Minor | test | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-10387 | Misspelling of threshold in log4j.properties for tests in hadoop-common-project | Minor | conf, test | Kenji Kikushima | Brahma Reddy Battula
MAPREDUCE-6356 | Misspelling of threshold in log4j.properties for tests | Minor | test | Brahma Reddy Battula | Brahma Reddy Battula
YARN-3523 | Cleanup ResourceManagerAdministrationProtocol interface audience | Major | client, resourcemanager | Wangda Tan | Naganarasimha G R
HDFS-7980 | Incremental BlockReport will dramatically slow down the startup of a namenode | Major | . | Hui Zheng | Walter Su
HADOOP-11936 | Dockerfile references a removed image | Major | . | Allen Wittenauer | Allen Wittenauer
YARN-3584 | [Log mesage correction] : MIssing space in Diagnostics message | Trivial | . | nijel | nijel
HDFS-8321 | CacheDirectives and CachePool operations should throw RetriableException in safemode | Major | . | Haohui Mai | Haohui Mai
HDFS-8037 | CheckAccess in WebHDFS silently accepts malformed FsActions parameters | Minor | webhdfs | Jake Low | Walter Su
YARN-1832 | Fix wrong MockLocalizerStatus#equals implementation | Minor | nodemanager | Hong Zhiguo | Hong Zhiguo
YARN-3572 | Correct typos in WritingYarnApplications.md | Minor | documentation | Sandeep Khurana | Gabor Liptak
HADOOP-11922 | Misspelling of threshold in log4j.properties for tests in hadoop-tools | Minor | . | Brahma Reddy Battula | Gabor Liptak
HDFS-8257 | Namenode rollingUpgrade option is incorrect in document | Major | documentation | J.Andreina | J.Andreina
HDFS-8067 | haadmin prints out stale help messages | Minor | hdfs-client | Ajith S | Ajith S
YARN-3592 | Fix typos in RMNodeLabelsManager | Trivial | resourcemanager | Junping Du | Sunil Govindan
HDFS-8174 | Update replication count to live rep count in fsck report | Minor | . | J.Andreina | J.Andreina
HDFS-6291 | FSImage may be left unclosed in BootstrapStandby#doRun() | Minor | ha | Ted Yu | Sanghyun Yun
YARN-3358 | Audit log not present while refreshing Service ACLs | Minor | resourcemanager | Varun Saxena | Varun Saxena
YARN-3589 | RM and AH web UI display DOCTYPE wrongly | Major | webapp | Rohith Sharma K S | Rohith Sharma K S
HDFS-7998 | HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong | Minor | documentation | Ajith S | Ajith S
HDFS-8222 | Remove usage of "dfsadmin -upgradeProgress " from document which is no longer supported | Major | documentation | J.Andreina | J.Andreina
HDFS-8187 | Remove usage of “-setStoragePolicy” and “-getStoragePolicy” using dfsadmin cmd (as it is not been supported) | Major | documentation | J.Andreina | J.Andreina
HDFS-8175 | Provide information on snapshotDiff for supporting the comparison between snapshot and current status | Major | documentation | J.Andreina | J.Andreina
MAPREDUCE-6342 | Make POM project names consistent | Minor | build | Rohith Sharma K S | Rohith Sharma K S
HDFS-6576 | Datanode log is generating at root directory in security mode | Minor | datanode, scripts | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-11877 | SnappyDecompressor’s Logger class name is wrong | Major | conf | Surendra Singh Lilhore | Surendra Singh Lilhore
HDFS-3384 | DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery | Major | hdfs-client | Brahma Reddy Battula | Uma Maheswara Rao G
YARN-3554 | Default value for maximum nodemanager connect wait time is too high | Major | . | Jason Lowe | Naganarasimha G R
HDFS-7894 | Rolling upgrade readiness is not updated in jmx until query command is issued. | Critical | . | Kihwal Lee | Brahma Reddy Battula
YARN-3600 | AM container link is broken (on a killed application, at least) | Major | . | Sergey Shelukhin | Naganarasimha G R
HDFS-8346 | libwebhdfs build fails during link due to unresolved external symbols. | Major | native | Chris Nauroth | Chris Nauroth
HDFS-8274 | NFS configuration nfs.dump.dir not working | Major | nfs | Ajith S | Ajith S
HDFS-8340 | Fix NFS documentation of nfs.wtmax | Minor | documentation, nfs | Ajith S | Ajith S
HADOOP-10356 | Corrections in winutils/chmod.c | Trivial | bin | René Nyffenegger | René Nyffenegger
HADOOP-7165 | listLocatedStatus(path, filter) is not redefined in FilterFs | Major | fs | Hairong Kuang | Hairong Kuang
MAPREDUCE-3383 | Duplicate job.getOutputValueGroupingComparator() in ReduceTask | Major | . | Binglin Chang | Binglin Chang
HDFS-8311 | DataStreamer.transfer() should timeout the socket InputStream. | Major | hdfs-client | Esteban Gutierrez | Esteban Gutierrez
HDFS-8113 | Add check for null BlockCollection pointers in BlockInfoContiguous structures | Major | namenode | Chengbing Liu | Chengbing Liu
HADOOP-9729 | The example code of org.apache.hadoop.util.Tool is incorrect | Major | util | hellojinjie | hellojinjie
MAPREDUCE-2094 | LineRecordReader should not seek into non-splittable, compressed streams. | Major | task | Niels Basjes | Niels Basjes
HDFS-8245 | Standby namenode doesn’t process DELETED_BLOCK if the add block request is in edit log. | Major | . | Rushabh S Shah | Rushabh S Shah
YARN-3018 | Unify the default value for yarn.scheduler.capacity.node-locality-delay in code and default xml file | Trivial | capacityscheduler | nijel | nijel
HDFS-8326 | Documentation about when checkpoints are run is out of date | Major | documentation | Misty Linville | Misty Linville
YARN-3604 | removeApplication in ZKRMStateStore should also disable watch. | Minor | resourcemanager | zhihai xu | zhihai xu
YARN-3476 | Nodemanager can fail to delete local logs if log aggregation fails | Major | log-aggregation, nodemanager | Jason Lowe | Rohith Sharma K S
YARN-3473 | Fix RM Web UI configuration for some properties | Minor | resourcemanager | Ray Chiang | Ray Chiang
HDFS-8097 | TestFileTruncate is failing intermittently | Major | test | Rakesh R | Rakesh R
YARN-1912 | ResourceLocalizer started without any jvm memory control | Major | nodemanager | stanley shi | Masatake Iwasaki
MAPREDUCE-6359 | RM HA setup, “Cluster” tab links populated with AM hostname instead of RM | Minor | . | Aroop Maliakkal | yunjiong zhao
MAPREDUCE-6353 | Divide by zero error in MR AM when calculating available containers | Major | mr-am | Anubhav Dhoot | Anubhav Dhoot
YARN-3395 | FairScheduler: Trim whitespaces when using username for queuename | Major | fairscheduler | zhihai xu | zhihai xu
HDFS-8351 | Remove namenode -finalize option from document | Major | documentation | Akira Ajisaka | Akira Ajisaka
YARN-3587 | Fix the javadoc of DelegationTokenSecretManager in projects of yarn, etc. | Minor | documentation | Akira Ajisaka | Gabor Liptak
HADOOP-11663 | Remove description about Java 6 from docs | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-11928 | Test-patch check for @author tags incorrectly flags removal of @author tags | Major | . | Sean Busbey | Kengo Seki
HADOOP-11951 | test-patch should give better info about failures to handle dev-support updates without resetrepo option | Minor | . | Sean Busbey | Sean Busbey
HADOOP-11947 | test-patch should return early from determine-issue when run in jenkins mode. | Minor | . | Sean Busbey | Sean Busbey
HDFS-7916 | ‘reportBadBlocks’ from datanodes to standby Node BPServiceActor goes for infinite loop | Critical | datanode | Vinayakumar B | Rushabh S Shah
YARN-3434 | Interaction between reservations and userlimit can result in significant ULF violation | Major | capacityscheduler | Thomas Graves | Thomas Graves
HDFS-8362 | Java Compilation Error in TestHdfsConfigFields.java | Major | . | Mohammad Arshad | Mohammad Arshad
MAPREDUCE-6360 | TestMapreduceConfigFields is placed in wrong dir, introducing compile error | Major | . | Vinayakumar B | Mohammad Arshad
MAPREDUCE-6361 | NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host | Critical | . | Junping Du | Junping Du
YARN-3629 | NodeID is always printed as “null” in node manager initialization log. | Major | . | nijel | nijel
MAPREDUCE-6251 | JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases | Major | jobhistoryserver, mrv2 | Craig Welch | Craig Welch
MAPREDUCE-6366 | mapreduce.terasort.final.sync configuration in TeraSort doesn’t work | Trivial | examples | Takuya Fukudome | Takuya Fukudome
HDFS-6300 | Prevent multiple balancers from running simultaneously | Critical | balancer & mover | Rakesh R | Rakesh R
HDFS-8358 | TestTraceAdmin fails | Major | . | Kihwal Lee | Masatake Iwasaki
HADOOP-11966 | Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. | Critical | scripts | Chris Nauroth | Chris Nauroth
HDFS-8380 | Always call addStoredBlock on blocks which have been shifted from one storage to another | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-8174 | Remove confusing comment in Path#isAbsolute() | Trivial | fs | Suresh Srinivas | Suresh Srinivas
HDFS-8150 | Make getFileChecksum fail for blocks under construction | Critical | . | Kihwal Lee | J.Andreina
MAPREDUCE-5708 | Duplicate String.format in YarnOutputFiles.getSpillFileForWrite | Minor | . | Konstantin Weitz | Konstantin Weitz
YARN-1519 | check if sysconf is implemented before using it | Major | nodemanager | Radim Kolar | Radim Kolar
HDFS-8371 | Fix test failure in TestHdfsConfigFields for spanreceiver properties | Major | . | Ray Chiang | Ray Chiang
MAPREDUCE-6273 | HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state | Minor | jobhistoryserver | zhihai xu | zhihai xu
YARN-2421 | RM still allocates containers to an app in the FINISHING state | Major | scheduler | Thomas Graves | Chang Li
YARN-3526 | ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster | Major | resourcemanager, webapp | Weiwei Yang | Weiwei Yang
HADOOP-11988 | Fix typo in the document for hadoop fs -find | Trivial | documentation | Akira Ajisaka | Kengo Seki
HADOOP-10582 | Fix the test case for copying to non-existent dir in TestFsShellCopy | Minor | fs | Kousuke Saruta | Kousuke Saruta
HDFS-8345 | Storage policy APIs must be exposed via the FileSystem interface | Major | hdfs-client | Arpit Agarwal | Arpit Agarwal
HDFS-8405 | Fix a typo in NamenodeFsck | Minor | namenode | Tsz Wo Nicholas Sze | Takanobu Asanuma
HDFS-6348 | SecondaryNameNode not terminating properly on runtime exceptions | Major | namenode | Rakesh R | Rakesh R
YARN-3601 | Fix UT TestRMFailover.testRMWebAppRedirect | Critical | resourcemanager, webapp | Weiwei Yang | Weiwei Yang
HDFS-8404 | Pending block replication can get stuck using older genstamp | Major | namenode | Nathan Roberts | Nathan Roberts
HADOOP-11973 | Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs | Major | security | Gregory Chanan | Gregory Chanan
HADOOP-11963 | Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. | Trivial | documentation | Chris Nauroth | Anu Engineer
YARN-2821 | Distributed shell app master becomes unresponsive sometimes | Major | applications/distributed-shell | Varun Vasudev | Varun Vasudev
YARN-3677 | Fix findbugs warnings in yarn-server-resourcemanager | Minor | resourcemanager | Akira Ajisaka | Vinod Kumar Vavilapalli
YARN-3681 | yarn cmd says “could not find main class ‘queue’” in windows | Blocker | yarn | Sumana Sathish | Varun Saxena
YARN-3654 | ContainerLogsPage web UI should not have meta-refresh | Major | yarn | Xuan Gong | Xuan Gong
YARN-3694 | Fix dead link for TimelineServer REST API | Minor | documentation | Akira Ajisaka | Jagadesh Kiran N
YARN-3646 | Applications are getting stuck some times in case of retry policy forever | Major | client | Raju Bairishetti | Raju Bairishetti
HDFS-8421 | Move startFile() and related operations into FSDirWriteFileOp | Major | . | Haohui Mai | Haohui Mai
HDFS-8451 | DFSClient probe for encryption testing interprets empty URI property for “enabled” | Blocker | encryption | Steve Loughran | Steve Loughran
YARN-3675 | FairScheduler: RM quits when node removal races with continousscheduling on the same node | Critical | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
HADOOP-12014 | hadoop-config.cmd displays a wrong error message | Minor | scripts | Kengo Seki | Kengo Seki
HADOOP-11955 | Fix a typo in the cluster setup doc | Trivial | . | Kihwal Lee | Yanjun Wang
HDFS-8268 | Port conflict log for data node server is not sufficient | Minor | datanode | Mohammad Shahid Khan | Mohammad Shahid Khan
YARN-3594 | WintuilsProcessStubExecutor.startStreamReader leaks streams | Trivial | nodemanager | Steve Loughran | Lars Francke
HADOOP-11743 | maven doesn’t clean all the site files | Minor | documentation | Allen Wittenauer | ramtin
HADOOP-11927 | Fix “undefined reference to dlopen” error when compiling libhadooppipes | Major | build, native, tools | Xianyin Xin | Xianyin Xin
YARN-3701 | Isolating the error of generating a single app report when getting all apps from generic history service | Blocker | timelineserver | Zhijie Shen | Zhijie Shen
YARN-3707 | RM Web UI queue filter doesn’t work | Blocker | . | Wangda Tan | Wangda Tan
YARN-2238 | filtering on UI sticks even if I move away from the page | Major | webapp | Sangjin Lee | Jian He
HADOOP-8751 | NPE in Token.toString() when Token is constructed using null identifier | Minor | security | Vlad Rozov | Kanaka Kumar Avvaru
HADOOP-11969 | ThreadLocal initialization in several classes is not thread safe | Critical | io | Sean Busbey | Sean Busbey
YARN-3626 | On Windows localized resources are not moved to the front of the classpath when they should be | Major | yarn | Craig Welch | Craig Welch
HADOOP-9891 | CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException | Minor | documentation | Steve Loughran | Darrell Taylor
HDFS-8431 | hdfs crypto class not found in Windows | Critical | scripts | Sumana Sathish | Anu Engineer
HADOOP-12004 | test-patch breaks with reexec in certain situations | Critical | . | Allen Wittenauer | Sean Busbey
YARN-3723 | Need to clearly document primaryFilter and otherInfo value type | Critical | timelineserver | Zhijie Shen | Zhijie Shen
HDFS-8407 | libhdfs hdfsListDirectory must set errno to 0 on success | Major | native | Juan Yu | Masatake Iwasaki
HDFS-8429 | Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread | Major | . | zhouyingchao | zhouyingchao
HADOOP-11959 | WASB should configure client side socket timeout in storage client blob request options | Major | tools | Ivan Mitic | Ivan Mitic
HADOOP-11934 | Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop | Blocker | security | Mike Yoder | Larry McCay
HDFS-7401 | Add block info to DFSInputStream’ WARN message when it adds node to deadNodes | Minor | . | Ming Ma | Mohammad Arshad
HADOOP-12042 | Users may see TrashPolicy if hdfs dfs -rm is run | Major | . | Allen Wittenauer | J.Andreina
HDFS-7609 | Avoid retry cache collision when Standby NameNode loading edits | Critical | namenode | Carrey Zhan | Ming Ma
HADOOP-11885 | hadoop-dist dist-layout-stitching.sh does not work with dash | Major | build | Andrew Wang | Andrew Wang
YARN-3725 | App submission via REST API is broken in secure mode due to Timeline DT service address is empty | Blocker | resourcemanager, timelineserver | Zhijie Shen | Zhijie Shen
HADOOP-12037 | Fix wrong classname in example configuration of hadoop-auth documentation | Trivial | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-8256 | fsck "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation | Major | documentation | J.Andreina | J.Andreina
HDFS-8486 | DN startup may cause severe data loss | Blocker | datanode | Daryn Sharp | Daryn Sharp
HDFS-8386 | Improve synchronization of ‘streamer’ reference in DFSOutputStream | Major | hdfs-client | Rakesh R | Rakesh R
HDFS-8513 | Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant | Minor | namenode | Andrew Wang | Andrew Wang
HADOOP-11991 | test-patch.sh isn’t re-executed even if smart-apply-patch.sh is modified | Major | test | Kengo Seki | Kengo Seki
HDFS-8270 | create() always retried with hardcoded timeout when file already exists with open lease | Major | hdfs-client | Andrey Stepachev | J.Andreina
HDFS-8470 | fsimage loading progress should update inode, delegation token and cache pool count. | Minor | namenode | tongshiquan | Surendra Singh Lilhore
HDFS-8523 | Remove usage information on unsupported operation “fsck -showprogress” from branch-2 | Major | documentation | J.Andreina | J.Andreina
HDFS-3716 | Purger should remove stale fsimage ckpt files | Minor | namenode | suja s | J.Andreina
YARN-3751 | TestAHSWebServices fails after YARN-3467 | Major | . | Zhijie Shen | Sunil Govindan
YARN-3585 | NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled | Critical | . | Peng Zhang | Rohith Sharma K S
MAPREDUCE-6374 | Distributed Cache File visibility should check permission of full path | Major | . | Chang Li | Chang Li
YARN-3762 | FairScheduler: CME on FSParentQueue#getQueueUserAclInfo | Critical | fairscheduler | Karthik Kambatla | Karthik Kambatla
YARN-3749 | We should make a copy of configuration when init MiniYARNCluster with multiple RMs | Major | . | Chun Chen | Chun Chen
MAPREDUCE-5965 | Hadoop streaming throws error if list of input files is high. Error is: “error=7, Argument list too long at if number of input file is high” | Major | . | Arup Malakar | Wilfred Spiegelenburg
HADOOP-12018 | smart-apply-patch.sh fails if the patch edits CR+LF files and is created by ‘git diff –no-prefix’ | Minor | build | Akira Ajisaka | Kengo Seki
HADOOP-12019 | update BUILDING.txt to include python for ‘mvn site’ in windows | Major | . | Vinayakumar B | Vinayakumar B
MAPREDUCE-6382 | Don’t escape HTML links in Diagnostics in JHS job overview | Major | . | Siqi Li | Siqi Li
HADOOP-12058 | Fix dead links to DistCp and Hadoop Archives pages. | Minor | documentation, site | Kazuho Fujii | Kazuho Fujii
HDFS-8463 | Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException | Minor | . | Masatake Iwasaki | Masatake Iwasaki
YARN-3764 | CapacityScheduler should forbid moving LeafQueue from one parent to another | Blocker | . | Wangda Tan | Wangda Tan
HADOOP-11994 | smart-apply-patch wrongly assumes that git is infallible | Major | test | Allen Wittenauer | Kengo Seki
HADOOP-11924 | Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init | Major | . | Gera Shegalov | Tsuyoshi Ozawa
YARN-3733 | Fix DominantRC#compare() does not work as expected if cluster resource is empty | Blocker | resourcemanager | Bibin A Chundatt | Rohith Sharma K S
MAPREDUCE-6377 | JHS sorting on state column not working in webUi | Minor | jobhistoryserver | Bibin A Chundatt | zhihai xu
MAPREDUCE-6387 | Serialize the recently added Task#encryptedSpillKey field at the end | Minor | . | Arun Suresh | Arun Suresh
HADOOP-12056 | Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory | Major | util | zhihai xu | zhihai xu
HDFS-8522 | Change heavily recorded NN logs from INFO to DEBUG level | Major | namenode | Xiaoyu Yao | Xiaoyu Yao
YARN-3655 | FairScheduler: potential livelock due to maxAMShare limitation and container reservation | Critical | fairscheduler | zhihai xu | zhihai xu
HDFS-8539 | Hdfs doesnt have class ‘debug’ in windows | Major | scripts | Sumana Sathish | Anu Engineer
YARN-3780 | Should use equals when compare Resource in RMNodeImpl#ReconnectNodeTransition | Minor | resourcemanager | zhihai xu | zhihai xu
YARN-3747 | TestLocalDirsHandlerService should delete the created test directory logDir2 | Minor | test | David Moore | David Moore
HDFS-8554 | TestDatanodeLayoutUpgrade fails on Windows. | Major | test | Chris Nauroth | Chris Nauroth
YARN-3778 | Fix Yarn resourcemanger CLI usage | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12054 | RPC client should not retry for InvalidToken exceptions | Critical | ipc | Daryn Sharp | Varun Saxena
HDFS-8552 | Fix hdfs CLI usage message for namenode and zkfc | Major | . | Xiaoyu Yao | Brahma Reddy Battula
HADOOP-12073 | Azure FileSystem PageBlobInputStream does not return -1 on EOF | Major | tools | Ivan Mitic | Ivan Mitic
HDFS-8568 | TestClusterId#testFormatWithEmptyClusterIdOption is failing | Major | . | Rakesh R | Rakesh R
HADOOP-7817 | RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() | Major | fs | Kristofer Tomasette | Kanaka Kumar Avvaru
MAPREDUCE-6350 | JobHistory doesn’t support fully-functional search | Critical | jobhistoryserver | Siqi Li | Siqi Li
MAPREDUCE-6389 | Fix BaileyBorweinPlouffe CLI usage message | Trivial | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12052 | IPC client downgrades all exception types to IOE, breaks callers trying to use them | Critical | . | Steve Loughran | Brahma Reddy Battula
YARN-3785 | Support for Resource as an argument during submitApp call in MockRM test class | Minor | resourcemanager | Sunil Govindan | Sunil Govindan
HADOOP-12074 | in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException | Minor | . | Lavkesh Lahngir | Lavkesh Lahngir
HDFS-8566 | HDFS documentation about debug commands wrongly identifies them as “hdfs dfs” commands | Major | documentation | Surendra Singh Lilhore | Surendra Singh Lilhore
HDFS-8583 | Document that NFS gateway does not work with rpcbind on SLES 11 | Major | documentation | Arpit Agarwal | Arpit Agarwal
HDFS-8572 | DN always uses HTTP/localhost@REALM principals in SPNEGO | Blocker | . | Haohui Mai | Haohui Mai
YARN-3794 | TestRMEmbeddedElector fails because of ambiguous LOG reference | Major | test | Chengbing Liu | Chengbing Liu
HDFS-8593 | Calculation of effective layout version mishandles comparison to current layout version in storage. | Major | namenode | Chris Nauroth | Chris Nauroth
HDFS-8596 | TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of “datanode” attribute | Blocker | datanode | Yongjun Zhang | Yongjun Zhang
HDFS-8595 | TestCommitBlockSynchronization fails in branch-2.7 | Major | test | Arpit Agarwal | Arpit Agarwal
HDFS-8607 | TestFileCorruption doesn’t work as expected | Major | test | Walter Su | Walter Su
HADOOP-12001 | Limiting LDAP search conflicts with posixGroup addition | Blocker | security | Patrick White | Patrick White
HADOOP-12078 | The default retry policy does not handle RetriableException correctly | Critical | ipc | Arpit Agarwal | Arpit Agarwal
HDFS-8576 | Lease recovery should return true if the lease can be released and the file can be closed | Major | namenode | J.Andreina | J.Andreina
HDFS-8592 | SafeModeException never get unwrapped | Major | . | Haohui Mai | Haohui Mai
HADOOP-12095 | org.apache.hadoop.fs.shell.TestCount fails | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-4660 | Block corruption can happen during pipeline recovery | Blocker | datanode | Peng Zhang | Kihwal Lee
HDFS-8548 | Minicluster throws NPE on shutdown | Major | . | Mike Drob | Surendra Singh Lilhore
YARN-3714 | AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id | Minor | . | Masatake Iwasaki | Masatake Iwasaki
HDFS-8551 | Fix hdfs datanode CLI usage message | Major | . | Xiaoyu Yao | Brahma Reddy Battula
HADOOP-12076 | Incomplete Cache Mechanism in CredentialProvider API | Major | security | Larry McCay | Larry McCay
YARN-3617 | Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning always -1 | Minor | . | Georg Berendt | J.Andreina
YARN-3804 | Both RM are on standBy state when kerberos user not in yarn.admin.acl | Critical | resourcemanager | Bibin A Chundatt | Varun Saxena
HDFS-8446 | Separate safemode related operations in GetBlockLocations() | Minor | . | Haohui Mai | Haohui Mai
HDFS-8615 | Correct HTTP method in WebHDFS document | Major | documentation | Akira Ajisaka | Brahma Reddy Battula
MAPREDUCE-6373 | The logger reports total input paths but it is referring to input files | Trivial | . | Andi Chirita Amdocs | Bibin A Chundatt
YARN-3824 | Fix two minor nits in member variable properties of YarnConfiguration | Trivial | yarn | Ray Chiang | Ray Chiang
HADOOP-12100 | ImmutableFsPermission should not override applyUmask since that method doesn’t modify the FsPermission | Major | . | Robert Kanter | Bibin A Chundatt
YARN-3802 | Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected. | Major | resourcemanager | zhihai xu | zhihai xu
HDFS-8633 | Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys | Minor | datanode | Ray Chiang | Ray Chiang
HDFS-8626 | Reserved RBW space is not released if creation of RBW File fails | Blocker | . | Kanaka Kumar Avvaru | Kanaka Kumar Avvaru
MAPREDUCE-6405 | NullPointerException in App Attempts page | Major | . | Siqi Li | Siqi Li
HADOOP-12103 | Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing | Minor | security | Yongjun Zhang | Yongjun Zhang
HDFS-8337 | Accessing httpfs via webhdfs doesn’t work from a jar with kerberos | Major | security, webhdfs | Yongjun Zhang | Yongjun Zhang
MAPREDUCE-6403 | Fix typo in the usage of NNBench | Trivial | documentation | Akira Ajisaka | Jagadesh Kiran N
HDFS-8480 | Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them | Critical | . | Zhe Zhang | Zhe Zhang
MAPREDUCE-5948 | org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well | Critical | . | Kris Geusebroek | Akira Ajisaka
HDFS-8542 | WebHDFS getHomeDirectory behavior does not match specification | Major | webhdfs | Jakob Homan | Kanaka Kumar Avvaru
YARN-3842 | NMProxy should retry on NMNotYetReadyException | Critical | . | Karthik Kambatla | Robert Kanter
YARN-3835 | hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml | Minor | resourcemanager | Vamsee Yarlagadda | Vamsee Yarlagadda
MAPREDUCE-6410 | Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster | Critical | . | Zhang Wei | Varun Saxena
MAPREDUCE-6400 | Multiple shuffle transfer fails because input is closed too early | Blocker | task | Akira Ajisaka | Brahma Reddy Battula
YARN-3809 | Failed to launch new attempts because ApplicationMasterLauncher’s threads all hang | Major | resourcemanager | Jun Gong | Jun Gong
YARN-3832 | Resource Localization fails on a cluster due to existing cache directories | Critical | nodemanager | Ranga Swamy | Brahma Reddy Battula
YARN-3790 | usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container | Major | fairscheduler, test | Rohith Sharma K S | zhihai xu
HADOOP-11958 | MetricsSystemImpl fails to show backtrace when an error occurs | Major | . | Jason Lowe | Jason Lowe
HDFS-8646 | Prune cached replicas from DatanodeDescriptor state on replica invalidation | Major | caching | Andrew Wang | Andrew Wang
YARN-3826 | Race condition in ResourceTrackerService leads to wrong diagnostics messages | Major | resourcemanager | Chengbing Liu | Chengbing Liu
YARN-3745 | SerializedException should also try to instantiate internal exception with the default constructor | Major | . | Lavkesh Lahngir | Lavkesh Lahngir
MAPREDUCE-6413 | TestLocalJobSubmission is failing with unknown host | Major | test | Jason Lowe | zhihai xu
HDFS-8665 | Fix replication check in DFSTestUtils#waitForReplication | Trivial | test | Andrew Wang | Andrew Wang
HADOOP-8151 | Error handling in snappy decompressor throws invalid exceptions | Major | io, native | Todd Lipcon | Matt Foley
YARN-3850 | NM fails to read files from full disks which can lead to container logs being lost and other issues | Blocker | log-aggregation, nodemanager | Varun Saxena | Varun Saxena
HDFS-8656 | Preserve compatibility of ClientProtocol#rollingUpgrade after finalization | Critical | rolling upgrades | Andrew Wang | Andrew Wang
YARN-3859 | LeafQueue doesn’t print user properly for application add | Minor | capacityscheduler | Devaraj K | Varun Saxena
HDFS-8681 | BlockScanner is incorrectly disabled by default | Blocker | datanode | Andrew Wang | Arpit Agarwal
YARN-3860 | rmadmin -transitionToActive should check the state of non-target node | Major | resourcemanager | Masatake Iwasaki | Masatake Iwasaki
HDFS-8586 | Dead Datanode is allocated for write when client is from deadnode | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12119 | hadoop fs -expunge does not work for federated namespace | Major | . | Vrushali C | J.Andreina
HDFS-8628 | Update missing command option for fetchdt | Major | documentation | J.Andreina | J.Andreina
YARN-3695 | ServerProxy (NMProxy, etc.) shouldn’t retry forever for non network exception. | Major | . | Junping Du | Raju Bairishetti
HADOOP-12089 | StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB | Major | tools | Duo Xu | Duo Xu
YARN-3770 | SerializedException should also handle java.lang.Error | Major | . | Lavkesh Lahngir | Lavkesh Lahngir
HDFS-8687 | Remove the duplicate usage message from Dfsck.java | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12107 | long running apps may have a huge number of StatisticsData instances under FileSystem | Critical | fs | Sangjin Lee | Sangjin Lee
HDFS-8579 | Update HDFS usage with missing options | Minor | . | J.Andreina | J.Andreina
HADOOP-12154 | FileSystem#getUsed() returns the file length only from root ‘/’ | Major | . | tongshiquan | J.Andreina
YARN-3768 | ArrayIndexOutOfBoundsException with empty environment variables | Major | yarn | Joe Ferner | zhihai xu
HADOOP-10798 | globStatus() should always return a sorted list of files | Minor | . | Felix Borchers | Colin P. McCabe
HADOOP-12124 | Add HTrace support for FsShell | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-12159 | Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces | Major | . | Ray Chiang | Ray Chiang
MAPREDUCE-6121 | JobResourceUpdater#compareFs() doesn’t handle HA namespaces | Major | mrv2 | Thomas Graves | Ray Chiang
HADOOP-12116 | Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2 | Major | scripts | Li Lu | Li Lu
HADOOP-12164 | Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. | Minor | . | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3823 | Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property | Minor | . | Ray Chiang | Ray Chiang
YARN-3830 | AbstractYarnScheduler.createReleaseCache may try to clean a null attempt | Major | scheduler | nijel | nijel
HDFS-8706 | Fix typo in datanode startup options in HDFSCommands.html | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
MAPREDUCE-6420 | Interrupted Exception in LocalContainerLauncher should be logged in warn/info level | Major | . | Chang Li | Chang Li
MAPREDUCE-6418 | MRApp should not shutdown LogManager during shutdown | Major | test | Chang Li | Chang Li
YARN-3793 | Several NPEs when deleting local files on NM recovery | Major | nodemanager | Karthik Kambatla | Varun Saxena
HDFS-8666 | speedup TestMover | Major | test | Walter Su | Walter Su
HADOOP-12171 | Shorten overly-long htrace span names for server | Major | tracing | Colin P. McCabe | Colin P. McCabe
YARN-3875 | FSSchedulerNode#reserveResource() doesn’t print Application Id properly in log | Minor | . | Bibin A Chundatt | Bibin A Chundatt
YARN-3508 | Prevent processing preemption events on the main RM dispatcher | Major | resourcemanager, scheduler | Jason Lowe | Varun Saxena
HADOOP-12173 | NetworkTopology#add calls NetworkTopology#toString always | Major | . | Íñigo Goiri | Íñigo Goiri
HDFS-8577 | Avoid retrying to recover lease on a file which does not exist | Major | . | J.Andreina | J.Andreina
YARN-3882 | AggregatedLogFormat should close aclScanner and ownerScanner after create them. | Minor | nodemanager | zhihai xu | zhihai xu
MAPREDUCE-6425 | ShuffleHandler passes wrong “base” parameter to getMapOutputInfo if mapId is not in the cache. | Major | mrv2, nodemanager | zhihai xu | zhihai xu
HADOOP-12186 | ActiveStandbyElector shouldn’t call monitorLockNodeAsync multiple times | Major | ha | zhihai xu | zhihai xu
HDFS-8686 | WebHdfsFileSystem#getXAttr(Path p, final String name) doesn’t work if namespace is in capitals | Major | webhdfs | Jagadesh Kiran N | Kanaka Kumar Avvaru
YARN-3837 | javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options | Minor | timelineserver | Steve Loughran | Bibin A Chundatt
HADOOP-12117 | Potential NPE from Configuration#loadProperty with allowNullValueProperties set. | Minor | conf | zhihai xu | zhihai xu
MAPREDUCE-6038 | A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial | Minor | . | Pei Ma | Tsuyoshi Ozawa
YARN-3892 | NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails | Minor | . | Bibin A Chundatt | Bibin A Chundatt
YARN-3690 | [JDK8] ‘mvn site’ fails | Major | api, site | Akira Ajisaka | Brahma Reddy Battula
HADOOP-12202 | releasedocmaker drops missing component and assignee entries | Blocker | yetus | Allen Wittenauer | Allen Wittenauer
HDFS-8642 | Make TestFileTruncate more reliable | Minor | . | Rakesh R | Rakesh R
HADOOP-11878 | FileContext.java # fixRelativePart should check for not null for a more informative exception | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12201 | Add tracing to FileSystem#createFileSystem and Globber#glob | Major | . | Colin P. McCabe | Colin P. McCabe
HADOOP-12200 | TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile | Minor | test | Masatake Iwasaki | Masatake Iwasaki
MAPREDUCE-6426 | TestShuffleHandler#testGetMapOutputInfo is failing | Major | test | Devaraj K | zhihai xu
HDFS-8729 | Fix testTruncateWithDataNodesRestartImmediately occasionally failed | Minor | . | Walter Su | Walter Su
YARN-3888 | ApplicationMaster link is broken in RM WebUI when appstate is NEW | Minor | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-8749 | Fix findbugs warning in BlockManager.java | Minor | . | Akira Ajisaka | Brahma Reddy Battula
HDFS-2956 | calling fetchdt without a –renewer argument throws NPE | Major | security | Todd Lipcon | Vinayakumar B
HDFS-8751 | Remove setBlocks API from INodeFile and misc code cleanup | Major | namenode | Zhe Zhang | Zhe Zhang
YARN-3849 | Too much of preemption activity causing continuos killing of containers across queues | Critical | capacityscheduler | Sunil Govindan | Sunil Govindan
YARN-3917 | getResourceCalculatorPlugin for the default should intercept all exceptions | Major | . | Gera Shegalov | Gera Shegalov
YARN-3894 | RM startup should fail for wrong CS xml NodeLabel capacity configuration | Critical | capacityscheduler | Bibin A Chundatt | Bibin A Chundatt
MAPREDUCE-6421 | Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression | Major | . | Ray Chiang | Brahma Reddy Battula
HADOOP-12191 | Bzip2Factory is not thread safe | Major | io | Jason Lowe | Brahma Reddy Battula
HDFS-7608 | hdfs dfsclient newConnectedPeer has no write timeout | Major | fuse-dfs, hdfs-client | zhangshilong | Xiaoyu Yao
HADOOP-12153 | ByteBufferReadable doesn’t declare @InterfaceAudience and @InterfaceStability | Minor | fs | Steve Loughran | Brahma Reddy Battula
HDFS-8778 | TestBlockReportRateLimiting#testLeaseExpiration can deadlock | Major | test | Arpit Agarwal | Arpit Agarwal
HADOOP-10615 | FileInputStream in JenkinsHash#main() is never closed | Minor | . | Ted Yu | Chen He
HADOOP-12240 | Fix tests requiring native library to be skipped in non-native profile | Minor | test | Masatake Iwasaki | Masatake Iwasaki
YARN-3805 | Update the documentation of Disk Checker based on YARN-90 | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-8767 | RawLocalFileSystem.listStatus() returns null for UNIX pipefile | Critical | . | Haohui Mai | Kanaka Kumar Avvaru
YARN-3885 | ProportionalCapacityPreemptionPolicy doesn’t preempt if queue is more than 2 level | Blocker | yarn | Ajith S | Ajith S
YARN-3453 | Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing | Major | fairscheduler | Ashwin Shankar | Arun Suresh
YARN-3535 | Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED | Critical | capacityscheduler, fairscheduler, resourcemanager | Peng Zhang | Peng Zhang
YARN-3905 | Application History Server UI NPEs when accessing apps run after RM restart | Major | timelineserver | Eric Payne | Eric Payne
HADOOP-12235 | hadoop-openstack junit & mockito dependencies should be “provided” | Minor | build, fs/swift | Steve Loughran | Ted Yu
HADOOP-12088 | KMSClientProvider uses equalsIgnoreCase(“application/json”) | Major | kms | Steve Loughran | Brahma Reddy Battula
HADOOP-12051 | ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage in logging/span events | Minor | ipc | Steve Loughran | Varun Saxena
HADOOP-12237 | releasedocmaker.py doesn’t work behind a proxy | Major | yetus | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-7582 | Enforce maximum number of ACL entries separately per access and default. | Major | namenode | Vinayakumar B | Vinayakumar B
HDFS-8773 | Few FSNamesystem metrics are not documented in the Metrics page | Major | documentation | Rakesh R | Rakesh R
YARN-3878 | AsyncDispatcher can hang while stopping if it is configured for draining events on stop | Critical | . | Varun Saxena | Varun Saxena
HDFS-7728 | Avoid updating quota usage while loading edits | Major | . | Jing Zhao | Jing Zhao
HADOOP-11962 | Sasl message with MD5 challenge text shouldn’t be LOG out even in debug level. | Critical | ipc, security | Junping Du | Junping Du
HADOOP-12017 | Hadoop archives command should use configurable replication factor when closing | Major | . | Zhe Zhang | Bibin A Chundatt
HADOOP-12239 | StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB | Major | fs/azure, tools | Duo Xu | Duo Xu
YARN-3932 | SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources | Major | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
YARN-3954 | TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml fails in trunk | Major | . | Varun Saxena | Varun Saxena
YARN-2019 | Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore | Critical | . | Junping Du | Jian He
HDFS-8797 | WebHdfsFileSystem creates too many connections for pread | Major | webhdfs | Jing Zhao | Jing Zhao
YARN-3941 | Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler | Major | capacityscheduler | Sunil Govindan | Sunil Govindan
YARN-3900 | Protobuf layout of yarn_security_token causes errors in other protos that include it | Major | . | Anubhav Dhoot | Anubhav Dhoot
YARN-3845 | Scheduler page does not render RGBA color combinations in IE11 | Minor | . | Jagadesh Kiran N | Mohammad Shahid Khan
HDFS-8806 | Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared | Major | . | Zhe Zhang | Zhe Zhang
YARN-3967 | Fetch the application report from the AHS if the RM does not know about it | Major | . | Mit Desai | Mit Desai
YARN-3957 | FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500 | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
YARN-3925 | ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. | Critical | nodemanager | zhihai xu | zhihai xu
YARN-3973 | Recent changes to application priority management break reservation system from YARN-1051 | Major | resourcemanager | Carlo Curino | Carlo Curino
YARN-3958 | TestYarnConfigurationFields should be moved to hadoop-yarn-api module | Major | . | Varun Saxena | Varun Saxena
HDFS-8810 | Correct assertions in TestDFSInotifyEventInputStream class. | Minor | test | Surendra Singh Lilhore | Surendra Singh Lilhore
HDFS-8785 | TestDistributedFileSystem is failing in trunk | Major | test | Arpit Agarwal | Xiaoyu Yao
YARN-2194 | Cgroups cease to work in RHEL7 | Critical | nodemanager | Wei Yan | Wei Yan
YARN-3846 | RM Web UI queue filter is not working | Major | yarn | Mohammad Shahid Khan | Mohammad Shahid Khan
HADOOP-12245 | References to misspelled REMAINING_QUATA in FileSystemShell.md | Minor | documentation | Gera Shegalov | Gabor Liptak
YARN-3982 | container-executor parsing of container-executor.cfg broken in trunk and branch-2 | Blocker | nodemanager | Varun Vasudev | Varun Vasudev
HADOOP-12175 | FsShell must load SpanReceiverHost to support tracing | Major | tracing | Masatake Iwasaki | Masatake Iwasaki
HDFS-8670 | Better to exclude decommissioned nodes for namenode NodeUsage JMX | Major | . | Ming Ma | J.Andreina
HADOOP-10945 | 4-digit octal umask permissions throws a parse error | Major | fs | Jason Lowe | Chang Li
YARN-3919 | NPEs’ while stopping service after exception during CommonNodeLabelsManager#start | Trivial | resourcemanager | Varun Saxena | Varun Saxena
YARN-3963 | AddNodeLabel on duplicate label addition shows success | Minor | . | Bibin A Chundatt | Bibin A Chundatt
YARN-3990 | AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected | Critical | resourcemanager | Rohith Sharma K S | Bibin A Chundatt
HDFS-6860 | BlockStateChange logs are too noisy | Major | namenode | Arpit Agarwal | Chang Li
HADOOP-12268 | AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. | Major | test | zhihai xu | zhihai xu
HDFS-8847 | change TestHDFSContractAppend to not override testRenameFileBeingAppended method. | Major | test | zhihai xu | zhihai xu
HDFS-8850 | VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks | Major | datanode | Colin P. McCabe | Colin P. McCabe
HDFS-8844 | TestHDFSCLI does not cleanup the test directory | Minor | test | Akira Ajisaka | Masatake Iwasaki
HADOOP-12274 | Remove direct download link from BUILDING.txt | Minor | documentation | Caleb Severn | Caleb Severn
HADOOP-12302 | Fix native compilation on Windows after HADOOP-7824 | Blocker | . | Vinayakumar B | Vinayakumar B
YARN-3983 | Make CapacityScheduler to easier extend application allocation logic | Major | . | Wangda Tan | Wangda Tan
HADOOP-12304 | Applications using FileContext fail with the default file system configured to be wasb/s3/etc. | Blocker | fs | Chris Nauroth | Chris Nauroth
HADOOP-11932 | MetricsSinkAdapter hangs when being stopped | Critical | . | Jian He | Brahma Reddy Battula
HDFS-8856 | Make LeaseManager#countPath O(1) | Major | namenode | Arpit Agarwal | Arpit Agarwal
HDFS-8772 | Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails | Major | . | Walter Su | Walter Su
YARN-3966 | Fix excessive loggings in CapacityScheduler | Major | . | Jian He | Jian He
HDFS-8866 | Typo in docs: Rumtime -> Runtime | Trivial | documentation, webhdfs | Jakob Homan | Gabor Liptak
YARN-3999 | RM hangs on draining events | Major | . | Jian He | Jian He
YARN-4026 | FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests | Major | . | Wangda Tan | Wangda Tan
HDFS-8879 | Quota by storage type usage incorrectly initialized upon namenode restart | Major | namenode | Kihwal Lee | Xiaoyu Yao
HADOOP-12258 | Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression | Critical | fs | zhihai xu | zhihai xu
YARN-4005 | Completed container whose app is finished is not removed from NMStateStore | Major | . | Jun Gong | Jun Gong
YARN-4047 | ClientRMService getApplications has high scheduler lock contention | Major | resourcemanager | Jason Lowe | Jason Lowe
YARN-3987 | am container complete msg ack to NM once RM receive it | Major | resourcemanager | sandflee | sandflee
HADOOP-12322 | typos in rpcmetrics.java | Trivial | ipc | Anu Engineer | Anu Engineer
HDFS-8565 | Typo in dfshealth.html - “Decomissioning” | Trivial | . | nijel | nijel
MAPREDUCE-5817 | Mappers get rescheduled on node transition even after all reducers are completed | Major | applicationmaster | Sangjin Lee | Sangjin Lee
HDFS-8891 | HDFS concat should keep srcs order | Blocker | . | Yong Zhang | Yong Zhang
MAPREDUCE-6439 | AM may fail instead of retrying if RM shuts down during the allocate call | Critical | . | Anubhav Dhoot | Anubhav Dhoot
HDFS-8845 | DiskChecker should not traverse the entire tree | Major | . | Chang Li | Chang Li
HDFS-8852 | HDFS architecture documentation of version 2.x is outdated about append write support | Major | documentation | Hong Dai Thanh | Ajith S
YARN-3857 | Memory leak in ResourceManager with SIMPLE mode | Critical | resourcemanager | mujunchao | mujunchao
YARN-4028 | AppBlock page key update and diagnostics value null on recovery | Minor | . | Bibin A Chundatt | Bibin A Chundatt
HDFS-8908 | TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode | Minor | test | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8867 | Enable optimized block reports | Major | . | Rushabh S Shah | Daryn Sharp
HADOOP-12317 | Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST | Critical | . | Anubhav Dhoot | Anubhav Dhoot
HDFS-8863 | The remaining space check in BlockPlacementPolicyDefault is flawed | Critical | . | Kihwal Lee | Kihwal Lee
HDFS-8922 | Link the native_mini_dfs test library with libdl, since IBM Java requires it | Major | build | Ayappan | Ayappan
HDFS-8809 | HDFS fsck reports under construction blocks as “CORRUPT” | Major | tools | Sudhir Prakash | Jing Zhao
MAPREDUCE-6454 | MapReduce doesn’t set the HADOOP_CLASSPATH for jar lib in distributed cache. | Critical | . | Junping Du | Junping Du
MAPREDUCE-6357 | MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute | Major | documentation | Ivan Mitic | Dustin Cote
YARN-3986 | getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead | Major | scheduler | Varun Saxena | Varun Saxena
HADOOP-12347 | Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives | Trivial | . | Xiaoyu Yao | Xiaoyu Yao
HDFS-8942 | Update hyperlink to rack awareness page in HDFS Architecture documentation | Trivial | documentation | Masatake Iwasaki | Masatake Iwasaki
YARN-3896 | RMNode transitioned from RUNNING to REBOOTED because its response id had not been reset synchronously | Major | resourcemanager | Jun Gong | Jun Gong
HDFS-8930 | Block report lease may leak if the 2nd full block report comes when NN is still in safemode | Minor | . | Jing Zhao | Jing Zhao
HDFS-8932 | NPE thrown in NameNode when try to get “TotalSyncCount” metric before editLogStream initialization | Major | . | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-12352 | Delay in checkpointing Trash can leave trash for 2 intervals before deleting | Trivial | trash | Casey Brotherton | Casey Brotherton
HDFS-8846 | Add a unit test for INotify functionality across a layout version upgrade | Major | namenode | Zhe Zhang | Zhe Zhang
HDFS-8896 | DataNode object isn’t GCed when shutdown, because it has GC root in ShutdownHookManager | Minor | test | Walter Su | Walter Su
HDFS-8961 | Surpress findbug warnings of o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager in hdfs-client | Major | . | Haohui Mai | Mingliang Liu
HADOOP-12362 | Set hadoop.tmp.dir and hadoop.log.dir in pom | Major | . | Charlie Helin | Charlie Helin
HDFS-8969 | Clean up findbugs warnings for HDFS-8823 and HDFS-8932 | Major | namenode | Anu Engineer | Anu Engineer
HDFS-8963 | Fix incorrect sign extension of xattr length in HDFS-8900 | Critical | . | Haohui Mai | Colin P. McCabe
YARN-1556 | NPE getting application report with a null appId | Minor | client | Steve Loughran | Weiwei Yang
MAPREDUCE-6452 | NPE when intermediate encrypt enabled for LocalRunner | Major | . | Bibin A Chundatt | zhihai xu
HDFS-8950 | NameNode refresh doesn’t remove DataNodes that are no longer in the allowed list | Major | datanode, namenode | Daniel Templeton | Daniel Templeton
HADOOP-12346 | Increase some default timeouts / retries for S3a connector | Major | fs/s3 | Sean Mackrory | Sean Mackrory
HADOOP-12359 | hadoop fs -getmerge doc is wrong | Major | documentation | Daniel Templeton | Jagadesh Kiran N
HADOOP-10365 | BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block | Minor | util | Ted Yu | Kiran Kumar M R
HDFS-8995 | Flaw in registration bookeeping can make DN die on reconnect | Critical | . | Kihwal Lee | Kihwal Lee
HDFS-8388 | Time and Date format need to be in sync in NameNode UI page | Minor | . | Archana T | Surendra Singh Lilhore
YARN-4073 | Unused ApplicationACLsManager in ContainerManagerImpl | Trivial | . | Naganarasimha G R | Naganarasimha G R
HDFS-9003 | ForkJoin thread pool leaks | Major | . | Kihwal Lee | Kihwal Lee
HDFS-8885 | ByteRangeInputStream used in webhdfs does not override available() | Minor | webhdfs | Shradha Revankar | Shradha Revankar
HADOOP-10318 | Incorrect reference to nodeFile in RumenToSLSConverter error message | Minor | . | Ted Yu | Wei Yan
HADOOP-12213 | Interrupted exception can occur when Client#stop is called | Minor | . | Oleg Zhurakousky | Kuhu Shukla
HDFS-9009 | Send metrics logs to NullAppender by default | Major | logging | Arpit Agarwal | Arpit Agarwal
HDFS-8964 | When validating the edit log, do not read at or beyond the file offset that is being written | Major | journal-node, namenode | Zhe Zhang | Zhe Zhang
HDFS-8939 | Test(S)WebHdfsFileContextMainOperations failing on branch-2 | Major | webhdfs | Jakob Homan | Chris Nauroth
YARN-4103 | RM WebServices missing scheme for appattempts logLinks | Major | . | Jonathan Eagles | Jonathan Eagles
YARN-4105 | Capacity Scheduler headroom for DRF is wrong | Major | capacityscheduler | Chang Li | Chang Li
MAPREDUCE-6442 | Stack trace is missing when error occurs in client protocol provider’s constructor | Major | client | Chang Li | Chang Li
YARN-3591 | Resource localization on a bad disk causes subsequent containers failure | Major | . | Lavkesh Lahngir | Lavkesh Lahngir
YARN-4121 | Typos in capacity scheduler documentation. | Trivial | documentation | Kai Sasaki | Kai Sasaki
YARN-4096 | App local logs are leaked if log aggregation fails to initialize for the app | Major | log-aggregation, nodemanager | Jason Lowe | Jason Lowe
HADOOP-12388 | Fix components’ version information in the web page ‘About the Cluster’ | Minor | util | Jun Gong | Jun Gong
HDFS-9033 | dfsadmin -metasave prints “NaN” for cache used% | Major | . | Archana T | Brahma Reddy Battula
HDFS-8716 | introduce a new config specifically for safe mode block count | Major | . | Chang Li | Chang Li
HDFS-8581 | ContentSummary on / skips further counts on yielding lock | Minor | namenode | tongshiquan | J.Andreina
HDFS-6763 | Initialize file system-wide quota once on transitioning to active | Major | ha, namenode | Daryn Sharp | Kihwal Lee
MAPREDUCE-6474 | ShuffleHandler can possibly exhaust nodemanager file descriptors | Major | mrv2, nodemanager | Nathan Roberts | Kuhu Shukla
YARN-4106 | NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM | Major | . | Bibin A Chundatt | Bibin A Chundatt
YARN-4115 | Reduce loglevel of ContainerManagementProtocolProxy to Debug | Minor | . | Anubhav Dhoot | Anubhav Dhoot
HADOOP-12348 | MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. | Major | metrics | zhihai xu | zhihai xu
HDFS-9042 | Update document for the Storage policy name | Minor | documentation | J.Andreina | J.Andreina
HDFS-9036 | In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. | Major | . | J.Andreina | J.Andreina
HADOOP-12407 | Test failing: hadoop.ipc.TestSaslRPC | Critical | security, test | Steve Loughran | Steve Loughran
HADOOP-12087 | [JDK8] Fix javadoc errors caused by incorrect or illegal tags | Major | documentation | Akira Ajisaka | Akira Ajisaka
HDFS-9069 | TestNameNodeMetricsLogger failing -port in use | Critical | test | Steve Loughran | Steve Loughran
HDFS-8996 | Consolidate validateLog and scanLog in FJM#EditLogFile | Major | journal-node, namenode | Zhe Zhang | Zhe Zhang
YARN-4151 | Fix findbugs errors in hadoop-yarn-server-common module | Major | . | MENG DING | MENG DING
HDFS-9067 | o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk | Critical | . | Haohui Mai | Surendra Singh Lilhore
MAPREDUCE-6472 | MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks | Major | mr-am | Jason Lowe | Naganarasimha G R
HADOOP-12374 | Description of hdfs expunge command is confusing | Major | documentation, trash | Weiwei Yang | Weiwei Yang
YARN-4078 | getPendingResourceRequestForAttempt is present in AbstractYarnScheduler should be present in YarnScheduler interface instead | Minor | resourcemanager | Naganarasimha G R | Naganarasimha G R
HDFS-9072 | Fix random failures in TestJMXGet | Critical | test | J.Andreina | J.Andreina
HDFS-9073 | Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction | Critical | test | J.Andreina | J.Andreina
YARN-3433 | Jersey tests failing with Port in Use -again | Critical | build, test | Steve Loughran | Brahma Reddy Battula
HADOOP-12417 | TestWebDelegationToken failing with port in use | Major | test | Steve Loughran | Mingliang Liu
MAPREDUCE-6481 | LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. | Critical | mrv2 | zhihai xu | zhihai xu
MAPREDUCE-5002 | AM could potentially allocate a reduce container to a map attempt | Major | mr-am | Jason Lowe | Chang Li
MAPREDUCE-5982 | Task attempts that fail from the ASSIGNED state can disappear | Major | mr-am | Jason Lowe | Chang Li
HADOOP-12386 | RetryPolicies.RETRY_FOREVER should be able to specify a retry interval | Major | . | Wangda Tan | Sunil Govindan
YARN-3697 | FairScheduler: ContinuousSchedulingThread can fail to shutdown | Critical | fairscheduler | zhihai xu | zhihai xu
HDFS-6955 | DN should reserve disk space for a full block when creating tmp files | Major | datanode | Arpit Agarwal | Kanaka Kumar Avvaru
HDFS-5802 | NameNode does not check for inode type before traversing down a path | Trivial | namenode | Harsh J | Xiao Chen
MAPREDUCE-6460 | TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails | Major | test | zhihai xu | zhihai xu
YARN-4167 | NPE on RMActiveServices#serviceStop when store is null | Minor | . | Bibin A Chundatt | Bibin A Chundatt
YARN-4113 | RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER | Critical | . | Wangda Tan | Sunil Govindan
YARN-4188 | MoveApplicationAcrossQueuesResponse should be an abstract class | Minor | resourcemanager | Giovanni Matteo Fumarola | Giovanni Matteo Fumarola
HDFS-9043 | Doc updation for commands in HDFS Federation | Minor | documentation | J.Andreina | J.Andreina
HDFS-9013 | Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore
YARN-3975 | WebAppProxyServlet should not redirect to RM page if AHS is enabled | Major | . | Mit Desai | Mit Desai
HADOOP-12438 | Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem | Trivial | test | Chris Nauroth | Chris Nauroth
HDFS-9128 | TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. | Trivial | test | Chris Nauroth | Chris Nauroth
YARN-4152 | NM crash with NPE when LogAggregationService#stopContainer called for absent container | Critical | log-aggregation, nodemanager | Bibin A Chundatt | Bibin A Chundatt
YARN-4044 | Running applications information changes such as movequeue is not published to TimeLine server | Critical | resourcemanager, timelineserver | Sunil Govindan | Sunil Govindan
HDFS-9076 | Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten() | Major | hdfs-client | Surendra Singh Lilhore | Surendra Singh Lilhore
MAPREDUCE-6484 | Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. | Major | client, security | zhihai xu | zhihai xu
HADOOP-12437 | Allow SecurityUtil to lookup alternate hostnames | Major | net, security | Arpit Agarwal | Arpit Agarwal
HADOOP-12252 | LocalDirAllocator should not throw NPE with empty string configuration. | Minor | fs | zhihai xu | zhihai xu
YARN-3624 | ApplicationHistoryServer reverses the order of the filters it gets | Major | timelineserver | Mit Desai | Mit Desai
HDFS-9123 | Copying from the root to a subdirectory should be forbidden | Minor | fs | Wei-Chiu Chuang | Wei-Chiu Chuang
MAPREDUCE-6480 | archive-logs tool may miss applications | Major | . | Robert Kanter | Robert Kanter
HDFS-9107 | Prevent NN’s unrecoverable death spiral after full GC | Critical | namenode | Daryn Sharp | Daryn Sharp
HDFS-9133 | ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe
HDFS-9080 | update htrace version to 4.0.1 | Major | tracing | Colin P. McCabe | Colin P. McCabe
YARN-4204 | ConcurrentModificationException in FairSchedulerQueueInfo | Major | . | Anubhav Dhoot | Anubhav Dhoot
HDFS-9106 | Transfer failure during pipeline recovery causes permanent write failures | Critical | . | Kihwal Lee | Kihwal Lee
HDFS-9147 | Fix the setting of visibleLength in ExternalBlockReader | Major | hdfs-client | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-6492 | AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask | Critical | . | Bibin A Chundatt | Bibin A Chundatt
HADOOP-12440 | TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down | Minor | . | Xiao Chen | Xiao Chen
HDFS-9092 | Nfs silently drops overlapping write requests and causes data copying to fail | Major | nfs | Yongjun Zhang | Yongjun Zhang
YARN-4180 | AMLauncher does not retry on failures when talking to NM | Critical | resourcemanager | Anubhav Dhoot | Anubhav Dhoot
HDFS-9141 | Thread leak in Datanode#refreshVolumes | Major | datanode | Uma Maheswara Rao G | Uma Maheswara Rao G
YARN-4066 | Large number of queues choke fair scheduler | Major | fairscheduler | Johan Gustavsson | Johan Gustavsson
HADOOP-12447 | Clean up some htrace integration issues | Major | tracing | Colin P. McCabe | Colin P. McCabe
HDFS-9174 | Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread | Critical | . | Yi Liu | Yi Liu
HDFS-9001 | DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster | Major | . | Daniel Templeton | Daniel Templeton
HADOOP-12448 | TestTextCommand: use mkdirs rather than mkdir to create test directory | Major | test | Colin P. McCabe | Colin P. McCabe
MAPREDUCE-6494 | Permission issue when running archive-logs tool as different users | Major | . | Robert Kanter | Robert Kanter
MAPREDUCE-6497 | Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler | Major | . | Shinichi Yamashita | Shinichi Yamashita
HADOOP-10296 | Incorrect null check in SwiftRestClient#buildException() | Minor | . | Ted Yu | Kanaka Kumar Avvaru
HADOOP-8437 | getLocalPathForWrite should throw IOException for invalid paths | Major | fs | Brahma Reddy Battula | Brahma Reddy Battula
MAPREDUCE-6485 | MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run | Critical | applicationmaster | Bob.zhao | Xianyin Xin
HDFS-9191 | Typo in Hdfs.java. NoSuchElementException is misspelled | Trivial | documentation | Catherine Palmer | Catherine Palmer
HDFS-9100 | HDFS Balancer does not respect dfs.client.use.datanode.hostname | Major | balancer & mover | Yongjun Zhang | Casey Brotherton
YARN-3619 | ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException | Major | nodemanager | Jason Lowe | zhihai xu
HDFS-9193 | Fix incorrect references the usages of the DN in dfshealth.js | Minor | . | Chang Li | Chang Li
HADOOP-11098 | [JDK8] Max Non Heap Memory default changed between JDK7 and 8 | Major | . | Travis Thompson | Tsuyoshi Ozawa
HADOOP-12441 | Fix kill command behavior under some Linux distributions. | Critical | . | Wangda Tan | Wangda Tan
HADOOP-12452 | Fix tracing documention reflecting the update to htrace-4 | Major | documentation | Masatake Iwasaki | Masatake Iwasaki
YARN-4176 | Resync NM nodelabels with RM periodically for distributed nodelabels | Major | . | Bibin A Chundatt | Bibin A Chundatt
HDFS-7899 | Improve EOF error message | Minor | hdfs-client | Harsh J | Jagadesh Kiran N
MAPREDUCE-6503 | archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME | Major | . | Robert Kanter | Robert Kanter
YARN-4209 | RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition | Critical | resourcemanager | zhihai xu | zhihai xu
HDFS-9196 | Fix TestWebHdfsContentLength | Major | . | Tsuyoshi Ozawa | Masatake Iwasaki
HDFS-9178 | Slow datanode I/O can cause a wrong node to be marked bad | Critical | . | Kihwal Lee | Kihwal Lee
HADOOP-12465 | Incorrect javadoc in WritableUtils.java | Minor | documentation | Martin Petricek | Jagadesh Kiran N
HDFS-9176 | TestDirectoryScanner#testThrottling often fails. | Minor | test | Yi Liu | Daniel Templeton
HDFS-9211 | Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backport | Major | build | Eric Payne | Eric Payne
HDFS-9137 | DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded | Major | datanode | Uma Maheswara Rao G | Uma Maheswara Rao G
HDFS-8164 | cTime is 0 in VERSION file for newly formatted NameNode. | Minor | namenode | Chris Nauroth | Xiao Chen
YARN-4235 | FairScheduler PrimaryGroup does not handle empty groups returned for a user | Major | fairscheduler | Anubhav Dhoot | Anubhav Dhoot
MAPREDUCE-6302 | Preempt reducers after a configurable timeout irrespective of headroom | Critical | . | mai shurong | Karthik Kambatla
HDFS-9142 | Separating Configuration object for namenode(s) in MiniDFSCluster | Major | . | Siqi Li | Siqi Li
HDFS-8941 | DistributedFileSystem listCorruptFileBlocks API should resolve relative path | Major | hdfs-client | Rakesh R | Rakesh R
HDFS-9222 | Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client | Major | . | Haohui Mai | Mingliang Liu
YARN-4201 | AMBlacklist does not work for minicluster | Major | resourcemanager | Jun Gong | Jun Gong
HDFS-9215 | Suppress the RAT warnings in hdfs-native-client module | Minor | . | Haohui Mai | Haohui Mai
HDFS-9224 | TestFileTruncate fails intermittently with BindException | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4017 | container-executor overuses PATH_MAX | Major | nodemanager | Allen Wittenauer | Sidharta Seethana
HDFS-8676 | Delayed rolling upgrade finalization can cause heartbeat expiration and write failures | Critical | . | Kihwal Lee | Walter Su
HADOOP-12474 | MiniKMS should use random ports for Jetty server by default | Major | . | Mingliang Liu | Mingliang Liu
HADOOP-12449 | TestDNS and TestNetUtils failing if no network | Minor | test | Steve Loughran | Steve Loughran
HADOOP-11515 | Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7 | Major | build | Johannes Zillmann | Tsuyoshi Ozawa
HDFS-9235 | hdfs-native-client build getting errors when built with cmake 2.6 | Minor | hdfs-client | Eric Payne | Eric Payne
HDFS-8779 | WebUI fails to display block IDs that are larger than 2^53 - 1 | Minor | webhdfs | Walter Su | Haohui Mai
HDFS-9187 | Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem | Major | tracing | stack | Colin P. McCabe
HDFS-1172 | Blocks in newly completed files are considered under-replicated too quickly | Major | namenode | Todd Lipcon | Masatake Iwasaki
YARN-4250 | NPE in AppSchedulingInfo#isRequestLabelChanged | Major | resourcemanager, scheduler | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12478 | Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath() | Critical | util | Steve Loughran | Steve Loughran
HDFS-9220 | Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum | Blocker | . | Bogdan Raducanu | Jing Zhao
HADOOP-12479 | ProtocMojo does not log the reason for a protoc compilation failure. | Minor | build | Chris Nauroth | Chris Nauroth
HADOOP-11628 | SPNEGO auth does not work with CNAMEs in JDK8 | Blocker | security | Daryn Sharp | Daryn Sharp
YARN-2597 | MiniYARNCluster should propagate reason for AHS not starting | Major | test | Steve Loughran | Steve Loughran
YARN-4155 | TestLogAggregationService.testLogAggregationServiceWithInterval failing | Critical | test | Steve Loughran | Bibin A Chundatt
HADOOP-10941 | Proxy user verification NPEs if remote host is unresolvable | Critical | ipc, security | Daryn Sharp | Benoy Antony
HADOOP-12483 | Maintain wrapped SASL ordering for postponed IPC responses | Critical | ipc | Daryn Sharp | Daryn Sharp
HDFS-9237 | NPE at TestDataNodeVolumeFailureToleration#tearDown | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12464 | Interrupted client may try to fail-over and retry | Major | ipc | Kihwal Lee | Kihwal Lee
YARN-4270 | Limit application resource reservation on nodes for non-node/rack specific requests | Major | fairscheduler | Arun Suresh | Arun Suresh
HDFS-9208 | Disabling atime may fail clients like distCp | Major | . | Kihwal Lee | Kihwal Lee
HDFS-9270 | TestShortCircuitLocalRead should not leave socket after unit test | Minor | test | Masatake Iwasaki | Masatake Iwasaki
HADOOP-12418 | TestRPC.testRPCInterruptedSimple fails intermittently | Major | test | Steve Loughran | Kihwal Lee
MAPREDUCE-6495 | Docs for archive-logs tool | Major | documentation | Robert Kanter | Robert Kanter
HDFS-3059 | ssl-server.xml causes NullPointer | Minor | datanode, security | Evert Lammerts | Xiao Chen
HDFS-9274 | Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent | Trivial | datanode | Yi Liu | Yi Liu
MAPREDUCE-6518 | Set SO_KEEPALIVE on shuffle connections | Major | mrv2, nodemanager | Nathan Roberts | Chang Li
HDFS-9225 | Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack | Minor | test | Masatake Iwasaki | Masatake Iwasaki
HDFS-9273 | ACLs on root directory may be lost after NN restart | Critical | namenode | Xiao Chen | Xiao Chen
YARN-4000 | RM crashes with NPE if leaf queue becomes parent queue during restart | Major | capacityscheduler, resourcemanager | Jason Lowe | Varun Saxena
HADOOP-9692 | Improving log message when SequenceFile reader throws EOFException on zero-length file | Major | . | Chu Tong | Zhe Zhang
YARN-4256 | YARN fair scheduler vcores with decimal values | Minor | fairscheduler | Prabhu Joseph | Jun Gong
HADOOP-12484 | Single File Rename Throws Incorrectly In Potential Race Condition Scenarios | Major | tools | Gaurav Kanade | Gaurav Kanade
HDFS-9286 | HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIES | Major | fs | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4009 | CORS support for ResourceManager REST API | Major | . | Prakash Ramachandran | Varun Vasudev
YARN-4041 | Slow delegation token renewal can severely prolong RM recovery | Major | resourcemanager | Jason Lowe | Sunil Govindan
HDFS-9290 | DFSClient#callAppend() is not backward compatible for slightly older NameNodes | Blocker | . | Tony Wu | Tony Wu
HDFS-9301 | HDFS clients can’t construct HdfsConfiguration instances | Major | . | Steve Loughran | Mingliang Liu
YARN-4294 | [JDK8] Fix javadoc errors caused by wrong reference and illegal tag | Blocker | build, documentation | Akira Ajisaka | Akira Ajisaka
YARN-4289 | TestDistributedShell failing with bind exception | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4296 | DistributedShell Log.info is not friendly | Major | applications/distributed-shell | Xiaowei Wang | Xiaowei Wang
YARN-4246 | NPE while listing app attempt | Major | . | Varun Saxena | nijel
YARN-4223 | Findbugs warnings in hadoop-yarn-server-nodemanager project | Minor | nodemanager | Varun Saxena | Varun Saxena
HADOOP-12513 | Dockerfile lacks initial ‘apt-get update’ | Trivial | build | Akihiro Suda | Akihiro Suda
YARN-4284 | condition for AM blacklisting is too narrow | Major | resourcemanager | Sangjin Lee | Sangjin Lee
HDFS-9268 | fuse_dfs chown crashes when uid is passed as -1 | Minor | . | Wei-Chiu Chuang | Colin P. McCabe
HDFS-9284 | fsck command should not print exception trace when file not found | Major | . | Jagadesh Kiran N | Jagadesh Kiran N
HDFS-9305 | Delayed heartbeat processing causes storm of subsequent heartbeats | Major | datanode | Chris Nauroth | Arpit Agarwal
YARN-4169 | Fix racing condition of TestNodeStatusUpdaterForLabels | Critical | test | Steve Loughran | Naganarasimha G R
YARN-4300 | [JDK8] Fix javadoc errors caused by wrong tags | Blocker | build, documentation | Akira Ajisaka | Akira Ajisaka
YARN-4302 | SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReport | Major | . | Bibin A Chundatt | Bibin A Chundatt
HADOOP-12178 | NPE during handling of SASL setup if problem with SASL resolver class | Minor | ipc | Steve Loughran | Steve Loughran
HADOOP-11685 | StorageException complaining " no lease ID" during HBase distributed log splitting | Major | tools | Duo Xu | Duo Xu
HDFS-9231 | fsck doesn’t list correct file path when Bad Replicas/Blocks are in a snapshot | Major | snapshots | Xiao Chen | Xiao Chen
HDFS-9302 | WebHDFS truncate throws NullPointerException if newLength is not provided | Minor | webhdfs | Karthik Palaniappan | Jagadesh Kiran N
YARN-4251 | TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12519 | hadoop-azure tests should avoid creating a metrics configuration file in the module root directory. | Minor | fs/azure, test | Chris Nauroth | Chris Nauroth
HDFS-9279 | Decomissioned capacity should not be considered for configured/used capacity | Major | . | Kuhu Shukla | Kuhu Shukla
HDFS-9044 | Give Priority to FavouredNodes , before selecting nodes from FavouredNode’s Node Group | Major | . | J.Andreina | J.Andreina
YARN-4130 | Duplicate declaration of ApplicationId in RMAppManager#submitApplication method | Trivial | resourcemanager | Kai Sasaki | Kai Sasaki
YARN-4288 | NodeManager restart should keep retrying to register to RM while connection exception happens during RM failed over. | Critical | nodemanager | Junping Du | Junping Du
MAPREDUCE-6515 | Update Application priority in AM side from AM-RM heartbeat | Major | applicationmaster | Sunil Govindan | Sunil Govindan
HDFS-9332 | Fix Precondition failures from NameNodeEditLogRoller while saving namespace | Major | . | Andrew Wang | Andrew Wang
YARN-4313 | Race condition in MiniMRYarnCluster when getting history server address | Major | . | Jian He | Jian He
YARN-4312 | TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out | Major | . | Varun Saxena | Varun Saxena
YARN-4320 | TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188 | Major | . | Varun Saxena | Varun Saxena
MAPREDUCE-6528 | Memory leak for HistoryFileManager.getJobSummary() | Critical | jobhistoryserver | Junping Du | Junping Du
MAPREDUCE-6451 | DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic | Major | distcp | Kuhu Shukla | Kuhu Shukla
HADOOP-12533 | Introduce FileNotFoundException in WASB for read and seek API | Major | tools | Dushyanth | Dushyanth
HADOOP-12508 | delete fails with exception when lease is held on blob | Blocker | fs/azure | Gaurav Kanade | Gaurav Kanade
HDFS-9329 | TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size | Minor | test | Zhe Zhang | Zhe Zhang
HDFS-9313 | Possible NullPointerException in BlockManager if no excess replica can be chosen | Major | . | Ming Ma | Ming Ma
HADOOP-12542 | TestDNS fails on Windows after HADOOP-12437. | Major | net | Chris Nauroth | Chris Nauroth
YARN-4326 | Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188 | Major | . | MENG DING | MENG DING
HDFS-9289 | Make DataStreamer#block thread safe and verify genStamp in commitBlock | Critical | . | Chang Li | Chang Li
YARN-4127 | RM fail with noAuth error if switched from failover mode to non-failover mode | Major | resourcemanager | Jian He | Varun Saxena
HDFS-9351 | checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs() | Major | namenode | Yongjun Zhang | Xiao Chen
HADOOP-12296 | when setnetgrent returns 0 in linux, exception should be thrown | Major | . | Chang Li | Chang Li
HDFS-9357 | NN UI renders icons of decommissioned DN incorrectly | Critical | . | Archana T | Surendra Singh Lilhore
HADOOP-12540 | TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. | Major | fs/azure, test | Chris Nauroth | Gaurav Kanade
HDFS-9360 | Storage type usage isn’t updated properly after file deletion | Major | . | Ming Ma | Ming Ma
HDFS-9378 | hadoop-hdfs-client tests do not write logs. | Minor | test | Chris Nauroth | Chris Nauroth
HDFS-4937 | ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom() | Major | namenode | Kihwal Lee | Kihwal Lee
HDFS-9372 | Remove dead code in DataStorage.recoverTransitionRead | Major | datanode | Duo Zhang | Duo Zhang
HDFS-9384 | TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. | Minor | test | Chris Nauroth | Chris Nauroth
HDFS-6481 | DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs | Minor | namenode | Ted Yu | Tsz Wo Nicholas Sze
HDFS-9318 | considerLoad factor can be improved | Major | . | Kuhu Shukla | Kuhu Shukla
HDFS-9236 | Missing sanity check for block size during block recovery | Major | datanode | Tony Wu | Tony Wu
HDFS-9394 | branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. | Critical | hdfs-client | Chris Nauroth | Mingliang Liu
HADOOP-12526 | [Branch-2] there are duplicate dependency definitions in pom’s | Major | build | Sangjin Lee | Sangjin Lee
MAPREDUCE-5763 | Warn message about httpshuffle in NM logs | Major | . | Sandy Ryza | Akira Ajisaka
HDFS-9383 | TestByteArrayManager#testByteArrayManager fails | Major | . | Kihwal Lee | Tsz Wo Nicholas Sze
HDFS-9249 | NPE is thrown if an IOException is thrown in NameNode constructor | Minor | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-2261 | AOP unit tests are not getting compiled or run | Minor | test | Giridharan Kesavan | Haohui Mai
HDFS-9401 | Fix findbugs warnings in BlockRecoveryWorker | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12482 | Race condition in JMX cache update | Major | . | Tony Wu | Tony Wu
HDFS-9364 | Unnecessary DNS resolution attempts when creating NameNodeProxies | Major | ha, performance | Xiao Chen | Xiao Chen
HADOOP-12560 | Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 | Major | native | Colin P. McCabe | Mingliang Liu
HDFS-9245 | Fix findbugs warnings in hdfs-nfs/WriteCtx | Major | nfs | Mingliang Liu | Mingliang Liu
YARN-4241 | Fix typo of property name in yarn-default.xml | Major | documentation | Anthony Rojas | Anthony Rojas
MAPREDUCE-6533 | testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken | Major | . | Chang Li | Chang Li
HDFS-9396 | Total files and directories on jmx and web UI on standby is uninitialized | Blocker | . | Kihwal Lee | Kihwal Lee
MAPREDUCE-6540 | TestMRTimelineEventHandling fails | Major | test | Sangjin Lee | Sangjin Lee
YARN-4347 | Resource manager fails with Null pointer exception | Major | yarn | Yesha Vora | Jian He
HADOOP-12545 | Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp | Major | documentation | Mohammad Arshad | Mohammad Arshad
YARN-4354 | Public resource localization fails with NPE | Blocker | nodemanager | Jason Lowe | Jason Lowe
HDFS-9413 | getContentSummary() on standby should throw StandbyException | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-9358 | TestNodeCount#testNodeCount timed out | Major | test | Wei-Chiu Chuang | Masatake Iwasaki
HDFS-9397 | Fix typo for readChecksum() LOG.warn in BlockSender.java | Trivial | . | Enrique Flores | Enrique Flores
HDFS-9400 | TestRollingUpgradeRollback fails on branch-2. | Blocker | . | Chris Nauroth | Brahma Reddy Battula
YARN-4367 | SLS webapp doesn’t load | Major | scheduler-load-simulator | Karthik Kambatla | Karthik Kambatla
HDFS-9431 | DistributedFileSystem#concat fails if the target path is relative. | Major | hdfs-client | Kazuho Fujii | Kazuho Fujii
YARN-2859 | ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster | Critical | timelineserver | Hitesh Shah | Vinod Kumar Vavilapalli
YARN-4374 | RM capacity scheduler UI rounds user limit factor | Major | capacityscheduler | Chang Li | Chang Li
YARN-3769 | Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler | Major | capacityscheduler | Eric Payne | Eric Payne
HDFS-9443 | Disabling HDFS client socket cache causes logging message printed to console for CLI commands. | Trivial | hdfs-client | Chris Nauroth | Chris Nauroth
HADOOP-11218 | Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory | Critical | kms | Robert Kanter | Vijay Singh
HADOOP-12467 | Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts | Minor | scripts | Radhey Shah | Radhey Shah
HADOOP-12181 | Fix intermittent test failure of TestZKSignerSecretProvider | Minor | . | Masatake Iwasaki | Masatake Iwasaki
HDFS-6885 | Fix wrong use of BytesWritable in FSEditLogOp#RenameOp | Minor | namenode | Yi Liu | Yi Liu
HADOOP-12098 | Remove redundant test dependencies in Hadoop Archives | Minor | . | Varun Saxena | Varun Saxena
HDFS-7897 | Shutdown metrics when stopping JournalNode | Major | . | zhouyingchao | zhouyingchao
HADOOP-11149 | Increase the timeout of TestZKFailoverController | Major | test | Rajat Jain | Steve Loughran
HADOOP-11677 | Add cookie flags for logs and static contexts | Major | . | nijel | nijel
HDFS-9356 | Decommissioning node does not have Last Contact value in the UI | Major | . | Archana T | Surendra Singh Lilhore
HADOOP-12313 | NPE in JvmPauseMonitor when calling stop() before start() | Critical | . | Rohith Sharma K S | Gabor Liptak
HDFS-9428 | Fix intermittent failure of TestDNFencing.testQueueingWithAppend | Minor | test | Masatake Iwasaki | Masatake Iwasaki
HDFS-9435 | TestBlockRecovery#testRBWReplicas is failing intermittently | Major | . | Rakesh R | Rakesh R
HADOOP-12577 | Bump up commons-collections version to 3.2.2 to address a security flaw | Blocker | build, security | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4344 | NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations | Critical | resourcemanager | Varun Vasudev | Varun Vasudev
HADOOP-9822 | create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor | Minor | . | Tsuyoshi Ozawa | Tsuyoshi Ozawa
YARN-4298 | Fix findbugs warnings in hadoop-yarn-common | Minor | . | Varun Saxena | Sunil Govindan
YARN-4387 | Fix typo in FairScheduler log message | Minor | fairscheduler | Xin Wang | Xin Wang
HDFS-6101 | TestReplaceDatanodeOnFailure fails occasionally | Major | test | Arpit Agarwal | Wei-Chiu Chuang
HDFS-8855 | Webhdfs client leaks active NameNode connections | Major | webhdfs | Bob Hansen | Xiaobing Zhou
HDFS-8335 | FSNamesystem should construct FSPermissionChecker only if permission is enabled | Major | . | David Bryson | Gabor Liptak
MAPREDUCE-5883 | “Total megabyte-seconds” in job counters is slightly misleading | Minor | . | Nathan Roberts | Nathan Roberts
YARN-4365 | FileSystemNodeLabelStore should check for root dir existence on startup | Major | resourcemanager | Jason Lowe | Kuhu Shukla
HDFS-8807 | dfs.datanode.data.dir does not handle spaces between storageType and URI correctly | Major | datanode | Anu Engineer | Anu Engineer
HADOOP-12415 | hdfs and nfs builds broken on -missing compile-time dependency on netty | Major | nfs | Konstantin Boudnik | Tom Zeng
MAPREDUCE-6553 | Replace ‘\u2b05’ with ‘<-’ in rendering job configuration | Minor | jobhistoryserver | Akira Ajisaka | Gabor Liptak
HADOOP-12598 | add XML namespace declarations for some hadoop/tools modules | Minor | build, tools | Xin Wang | Xin Wang
YARN-4380 | TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently | Major | test | Tsuyoshi Ozawa | Varun Saxena
MAPREDUCE-6557 | Some tests in mapreduce-client-app are writing outside of target | Blocker | build | Allen Wittenauer | Akira Ajisaka
HDFS-9459 | hadoop-hdfs-native-client fails test build on Windows after transition to ctest. | Blocker | build, test | Chris Nauroth | Chris Nauroth
HDFS-9407 | TestFileTruncate fails with BindException | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-9467 | Fix data race accessing writeLockHeldTimeStamp in FSNamesystem | Major | namenode | Mingliang Liu | Mingliang Liu
MAPREDUCE-6549 | multibyte delimiters with LineRecordReader cause duplicate records | Major | mrv1, mrv2 | Dustin Cote | Wilfred Spiegelenburg
MAPREDUCE-6550 | archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor | Major | . | Robert Kanter | Robert Kanter
HADOOP-12468 | Partial group resolution failure should not result in user lockout | Minor | security | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9426 | Rollingupgrade finalization is not backward compatible | Blocker | . | Kihwal Lee | Kihwal Lee
HADOOP-10406 | TestIPC.testIpcWithReaderQueuing may fail | Major | ipc | Tsz Wo Nicholas Sze | Xiao Chen
HDFS-9470 | Encryption zone on root not loaded from fsimage after NN restart | Critical | . | Xiao Chen | Xiao Chen
HDFS-9336 | deleteSnapshot throws NPE when snapshotname is null | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12609 | Fix intermittent failure of TestDecayRpcScheduler | Minor | ipc, test | Masatake Iwasaki | Masatake Iwasaki
HDFS-6533 | TestBPOfferService#testBasicFunctionalitytest fails intermittently | Major | datanode, hdfs-client | Yongjun Zhang | Wei-Chiu Chuang
YARN-4398 | Yarn recover functionality causes the cluster running slowly and the cluster usage rate is far below 100 | Major | resourcemanager | NING DING | NING DING
HDFS-9294 | DFSClient deadlock when close file and failed to renew lease | Blocker | hdfs-client | DENG FEI | Brahma Reddy Battula
HADOOP-12565 | Replace DSA with RSA for SSH key type in SingleCluster.md | Minor | documentation | Alexander Veit | Mingliang Liu
YARN-4408 | NodeManager still reports negative running containers | Major | nodemanager | Robert Kanter | Robert Kanter
HDFS-9430 | Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started. | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4392 | ApplicationCreatedEvent event time resets after RM restart/failover | Critical | . | Xuan Gong | Naganarasimha G R
YARN-4422 | Generic AHS sometimes doesn’t show started, node, or logs on App page | Major | . | Eric Payne | Eric Payne
YARN-4424 | Fix deadlock in RMAppImpl | Blocker | . | Yesha Vora | Jian He
HADOOP-12617 | SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal | Major | security | Matt Foley | Matt Foley
YARN-4431 | Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM | Major | nodemanager | Junping Du | Junping Du
YARN-4421 | Remove dead code in RmAppImpl.RMAppRecoveredTransition | Trivial | resourcemanager | Daniel Templeton | Daniel Templeton
HADOOP-12618 | NPE in TestSequenceFile | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4434 | NodeManager Disk Checker parameter documentation is not correct | Minor | documentation, nodemanager | Takashi Ohnishi | Weiwei Yang
HADOOP-12602 | TestMetricsSystemImpl#testQSize occasionally fail | Major | test | Wei-Chiu Chuang | Masatake Iwasaki
HDFS-9519 | Some coding improvement in SecondaryNameNode#main | Major | namenode | Yongjun Zhang | Xiao Chen
HDFS-9514 | TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed | Major | hdfs-client, test | Steve Loughran | Wei-Chiu Chuang
HDFS-9535 | Newly completed blocks in IBR should not be considered under-replicated too quickly | Major | namenode | Jing Zhao | Mingliang Liu
YARN-4418 | AM Resource Limit per partition can be updated to ResourceUsage as well | Major | resourcemanager | Sunil Govindan | Sunil Govindan
YARN-4403 | (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period | Critical | . | Junping Du | Junping Du
YARN-4402 | TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4439 | Clarify NMContainerStatus#toString method. | Major | . | Jian He | Jian He
YARN-4440 | FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time | Major | fairscheduler | Yiqun Lin | Yiqun Lin
HDFS-9516 | truncate file fails with data dirs on multiple disks | Major | datanode | Bogdan Raducanu | Plamen Jeliazkov
HDFS-8894 | Set SO_KEEPALIVE on DN server sockets | Major | datanode | Nathan Roberts | Kanaka Kumar Avvaru
YARN-4461 | Redundant nodeLocalityDelay log in LeafQueue | Trivial | capacityscheduler | Jason Lowe | Eric Payne
YARN-4452 | NPE when submit Unmanaged application | Critical | . | Naganarasimha G R | Naganarasimha G R
HDFS-9565 | TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition | Minor | fs, test | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4225 | Add preemption status to yarn queue -status for capacity scheduler | Minor | capacity scheduler, yarn | Eric Payne | Eric Payne
HDFS-9515 | NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference | Minor | . | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9572 | Prevent DataNode log spam if a client connects on the data transfer port but sends no data. | Major | datanode | Chris Nauroth | Chris Nauroth
HDFS-9533 | seen_txid in the shared edits directory is modified during bootstrapping | Major | ha, namenode | Kihwal Lee | Kihwal Lee
HDFS-9571 | Fix ASF Licence warnings in Jenkins reports | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-9393 | After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy | Major | . | J.Andreina | J.Andreina
HDFS-9347 | Invariant assumption in TestQuorumJournalManager.shutdown() is wrong | Major | test | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12656 | MiniKdc throws “address in use” BindException | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12636 | Prevent ServiceLoader failure init for unused FileSystems | Major | fs | Íñigo Goiri | Íñigo Goiri
MAPREDUCE-6583 | Clarify confusing sentence in MapReduce tutorial document | Minor | documentation | chris snow | Kai Sasaki
HDFS-9505 | HDFS Architecture documentation needs to be refreshed. | Major | documentation | Chris Nauroth | Masatake Iwasaki
YARN-4454 | NM to nodelabel mapping going wrong after RM restart | Critical | . | Bibin A Chundatt | Bibin A Chundatt
HDFS-9580 | TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. | Major | datanode, namenode, test | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4477 | FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. | Major | fairscheduler | Tao Jie | Tao Jie
HDFS-9589 | Block files which have been hardlinked should be duplicated before the DataNode appends to the them | Major | datanode | Colin P. McCabe | Colin P. McCabe
HDFS-9458 | TestBackupNode always binds to port 50070, which can cause bind failures. | Major | test | Chris Nauroth | Xiao Chen
HDFS-9034 | “StorageTypeStats” Metric should not count failed storage. | Major | namenode | Archana T | Surendra Singh Lilhore
YARN-4109 | Exception on RM scheduler page loading with labels | Minor | . | Bibin A Chundatt | Mohammad Shahid Khan
MAPREDUCE-6419 | JobHistoryServer doesn’t sort properly based on Job ID when Job id’s exceed 9999 | Major | webapps | Devaraj K | Mohammad Shahid Khan
HDFS-9597 | BaseReplicationPolicyTest should update data node stats after adding a data node | Minor | datanode, test | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12681 | start-build-env.sh fails in branch-2 | Blocker | build | Akira Ajisaka | Kengo Seki
HDFS-7163 | WebHdfsFileSystem should retry reads according to the configured retry policy. | Major | webhdfs | Eric Payne | Eric Payne
HADOOP-12559 | KMS connection failures should trigger TGT renewal | Major | security | Zhe Zhang | Zhe Zhang
MAPREDUCE-6574 | MR AM should print host of failed tasks. | Major | . | Wangda Tan | Mohammad Shahid Khan
MAPREDUCE-6589 | TestTaskLog outputs a log under directory other than target/test-dir | Major | test | Akira Ajisaka | Akira Ajisaka
YARN-4315 | NaN in Queue percentage for cluster apps page | Minor | . | Bibin A Chundatt | Bibin A Chundatt
YARN-1382 | Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak | Major | resourcemanager | Alejandro Abdelnur | Rohith Sharma K S
HADOOP-12682 | Fix TestKMS#testKMSRestart* failure | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12608 | Fix exception message in WASB when connecting with anonymous credential | Major | tools | Dushyanth | Dushyanth
YARN-4524 | Cleanup AppSchedulingInfo | Major | scheduler | Karthik Kambatla | Karthik Kambatla
YARN-4510 | Fix SLS startup failure caused by NPE | Critical | . | Bibin A Chundatt | Bibin A Chundatt
MAPREDUCE-6593 | TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE | Major | . | Tsuyoshi Ozawa | Naganarasimha G R
HDFS-9445 | Datanode may deadlock while handling a bad volume | Blocker | . | Kihwal Lee | Walter Su
HADOOP-12658 | Clear javadoc and check style issues around DomainSocket | Trivial | . | Kai Zheng | Kai Zheng
HADOOP-12604 | Exception may be swallowed in KMSClientProvider | Major | kms | Yongjun Zhang | Yongjun Zhang
HDFS-9605 | Add links to failed volumes to explorer.html in HDFS Web UI | Minor | . | Archana T | Archana T
MAPREDUCE-6577 | MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set | Critical | mr-am | Sangjin Lee | Sangjin Lee
HADOOP-12689 | S3 filesystem operations stopped working correctly | Major | tools | Matthew Paduano | Matthew Paduano
YARN-4546 | ResourceManager crash due to scheduling opportunity overflow | Critical | resourcemanager | Jason Lowe | Jason Lowe
HADOOP-12634 | Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy | Critical | . | Gaurav Kanade | Gaurav Kanade
HDFS-9600 | do not check replication if the block is under construction | Critical | . | Phil Yang | Phil Yang
HDFS-9619 | SimulatedFSDataset sometimes can not find blockpool for the correct namenode | Major | datanode, test | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12675 | Fix description about retention period in usage of expunge command | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-12613 | TestFind.processArguments occasionally fails | Major | test | Wei-Chiu Chuang | Wei-Chiu Chuang
MAPREDUCE-6508 | TestNetworkedJob fails consistently due to delegation token changes on RM. | Major | test | Rohith Sharma K S | Akira Ajisaka
HDFS-9574 | Reduce client failures during datanode restart | Major | . | Kihwal Lee | Kihwal Lee
HDFS-9493 | Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk | Major | test | Mingliang Liu | Tony Wu
HADOOP-12678 | Handle empty rename pending metadata file during atomic rename in redo path | Critical | fs/azure | madhumita chakraborty | madhumita chakraborty
HADOOP-12590 | TestCompressorDecompressor failing without stack traces | Critical | test | Steve Loughran | John Zhuge
HADOOP-12587 | Hadoop AuthToken refuses to work without a maxinactive attribute in issued token | Blocker | security | Steve Loughran | Benoy Antony
HADOOP-12551 | Introduce FileNotFoundException for WASB FileSystem API | Major | tools | Dushyanth | Dushyanth
MAPREDUCE-6068 | Illegal progress value warnings in map tasks | Major | mrv2, task | Todd Lipcon | Binglin Chang
HDFS-9639 | Inconsistent Logging in BootstrapStandby | Minor | ha | BELUGA BEHR | Xiaobing Zhou
HDFS-9584 | NPE in distcp when ssl configuration file does not exist in class path. | Major | distcp | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-12584 | Disable browsing the static directory in HttpServer2 | Major | security | Robert Kanter | Robert Kanter
YARN-4567 | javadoc failing on java 8 | Blocker | build | Steve Loughran | Steve Loughran
YARN-4414 | Nodemanager connection errors are retried at multiple levels | Major | nodemanager | Jason Lowe | Chang Li
HADOOP-12603 | TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail | Major | test | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4534 | Remove the redundant symbol in yarn rmadmin help msg | Trivial | . | Yiqun Lin | Yiqun Lin
HADOOP-12700 | Remove unused import in TestCompressorDecompressor.java | Minor | . | John Zhuge | John Zhuge
MAPREDUCE-6601 | Fix typo in Job#setUseNewAPI | Trivial | . | Kai Sasaki | Kai Sasaki
YARN-3446 | FairScheduler headroom calculation should exclude nodes in the blacklist | Major | fairscheduler | zhihai xu | zhihai xu
HDFS-9648 | TestStartup.testImageChecksum is broken by HDFS-9569’s message change | Trivial | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12706 | TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally | Major | test | Jason Lowe | Sangjin Lee
YARN-4581 | AHS writer thread leak makes RM crash while RM is recovering | Major | resourcemanager | sandflee | sandflee
MAPREDUCE-6554 | MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory | Critical | . | Bibin A Chundatt | Bibin A Chundatt
YARN-4389 | “yarn.am.blacklisting.enabled” and “yarn.am.blacklisting.disable-failure-threshold” should be app specific rather than a setting for whole YARN cluster | Critical | applications | Junping Du | Sunil Govindan
HDFS-9612 | DistCp worker threads are not terminated after jobs are done. | Major | distcp | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-12712 | Fix some cmake plugin and native build warnings | Minor | native | Colin P. McCabe | Colin P. McCabe
YARN-4538 | QueueMetrics pending cores and memory metrics wrong | Major | . | Bibin A Chundatt | Bibin A Chundatt
YARN-4596 | SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities | Major | timelineserver | Li Lu | Li Lu
YARN-4502 | Fix two AM containers get allocated when AM restart | Critical | . | Yesha Vora | Vinod Kumar Vavilapalli
HDFS-9623 | Update example configuration of block state change log in log4j.properties | Minor | logging | Masatake Iwasaki | Masatake Iwasaki
YARN-4565 | When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only | Major | capacity scheduler, capacityscheduler | Karam Singh | Wangda Tan
HADOOP-12356 | Fix computing CPU usage statistics on Windows | Major | util | Yunqi Zhang | Íñigo Goiri
HDFS-9661 | Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw | Major | datanode | ade | ade
HDFS-9655 | NN should start JVM pause monitor before loading fsimage | Critical | . | John Zhuge | John Zhuge
YARN-4559 | Make leader elector and zk store share the same curator client | Major | . | Jian He | Jian He
HADOOP-12605 | Fix intermittent failure of TestIPC.testIpcWithReaderQueuing | Minor | test | Masatake Iwasaki | Masatake Iwasaki
HDFS-9625 | set replication for empty file failed when set storage policy | Major | namenode | DENG FEI | DENG FEI
HADOOP-12423 | Handle failure of registering shutdownhook by ShutdownHookManager in static block | Minor | fs | Abhishek Agarwal | Abhishek Agarwal
HDFS-9634 | webhdfs client side exceptions don’t provide enough details | Major | webhdfs | Eric Payne | Eric Payne
YARN-4608 | Redundant code statement in WritingYarnApplications | Minor | documentation | Kai Sasaki | Kai Sasaki
HADOOP-7161 | Remove unnecessary oro package from dependency management section | Minor | build | Todd Lipcon | Sean Busbey
YARN-4610 | Reservations continue looking for one app causes other apps to starve | Blocker | capacityscheduler | Jason Lowe | Jason Lowe
HADOOP-12659 | Incorrect usage of config parameters in token manager of KMS | Major | security | Tianyin Xu | Mingliang Liu
MAPREDUCE-6605 | Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml | Major | documentation | Dong Zhen | Kai Sasaki
YARN-4605 | Spelling mistake in the help message of “yarn applicationattempt” command | Trivial | client | Manjunath Ballur | Weiwei Yang
HDFS-9682 | Fix a typo “aplication” in HttpFS document | Trivial | documentation | Weiwei Yang | Weiwei Yang
HADOOP-12730 | Hadoop streaming -mapper and -reducer options are wrongly documented as required | Major | documentation | DeepakVohra | Kengo Seki
HDFS-8898 | Create API and command-line argument to get quota and quota usage without detailed content summary | Major | fs | Joep Rottinghuis | Ming Ma
YARN-4598 | Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL | Major | nodemanager | tangshangwen | tangshangwen
YARN-4592 | Remove unused GetContainerStatus proto | Minor | . | Chang Li | Chang Li
YARN-4520 | FinishAppEvent is leaked in leveldb if no app’s container running on this node | Major | nodemanager | sandflee | sandflee
MAPREDUCE-6610 | JobHistoryEventHandler should not swallow timeline response | Trivial | . | Li Lu | Li Lu
HDFS-9690 | ClientProtocol.addBlock is not idempotent after HDFS-8071 | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HADOOP-12743 | Fix git environment check during test-patch | Major | . | Ray Chiang | Allen Wittenauer
HADOOP-12735 | core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid | Minor | . | Ray Chiang | Ray Chiang
MAPREDUCE-6619 | HADOOP_CLASSPATH is overwritten in MR container | Major | mrv2 | shanyu zhao | Junping Du
HDFS-8999 | Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. | Major | namenode | Jitendra Nath Pandey | Tsz Wo Nicholas Sze
MAPREDUCE-6595 | Fix findbugs warnings in OutputCommitter and FileOutputCommitter | Major | . | Akira Ajisaka | Akira Ajisaka
MAPREDUCE-6563 | Streaming documentation contains a stray ‘%’ character. | Trivial | documentation | Chris Nauroth | Chris Nauroth
YARN-4519 | potential deadlock of CapacityScheduler between decrease container and assign containers | Major | capacityscheduler | sandflee | MENG DING
MAPREDUCE-6616 | Fail to create jobhistory file if there are some multibyte characters in the job name | Major | jobhistoryserver | Akira Ajisaka | Kousuke Saruta
YARN-4411 | RMAppAttemptImpl#createApplicationAttemptReport throws IllegalArgumentException | Major | resourcemanager | yarntime | Bibin A Chundatt
YARN-4617 | LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy | Major | capacity scheduler | Rohith Sharma K S | Rohith Sharma K S
YARN-4428 | Redirect RM page to AHS page when AHS turned on and RM page is not available | Major | . | Chang Li | Chang Li
MAPREDUCE-6618 | YarnClientProtocolProvider leaking the YarnClient thread. | Major | . | Xuan Gong | Xuan Gong
HDFS-9210 | Fix some misuse of %n in VolumeScanner#printStats | Minor | datanode | Xiaoyu Yao | Xiaoyu Yao
HDFS-9701 | DN may deadlock when hot-swapping under load | Major | . | Xiao Chen | Xiao Chen
YARN-3102 | Decommisioned Nodes not listed in Web UI | Minor | resourcemanager | Bibin A Chundatt | Kuhu Shukla
HDFS-9406 | FSImage may get corrupted after deleting snapshot | Major | namenode | Stanislav Antic | Yongjun Zhang
HDFS-9718 | HAUtil#getConfForOtherNodes should unset independent generic keys before initialize | Major | namenode | DENG FEI | DENG FEI
HDFS-9708 | FSNamesystem.initAuditLoggers() doesn’t trim classnames | Minor | fs | Steve Loughran | Mingliang Liu
MAPREDUCE-6621 | Memory Leak in JobClient#submitJobInternal() | Major | . | Xuan Gong | Xuan Gong
HADOOP-12755 | Fix typo in defaultFS warning message | Trivial | . | Andrew Wang | Andrew Wang
HDFS-9739 | DatanodeStorage.isValidStorageId() is broken | Critical | hdfs-client | Kihwal Lee | Mingliang Liu
HDFS-9740 | Use a reasonable limit in DFSTestUtil.waitForMetric() | Major | test | Kihwal Lee | Chang Li
HADOOP-12761 | incremental maven build is not really incremental | Minor | build | Sangjin Lee | Sangjin Lee
HDFS-9748 | When addExpectedReplicasToPending is called twice, pendingReplications should avoid duplication | Minor | . | Walter Su | Walter Su
HDFS-9730 | Storage ID update does not happen when there is a layout change | Major | datanode | Kihwal Lee | Tsz Wo Nicholas Sze
HDFS-9724 | Degraded performance in WebHDFS listing as it does not reuse ObjectMapper | Critical | performance | Akira Ajisaka | Akira Ajisaka
HADOOP-12766 | The default value of “hadoop.workaround.non.threadsafe.getpwuid” is different between core-default.xml and NativeIO.java | Minor | . | Akira Ajisaka | Akira Ajisaka
HDFS-9761 | Rebalancer sleeps too long between iterations | Blocker | balancer & mover | Adrian Bridgett | Mingliang Liu
HDFS-9713 | DataXceiver#copyBlock should return if block is pinned | Major | datanode | Uma Maheswara Rao G | Uma Maheswara Rao G
HADOOP-12773 | HBase classes fail to load with client/job classloader enabled | Major | util | Sangjin Lee | Sangjin Lee
HDFS-9777 | Fix typos in DFSAdmin command line and documentation | Trivial | hdfs-client | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9784 | Example usage is not correct in Transparent Encryption document | Major | documentation | Takashi Ohnishi | Takashi Ohnishi
HDFS-9752 | Permanent write failures may happen to slow writers during datanode rolling upgrades | Critical | . | Kihwal Lee | Walter Su
HDFS-9760 | WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler | Major | webhdfs | Ryan Sasson | Ryan Sasson
HDFS-9779 | TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value | Minor | test | Kuhu Shukla | Kuhu Shukla
HADOOP-12792 | TestUserGroupInformation#testGetServerSideGroups fails in chroot | Minor | security, test | Eric Badger | Eric Badger
HDFS-9788 | Incompatible tag renumbering in HeartbeatResponseProto | Blocker | rolling upgrades | Andrew Wang | Andrew Wang
HADOOP-12795 | KMS does not log detailed stack trace for unexpected errors. | Major | kms | Chris Nauroth | Chris Nauroth
HADOOP-12699 | TestKMS#testKMSProvider intermittently fails during ‘test rollover draining’ | Major | . | Xiao Chen | Xiao Chen
HDFS-9790 | HDFS Balancer should exit with a proper message if upgrade is not finalized | Major | . | Xiaobing Zhou | Xiaobing Zhou
HDFS-9801 | ReconfigurableBase should update the cached configuration | Major | datanode | Arpit Agarwal | Arpit Agarwal
HADOOP-12780 | During WASB atomic rename handle crash when one directory has been renamed but not file under it. | Critical | fs/azure | madhumita chakraborty | madhumita chakraborty
HADOOP-12589 | Fix intermittent test failure of TestCopyPreserveFlag | Major | test | Tsuyoshi Ozawa | Masatake Iwasaki
HADOOP-12786 | “hadoop key” command usage is not documented | Major | documentation | Akira Ajisaka | Xiao Chen
HDFS-9765 | TestBlockScanner#testVolumeIteratorWithCaching fails intermittently | Major | test | Mingliang Liu | Akira Ajisaka
HDFS-9456 | BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement | Major | . | Junping Du | Xiaobing Zhou
HADOOP-12810 | FileSystem#listLocatedStatus causes unnecessary RPC calls | Major | fs, fs/s3 | Ryan Blue | Ryan Blue
MAPREDUCE-6341 | Fix typo in mapreduce tutorial | Trivial | . | John Michael Luy | John Michael Luy
HADOOP-12787 | KMS SPNEGO sequence does not work with WEBHDFS | Major | kms, security | Xiaoyu Yao | Xiaoyu Yao
HDFS-9815 | Move o.a.h.fs.Hdfs to hadoop-hdfs-client | Blocker | . | Haohui Mai | Vinayakumar B
HDFS-9799 | Reimplement getCurrentTrashDir to remove incompatibility | Blocker | . | Zhe Zhang | Zhe Zhang
YARN-4654 | Yarn node label CLI should parse “=” correctly when trying to remove all labels on a node | Major | . | Wangda Tan | Naganarasimha G R
HDFS-6832 | Fix the usage of ‘hdfs namenode’ command | Minor | . | Akira Ajisaka | Manjunath Ballur
HDFS-8923 | Add -source flag to balancer usage message | Trivial | balancer & mover, documentation | Chris Trezzo | Chris Trezzo
HDFS-9764 | DistCp doesn’t print value for several arguments including -numListstatusThreads | Minor | distcp | Yongjun Zhang | Wei-Chiu Chuang
MAPREDUCE-6637 | Testcase Failure : TestFileInputFormat.testSplitLocationInfo | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-9839 | Reduce verbosity of processReport logging | Major | namenode | Arpit Agarwal | Arpit Agarwal
HDFS-7452 | skip StandbyException log for getCorruptFiles() | Minor | . | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4707 | Remove the extra char (>) from SecureContainer.md | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4386 | refreshNodesGracefully() should send recommission event to active RMNodes only | Minor | graceful | Kuhu Shukla | Kuhu Shukla
HDFS-9842 | dfs.datanode.balance.bandwidthPerSec should accept friendly size units | Minor | balancer & mover | Yiqun Lin | Yiqun Lin
YARN-4709 | NMWebServices produces incorrect JSON for containers | Critical | . | Varun Saxena | Varun Saxena
MAPREDUCE-6635 | Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException | Critical | . | Sergey Shelukhin | Junping Du
HDFS-9549 | TestCacheDirectives#testExceedsCapacity is flaky | Major | . | Wei-Chiu Chuang | Xiao Chen
YARN-2046 | Out of band heartbeats are sent only on container kill and possibly too early | Major | nodemanager | Jason Lowe | Ming Ma
HDFS-9844 | Correct path creation in getTrashRoot to handle root dir | Blocker | encryption | Zhe Zhang | Zhe Zhang
YARN-4722 | AsyncDispatcher logs redundant event queue sizes | Major | . | Jason Lowe | Jason Lowe
HADOOP-12716 | KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8 | Major | security | Xiaoyu Yao | Xiaoyu Yao
HDFS-9855 | Modify TestAuditLoggerWithCommands to workaround the absence of HDFS-8332 | Major | test | Kuhu Shukla | Kuhu Shukla
YARN-4723 | NodesListManager$UnknownNodeId ClassCastException | Critical | resourcemanager | Jason Lowe | Kuhu Shukla
HADOOP-12849 | TestSymlinkLocalFSFileSystem fails intermittently | Major | test | Mingliang Liu | Mingliang Liu
HADOOP-12831 | LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 | Minor | fs | Steve Loughran | Mingliang Liu
HADOOP-12846 | Credential Provider Recursive Dependencies | Major | . | Larry McCay | Larry McCay
HDFS-9864 | Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12622 | RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy’s retry could be very misleading. | Critical | auto-failover | Junping Du | Junping Du
YARN-4748 | ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport | Major | timelineserver | Li Lu | Li Lu
HADOOP-12851 | S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders | Major | fs/s3 | Larry McCay | Larry McCay
HADOOP-12843 | Fix findbugs warnings in hadoop-common (branch-2) | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-9870 | Remove unused imports from DFSUtil | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-8791 | block ID-based DN storage layout can be very slow for datanode on ext4 | Blocker | datanode | Nathan Roberts | Chris Trezzo
HDFS-9880 | TestDatanodeRegistration fails occasionally | Major | test | Kihwal Lee | Kihwal Lee
HDFS-9881 | DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones | Critical | . | Andrew Wang | Andrew Wang
HDFS-9766 | TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently | Major | test | Mingliang Liu | Xiao Chen
HDFS-9851 | Name node throws NPE when setPermission is called on a path that does not exist | Critical | namenode | David Yan | Brahma Reddy Battula
HDFS-9886 | Configuration properties for hedged read is broken | Blocker | . | Akira Ajisaka | Akira Ajisaka
HADOOP-12870 | Fix typo admininistration in CommandsManual.md | Minor | documentation | Akira Ajisaka | John Zhuge
HDFS-9048 | DistCp documentation is out-of-dated | Major | . | Haohui Mai | Daisuke Kobayashi
HADOOP-12871 | Fix dead link to NativeLibraries.html in CommandsManual.md | Minor | documentation | Akira Ajisaka | Brahma Reddy Battula
HADOOP-12872 | Fix formatting in ServiceLevelAuth.md | Trivial | documentation | Akira Ajisaka | Brahma Reddy Battula
MAPREDUCE-4785 | TestMRApp occasionally fails | Major | mrv2, test | Jason Lowe | Haibo Chen
HADOOP-12717 | NPE when trying to rename a directory in Windows Azure Storage FileSystem | Blocker | . | Robert Yokota | Robert Yokota
YARN-4763 | RMApps Page crashes with NPE | Major | webapp | Bibin A Chundatt | Bibin A Chundatt
YARN-4761 | NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler | Major | fairscheduler | Sangjin Lee | Sangjin Lee
YARN-4744 | Too many signal to container failure in case of LCE | Major | . | Bibin A Chundatt | Sidharta Seethana
YARN-4760 | proxy redirect to history server uses wrong URL | Major | webapp | Jason Lowe | Eric Badger
HDFS-9865 | TestBlockReplacement fails intermittently in trunk | Major | test | Yiqun Lin | Yiqun Lin
HDFS-9812 | Streamer threads leak if failure happens when closing DFSOutputStream | Major | hdfs-client | Yiqun Lin | Yiqun Lin
HADOOP-12688 | Fix deadlinks in Compatibility.md | Major | documentation | Akira Ajisaka | Gabor Liptak
HADOOP-12903 | IPC Server should allow suppressing exception logging by type, not log ‘server too busy’ messages | Major | ipc | Arpit Agarwal | Arpit Agarwal
HDFS-9934 | ReverseXML oiv processor should bail out if the XML file’s layoutVersion doesn’t match oiv’s | Major | tools | Colin P. McCabe | Colin P. McCabe
HDFS-9933 | ReverseXML should be capitalized in oiv usage message | Minor | tools | Colin P. McCabe | Colin P. McCabe
HDFS-9953 | Download File from UI broken after pagination | Blocker | namenode | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-9904 | testCheckpointCancellationDuringUpload occasionally fails | Major | test | Kihwal Lee | Yiqun Lin
MAPREDUCE-6579 | JobStatus#getFailureInfo should not output diagnostic information when the job is running | Blocker | test | Rohith Sharma K S | Akira Ajisaka
MAPREDUCE-6645 | TestWordStats outputs logs under directories other than target/test-dir | Major | test | Akira Ajisaka | Gabor Liptak
HDFS-9874 | Long living DataXceiver threads cause volume shutdown to block. | Critical | datanode | Rushabh S Shah | Rushabh S Shah
HDFS-3677 | dfs.namenode.edits.dir.required missing from hdfs-default.xml | Major | documentation, namenode | Todd Lipcon | Mark Yang
HDFS-7166 | SbNN Web UI shows #Under replicated blocks and #pending deletion blocks | Major | ha | Juan Yu | Wei-Chiu Chuang
YARN-4686 | MiniYARNCluster.start() returns before cluster is completely started | Major | test | Rohith Sharma K S | Eric Badger
MAPREDUCE-6363 | [NNBench] Lease mismatch error when running with multiple mappers | Critical | benchmarks | Brahma Reddy Battula | Bibin A Chundatt
HDFS-10189 | PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE | Minor | datanode | Joe Pallas | Joe Pallas
MAPREDUCE-6580 | Test failure : TestMRJobsWithProfiler | Major | . | Rohith Sharma K S | Eric Badger
MAPREDUCE-6656 | [NNBench] OP_DELETE operation isn’t working after MAPREDUCE-6363 | Blocker | . | J.Andreina | J.Andreina
HDFS-10193 | fuse_dfs segfaults if uid cannot be resolved to a username | Major | fuse-dfs | John Thiltges | John Thiltges
HDFS-10199 | Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing | Minor | . | Tibor Kiss | Tibor Kiss
YARN-4820 | ResourceManager web redirects in HA mode drops query parameters | Major | . | Varun Vasudev | Varun Vasudev
YARN-4850 | test-fair-scheduler.xml isn’t valid xml | Blocker | fairscheduler, test | Allen Wittenauer | Yufei Gu
HADOOP-12962 | KMS key names are incorrectly encoded when creating key | Major | . | Xiao Chen | Xiao Chen
HADOOP-12958 | PhantomReference for filesystem statistics can trigger OOM | Major | . | Jason Lowe | Sangjin Lee
HADOOP-12873 | Remove MRv1 terms from HttpAuthentication.md | Major | documentation | Akira Ajisaka | Brahma Reddy Battula
HDFS-10182 | Hedged read might overwrite user’s buf | Major | . | zhouyingchao | zhouyingchao
YARN-4773 | Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled | Minor | nodemanager | Jason Lowe | Jun Gong
MAPREDUCE-6662 | Clear ASF Warnings on test data files | Minor | . | Vinayakumar B | Vinayakumar B
HDFS-9871 | “Bytes Being Moved” -ve(-1 B) when cluster was already balanced. | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
YARN-4863 | AHS Security login should be in serviceInit() instead of serviceStart() | Major | timelineserver | Junping Du | Junping Du
HDFS-10197 | TestFsDatasetCache failing intermittently due to timeout | Major | test | Yiqun Lin | Yiqun Lin
HDFS-9478 | Reason for failing ipc.FairCallQueue contruction should be thrown | Minor | . | Archana T | Ajith S
HDFS-10228 | TestHDFSCLI fails | Major | test | Akira Ajisaka | Akira Ajisaka
YARN-4865 | Track Reserved resources in ResourceUsage and QueueCapacities | Major | resourcemanager | Sunil Govindan | Sunil Govindan
HADOOP-12972 | Lz4Compressor#getLibraryName returns the wrong version number | Trivial | native | John Zhuge | Colin P. McCabe
HDFS-5177 | blocksScheduled count should be decremented for abandoned blocks | Major | namenode | Vinayakumar B | Vinayakumar B
HDFS-10223 | peerFromSocketAndKey performs SASL exchange before setting connection timeouts | Major | . | Colin P. McCabe | Colin P. McCabe
HDFS-10221 | Add .json to the rat exclusions | Blocker | build | Ming Ma | Ming Ma
HADOOP-12902 | JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter | Major | documentation | Robert Kanter | Gabor Liptak
YARN-4183 | Clarify the behavior of timeline service config properties | Major | . | Mit Desai | Naganarasimha G R
HDFS-10253 | Fix TestRefreshCallQueue failure. | Major | . | Brahma Reddy Battula | Xiaoyu Yao
YARN-4746 | yarn web services should convert parse failures of appId, appAttemptId and containerId to 400 | Minor | webapp | Steve Loughran | Bibin A Chundatt
HDFS-9599 | TestDecommissioningStatus.testDecommissionStatus occasionally fails | Major | namenode | Wei-Chiu Chuang | Yiqun Lin
YARN-4706 | UI Hosting Configuration in TimelineServer doc is broken | Critical | documentation | Akira Ajisaka | Akira Ajisaka
HDFS-10178 | Permanent write failures can happen if pipeline recoveries occur for the first packet | Critical | . | Kihwal Lee | Kihwal Lee
HDFS-8496 | Calling stopWriter() with FSDatasetImpl lock held may block other threads | Major | . | zhouyingchao | Colin P. McCabe
HDFS-9917 | IBR accumulate more objects when SNN was down for sometime. | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10239 | Fsshell mv fails if port usage doesn’t match in src and destination paths | Major | . | Kuhu Shukla | Kuhu Shukla
YARN-4893 | Fix some intermittent test failures in TestRMAdminService | Blocker | . | Junping Du | Brahma Reddy Battula
YARN-4916 | TestNMProxy.tesNMProxyRPCRetry fails. | Minor | . | Tibor Kiss | Tibor Kiss
YARN-4915 | Fix typo in YARN Secure Containers documentation | Trivial | documentation, yarn | Takashi Ohnishi | Takashi Ohnishi
YARN-4917 | Fix typos in documentation of Capacity Scheduler. | Minor | documentation | Takashi Ohnishi | Takashi Ohnishi
HDFS-10261 | TestBookKeeperHACheckpoints doesn’t handle ephemeral HTTP ports | Major | . | Eric Badger | Eric Badger
YARN-4699 | Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node | Critical | capacity scheduler | Sunil Govindan | Sunil Govindan
HADOOP-12022 | fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits | Blocker | build | Allen Wittenauer | Allen Wittenauer
MAPREDUCE-6670 | TestJobListCache#testEviction sometimes fails on Windows with timeout | Minor | test | Gergely Novák | Gergely Novák
HDFS-6520 | hdfs fsck -move passes invalid length value when creating BlockReader | Major | . | Shengjun Xin | Xiao Chen
HDFS-10267 | Extra “synchronized” on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose | Major | datanode | Colin P. McCabe | Colin P. McCabe
YARN-4740 | AM may not receive the container complete msg when it restarts | Major | . | sandflee | sandflee
MAPREDUCE-6633 | AM should retry map attempts if the reduce task encounters commpression related errors. | Major | . | Rushabh S Shah | Rushabh S Shah
YARN-4938 | MiniYarnCluster should not request transitionToActive to RM on non-HA environment | Major | test | Akira Ajisaka | Eric Badger
HADOOP-12406 | AbstractMapWritable.readFields throws ClassNotFoundException with custom writables | Blocker | io | Nadeem Douba | Nadeem Douba
HADOOP-12993 | Change ShutdownHookManger complete shutdown log from INFO to DEBUG | Minor | . | Xiaoyu Yao | Xiaoyu Yao
HDFS-10277 | PositionedReadable test testReadFullyZeroByteFile failing in HDFS | Major | test | Steve Loughran | Steve Loughran
HDFS-10271 | Extra bytes are getting released from reservedSpace for append | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-12964 | Http server vulnerable to clickjacking | Major | . | Haibo Chen | Haibo Chen
YARN-4794 | Deadlock in NMClientImpl | Critical | . | Sumana Sathish | Jian He
HDFS-9772 | TestBlockReplacement#testThrottler doesn’t work as expected | Minor | test | Yiqun Lin | Yiqun Lin
HDFS-10270 | TestJMXGet:testNameNode() fails | Minor | test | Andras Bokor | Gergely Novák
HDFS-10216 | distcp -diff relative path exception | Major | distcp | John Zhuge | Takashi Ohnishi
YARN-4924 | NM recovery race can lead to container not cleaned up | Major | nodemanager | Nathan Roberts | sandflee
HADOOP-12989 | Some tests in org.apache.hadoop.fs.shell.find occasionally time out | Major | test | Akira Ajisaka | Takashi Ohnishi
HADOOP-13026 | Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator | Critical | . | Xuan Gong | Xuan Gong
YARN-4940 | yarn node -list -all failed if RM start with decommissioned node | Major | . | sandflee | sandflee
YARN-4965 | Distributed shell AM failed due to ClientHandlerException thrown by jersey | Critical | . | Sumana Sathish | Junping Du
YARN-4934 | Reserved Resource for QueueMetrics needs to be handled correctly in few cases | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
HDFS-10291 | TestShortCircuitLocalRead failing | Major | test | Steve Loughran | Steve Loughran
HDFS-10275 | TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly | Major | test | Yiqun Lin | Yiqun Lin
MAPREDUCE-6649 | getFailureInfo not returning any failure info | Major | . | Eric Badger | Eric Badger
HDFS-10265 | OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag | Minor | tools | Wan Chang | Wan Chang
HDFS-9744 | TestDirectoryScanner#testThrottling occasionally time out after 300 seconds | Minor | datanode | Wei-Chiu Chuang | Yiqun Lin
HDFS-10308 | TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing | Major | test | Rakesh R | Rakesh R
HDFS-10312 | Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. | Major | namenode | Chris Nauroth | Chris Nauroth
MAPREDUCE-6680 | JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.) | Major | jobhistoryserver | Junping Du | Junping Du
HDFS-9670 | DistCp throws NPE when source is root | Major | distcp | Yongjun Zhang | John Zhuge
HADOOP-13042 | Restore lost leveldbjni LICENSE and NOTICE changes | Major | . | Andrew Wang | Andrew Wang
HADOOP-13043 | Add LICENSE.txt entries for bundled javascript dependencies | Major | . | Andrew Wang | Andrew Wang
HDFS-10319 | Balancer should not try to pair storages with different types | Minor | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-10309 | Balancer doesn’t honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga) | Minor | balancer & mover | Amit Anand | Amit Anand
HDFS-9555 | LazyPersistFileScrubber should still sleep if there are errors in the clear progress | Major | . | Phil Yang | Phil Yang
HADOOP-13052 | ChecksumFileSystem mishandles crc file permissions | Major | fs | Daryn Sharp | Daryn Sharp
HDFS-9905 | WebHdfsFileSystem#runWithRetry should display original stack trace on error | Major | test | Kihwal Lee | Wei-Chiu Chuang
HADOOP-11418 | Property “io.compression.codec.lzo.class” does not work with other value besides default | Major | io | fang fang chen | Yuanbo Liu
HDFS-10318 | TestJMXGet hides the real error in case of test failure | Minor | test | Andras Bokor | Andras Bokor
YARN-4556 | TestFifoScheduler.testResourceOverCommit fails | Major | scheduler, test | Akihiro Suda | Akihiro Suda
HDFS-10329 | Bad initialisation of StringBuffer in RequestHedgingProxyProvider.java | Minor | ha | Max Schaefer | Yiqun Lin
HDFS-10313 | Distcp need to enforce the order of snapshot names passed to -diff | Major | distcp | Yongjun Zhang | Yiqun Lin
HADOOP-13030 | Handle special characters in passwords in KMS startup script | Major | kms | Xiao Chen | Xiao Chen
YARN-4955 | Add retry for SocketTimeoutException in TimelineClient | Critical | . | Xuan Gong | Xuan Gong
HDFS-9958 | BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. | Major | . | Kuhu Shukla | Kuhu Shukla
YARN-5008 | LeveldbRMStateStore database can grow substantially leading to long recovery times | Major | resourcemanager | Jason Lowe | Jason Lowe
YARN-5009 | NMLeveldbStateStoreService database can grow substantially leading to longer recovery times | Major | nodemanager | Jason Lowe | Jason Lowe
HADOOP-12378 | Fix findbugs warnings in hadoop-tools module | Major | tools | Akira Ajisaka | Akira Ajisaka
HDFS-10260 | TestFsDatasetImpl#testCleanShutdownOfVolume often fails | Major | datanode, test | Wei-Chiu Chuang | Rushabh S Shah
HDFS-10335 | Mover$Processor#chooseTarget() always chooses the first matching target storage group | Critical | balancer & mover | Mingliang Liu | Mingliang Liu
MAPREDUCE-6672 | TestTeraSort fails on Windows | Minor | test | Tibor Kiss | Tibor Kiss
HDFS-10347 | Namenode report bad block method doesn’t log the bad block or datanode. | Minor | namenode | Rushabh S Shah | Rushabh S Shah
HADOOP-13072 | WindowsGetSpaceUsed constructor should be public | Major | . | Vinayakumar B | Vinayakumar B
MAPREDUCE-6537 | Include hadoop-pipes examples in the release tarball | Blocker | pipes | Allen Wittenauer | Kai Sasaki
HDFS-10353 | Fix hadoop-hdfs-native-client compilation on Windows | Blocker | build | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10344 | DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash | Major | . | Namit Maheshwari | Xiaoyu Yao
HADOOP-13080 | Refresh time in SysInfoWindows is in nanoseconds | Major | util | Íñigo Goiri | Íñigo Goiri
YARN-4834 | ProcfsBasedProcessTree doesn’t track daemonized processes | Major | nodemanager | Nathan Roberts | Nathan Roberts
HDFS-10320 | Rack failures may result in NN terminate | Major | . | Xiao Chen | Xiao Chen
MAPREDUCE-6675 | TestJobImpl.testUnusableNode failed | Major | mrv2 | Haibo Chen | Haibo Chen
YARN-4311 | Removing nodes from include and exclude lists will not remove them from decommissioned nodes list | Major | . | Kuhu Shukla | Kuhu Shukla
YARN-4984 | LogAggregationService shouldn’t swallow exception in handling createAppDir() which cause thread leak. | Critical | log-aggregation | Junping Du | Junping Du
HADOOP-13098 | Dynamic LogLevel setting page should accept case-insensitive log level string | Major | . | Junping Du | Junping Du
HDFS-10324 | Trash directory in an encryption zone should be pre-created with correct permissions | Major | encryption | Wei-Chiu Chuang | Wei-Chiu Chuang
MAPREDUCE-6514 | Job hangs as ask is not updated after ramping down of all reducers | Blocker | applicationmaster | Varun Saxena | Varun Saxena
HDFS-2043 | TestHFlush failing intermittently | Major | test | Aaron T. Myers | Yiqun Lin
MAPREDUCE-6689 | MapReduce job can infinitely increase number of reducer resource requests | Blocker | . | Wangda Tan | Wangda Tan
YARN-4747 | AHS error 500 due to NPE when container start event is missing | Major | timelineserver | Jason Lowe | Varun Saxena
HDFS-9939 | Increase DecompressorStream skip buffer size | Major | . | Yongjun Zhang | John Zhuge
YARN-5048 | DelegationTokenRenewer#skipTokenRenewal may throw NPE | Major | . | Jian He | Jian He
YARN-4926 | Change nodelabel rest API invalid reponse status to 400 | Major | . | Bibin A Chundatt | Bibin A Chundatt
HDFS-10372 | Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume | Major | test | Rushabh S Shah | Rushabh S Shah
MAPREDUCE-6684 | High contention on scanning of user directory under immediate_done in Job History Server | Critical | jobhistoryserver | Haibo Chen | Haibo Chen
HDFS-6187 | Update the document of hftp/hsftp in branch-2 to mention that they are deprecated | Major | documentation | Haohui Mai | Gergely Novák
YARN-4768 | getAvailablePhysicalMemorySize can be inaccurate on linux | Major | nodemanager | Nathan Roberts | Nathan Roberts
HADOOP-13125 | FS Contract tests don’t report FS initialization errors well | Minor | test | Steve Loughran | Steve Loughran
YARN-5029 | RM needs to send update event with YarnApplicationState as Running to ATS/AHS | Critical | . | Xuan Gong | Xuan Gong
HADOOP-13116 | Jets3tNativeS3FileSystemContractTest does not run. | Minor | test | Chris Nauroth | Chris Nauroth
MAPREDUCE-6639 | Process hangs in LocatedFileStatusFetcher if FileSystem.get throws | Major | mrv2 | Ryan Blue | Ryan Blue
HADOOP-11180 | Change log message “token.Token: Cannot find class for token kind kms-dt” to debug | Major | kms, security | Yi Liu | Yi Liu
MAPREDUCE-6558 | multibyte delimiters with compressed input files generate duplicate records | Major | mrv1, mrv2 | Wilfred Spiegelenburg | Wilfred Spiegelenburg
HADOOP-13083 | The number of javadocs warnings is limited to 100 | Critical | . | Li Lu | Gergely Novák
MAPREDUCE-6513 | MR job got hanged forever when one NM unstable for some time | Critical | applicationmaster, resourcemanager | Bob.zhao | Varun Saxena
HDFS-10333 | Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk | Major | hdfs | Yongjun Zhang | Yiqun Lin
HADOOP-12942 | hadoop credential commands non-obviously use password of “none” | Major | security | Mike Yoder | Mike Yoder
YARN-4325 | Nodemanager log handlers fail to send finished/failed events in some cases | Critical | . | Junping Du | Junping Du
HDFS-10242 | Cannot create space quota of zero | Major | fs | Takashi Ohnishi | Takashi Ohnishi
MAPREDUCE-6693 | ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit | Critical | . | Bibin A Chundatt | Ajith S
HADOOP-13163 | Reuse pre-computed filestatus in Distcp-CopyMapper | Minor | tools/distcp | Rajesh Balamohan | Rajesh Balamohan
HDFS-10303 | DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. | Major | hdfs-client | Surendra Singh Lilhore | Surendra Singh Lilhore
MAPREDUCE-6698 | Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser | Major | jobhistoryserver | Haibo Chen | Haibo Chen
HADOOP-13159 | Fix potential NPE in Metrics2 source for DecayRpcScheduler | Major | ipc | Xiaoyu Yao | Xiaoyu Yao
HDFS-10397 | Distcp should ignore -delete option if -diff option is provided instead of exiting | Major | distcp | Mingliang Liu | Mingliang Liu
HDFS-10381 | DataStreamer DataNode exclusion log message should be warning | Minor | hdfs-client | John Zhuge | John Zhuge
HDFS-9226 | MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils | Major | test | Josh Elser | Josh Elser
HADOOP-13138 | Unable to append to a SequenceFile with Compression.NONE. | Critical | . | Gervais Mickaël | Vinayakumar B
HADOOP-13157 | Follow-on improvements to hadoop credential commands | Major | security | Mike Yoder | Mike Yoder
YARN-3840 | Resource Manager web ui issue when sorting application by id (with application having id > 9999) | Major | resourcemanager | LINTE | Varun Saxena
HADOOP-13177 | Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib. | Minor | build | Chris Nauroth | Chris Nauroth
HADOOP-12767 | update apache httpclient version to 4.5.2; httpcore to 4.4.4 | Major | build | Artem Aliev | Artem Aliev
YARN-5100 | The YarnApplicationState is always running in ATS no matter the application is running or finishes. | Blocker | . | Xuan Gong | Xuan Gong
HADOOP-13183 | S3A proxy tests fail after httpclient/httpcore upgrade. | Major | fs/s3 | Chris Nauroth | Steve Loughran
YARN-5020 | Fix Documentation for Yarn Capacity Scheduler on Resource Calculator | Minor | . | Jo Desmet | Takashi Ohnishi
HDFS-10424 | DatanodeLifelineProtocol not able to use under security cluster | Blocker | . | gu-chi | Chris Nauroth
HDFS-10438 | When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. | Minor | ha, namenode | KWON BYUNGCHANG | Chris Nauroth
HDFS-10439 | Update setOwner doc in HdfsPermissionsGuide | Minor | documentation | John Zhuge | John Zhuge
MAPREDUCE-6607 | Enable regex pattern matching when mapreduce.task.files.preserve.filepattern is set | Minor | applicationmaster | Maysam Yabandeh | Kai Sasaki
YARN-5103 | With NM recovery enabled, restarting NM multiple times results in AM restart | Critical | yarn | Sumana Sathish | Junping Du
YARN-5055 | max apps per user can be larger than max per queue | Minor | capacityscheduler, resourcemanager | Jason Lowe | Eric Badger
YARN-3971 | Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery | Critical | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-9365 | Balancer does not work with the HDFS-6376 HA setup | Major | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-3344 | Fix warning - procfs stat file is not in the expected format | Major | . | Jon Bringhurst | Ravindra Kumar Naik
YARN-4459 | container-executor should only kill process groups | Major | nodemanager | Jun Gong | Jun Gong
YARN-5166 | javadoc:javadoc goal fails on hadoop-yarn-client | Major | . | Andras Bokor | Andras Bokor
HDFS-10276 | HDFS should not expose path info that user has no permission to see. | Major | fs, security | Kevin Cox | Yuanbo Liu
YARN-5132 | Exclude generated protobuf sources from YARN Javadoc build | Critical | . | Subru Krishnan | Subru Krishnan
HADOOP-13132 | Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider | Major | kms | Miklos Szurap | Wei-Chiu Chuang
HDFS-10415 | TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called | Major | test | Sangjin Lee | Mingliang Liu
HADOOP-13137 | TraceAdmin should support Kerberized cluster | Major | tracing | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9476 | TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail | Major | . | Wei-Chiu Chuang | Masatake Iwasaki
HDFS-10367 | TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10471 | DFSAdmin#SetQuotaCommand’s help msg is not correct | Minor | documentation | Yiqun Lin | Yiqun Lin
YARN-5098 | Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token | Major | yarn | Yesha Vora | Jian He
HADOOP-13155 | Implement TokenRenewer to renew and cancel delegation tokens in KMS | Major | kms, security | Xiao Chen | Xiao Chen
HDFS-10481 | HTTPFS server should correctly impersonate as end user to open file | Major | httpfs | Xiao Chen | Xiao Chen
HDFS-10485 | Fix findbugs warning in FSEditLog.java | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-10458 | getFileEncryptionInfo should return quickly for non-encrypted cluster | Major | encryption, namenode | Zhe Zhang | Zhe Zhang
YARN-5206 | RegistrySecurity includes id:pass in exception text if considered invalid | Minor | client, security | Steve Loughran | Steve Loughran
HDFS-10220 | A large number of expired leases can make namenode unresponsive and cause failover | Major | namenode | Nicolas Fraison | Nicolas Fraison
HADOOP-13249 | RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep | Major | ipc | zhihai xu | zhihai xu
HADOOP-13213 | Small Documentation bug with AuthenticatedURL in hadoop-auth | Minor | documentation | Tom Ellis | Tom Ellis
HADOOP-13079 | Add -q option to Ls to print ? instead of non-printable characters | Major | . | John Zhuge | John Zhuge
HDFS-10516 | Fix bug when warming up EDEK cache of more than one encryption zone | Major | encryption, namenode | Xiao Chen | Xiao Chen
HADOOP-13270 | BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks | Critical | . | Haibo Chen | Kai Sasaki
HADOOP-13179 | GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe | Minor | . | hongbin ma | hongbin ma
HADOOP-13244 | o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor | Minor | ipc | Xiaoyu Yao | Kai Sasaki
HADOOP-13245 | Fix up some misc create-release issues | Blocker | build | Allen Wittenauer | Allen Wittenauer
HDFS-10505 | OIV’s ReverseXML processor should support ACLs | Major | tools | Colin P. McCabe | Surendra Singh Lilhore
HDFS-10525 | Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap | Major | caching | Xiao Chen | Xiao Chen
YARN-5237 | Fix missing log files issue in rolling log aggregation. | Major | . | Siddharth Seth | Xuan Gong
HDFS-10532 | Typo in RollingUpgrade docs | Major | documentation | Arpit Agarwal | Yiqun Lin
HADOOP-3733 | “s3:” URLs break when Secret Key contains a slash, even if encoded | Minor | fs/s3 | Stuart Sierra | Steve Loughran
HDFS-9466 | TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky | Major | fs, hdfs-client | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-13255 | KMSClientProvider should check and renew tgt when doing delegation token operations. | Major | kms | Xiao Chen | Xiao Chen
HADOOP-13285 | DecayRpcScheduler MXBean should only report decayed CallVolumeSummary | Major | ipc | Namit Maheshwari | Xiaoyu Yao
HADOOP-13149 | Windows distro build fails on dist-copynativelibs. | Blocker | build | Chris Nauroth | Chris Nauroth
YARN-5246 | NMWebAppFilter web redirects drop query parameters | Major | . | Varun Vasudev | Varun Vasudev
HDFS-10474 | hftp copy fails when file name with Chinese+special char in branch-2 | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-13192 | org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly | Critical | util | binde | binde
HDFS-10448 | CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 | Major | caching | Yiqun Lin | Yiqun Lin
YARN-5197 | RM leaks containers if running container disappears from node update | Critical | resourcemanager | Jason Lowe | Jason Lowe
HADOOP-13287 | TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains ‘+’. | Minor | fs/s3, test | Chris Nauroth | Chris Nauroth
HDFS-10556 | DistCpOptions should be validated automatically | Major | distcp | Mingliang Liu | Mingliang Liu
MAPREDUCE-6725 | Javadoc for CLI#listEvents() contains no-existent param | Minor | client, documentation | Shen Yinjie | Shen Yinjie
HDFS-7959 | WebHdfs logging is missing on Datanode | Critical | . | Kihwal Lee | Kihwal Lee
MAPREDUCE-6542 | HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe | Major | jobhistoryserver | zhangyubiao | zhangyubiao
HADOOP-13251 | Authenticate with Kerberos credentials when renewing KMS delegation token | Major | kms | Xiao Chen | Xiao Chen
HADOOP-13316 | Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator | Blocker | kms, security | Xiao Chen | Xiao Chen
HDFS-9852 | hdfs dfs -setfacl error message is misleading | Minor | . | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-5262 | Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HADOOP-12345 | Pad hostname correctly in CredentialsSys.java | Critical | nfs | Pradeep Nayak Udupi Kadbet | Pradeep Nayak Udupi Kadbet
HADOOP-13314 | Remove ‘package-info.java’ from ‘test\java\org\apache\hadoop\fs\shell\’ to remove eclipse compile error | Trivial | . | Vinayakumar B | Vinayakumar B
HDFS-10589 | Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params | Minor | documentation, hdfs | Shen Yinjie | Shen Yinjie
YARN-5286 | Add RPC port info in RM web service’s response when getting app status | Major | . | Jun Gong | Jun Gong
YARN-5214 | Pending on synchronized method DirectoryCollection#checkDirs can hang NM’s NodeStatusUpdater | Critical | nodemanager | Junping Du | Junping Du
HADOOP-13350 | Additional fix to LICENSE and NOTICE | Blocker | build | Xiao Chen | Xiao Chen
HDFS-10592 | Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning | Major | test | Rakesh R | Rakesh R
HADOOP-13320 | Fix arguments check in documentation for WordCount v2.0 | Minor | documentation | niccolo becchi | niccolo becchi
YARN-5314 | ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore | Major | timelineserver | Karam Singh | Li Lu
YARN-4939 | the decommissioning Node should keep alive if NM restart | Major | . | sandflee | sandflee
HADOOP-12893 | Verify LICENSE.txt and NOTICE.txt | Blocker | build | Allen Wittenauer | Xiao Chen
HADOOP-13352 | Make X-FRAME-OPTIONS configurable in HttpServer2 | Major | net, security | Anu Engineer | Anu Engineer
HDFS-10336 | TestBalancer failing intermittently because of not reseting UserGroupInformation completely | Major | test | Yiqun Lin | Yiqun Lin
HDFS-10512 | VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks | Major | datanode | Wei-Chiu Chuang | Yiqun Lin
YARN-5337 | Fix OOM issue in DistributedShell. AM failed with “java.lang.OutOfMemoryError: GC overhead limit exceeded” | Major | . | Sumana Sathish | Jian He
HADOOP-13297 | Add missing dependency in setting maven-remote-resource-plugin to fix builds | Major | build | Akira Ajisaka | Sean Busbey
YARN-5270 | Solve miscellaneous issues caused by YARN-4844 | Blocker | . | Wangda Tan | Wangda Tan
HDFS-10579 | HDFS web interfaces lack configs for X-FRAME-OPTIONS protection | Major | datanode, namenode | Anu Engineer | Anu Engineer
MAPREDUCE-6625 | TestCLI#testGetJob fails occasionally | Major | test | Jason Lowe | Haibo Chen
HADOOP-13315 | FileContext#umask is not initialized properly | Minor | . | John Zhuge | John Zhuge
YARN-5353 | ResourceManager can leak delegation tokens when they are shared across apps | Critical | resourcemanager | Jason Lowe | Jason Lowe
HADOOP-11361 | Fix a race condition in MetricsSourceAdapter.updateJmxCache | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10544 | Balancer doesn’t work with IPFailoverProxyProvider | Major | balancer & mover, ha | Zhe Zhang | Zhe Zhang
HADOOP-13351 | TestDFSClientSocketSize buffer size tests are flaky | Major | . | Aaron Fabbri | Aaron Fabbri
HADOOP-13202 | Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes | Major | util | zhengbing li | Kai Sasaki
HDFS-10603 | Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot | Major | hdfs, namenode | Yongjun Zhang | Yiqun Lin
HADOOP-12991 | Conflicting default ports in DelegateToFileSystem | Major | fs | Kevin Hogeland | Kai Sasaki
YARN-5309 | Fix SSLFactory truststore reloader thread leak in TimelineClientImpl | Blocker | timelineserver, yarn | Thomas Friedrich | Weiwei Yang
HADOOP-13387 | users always get told off for using S3 —even when not using it. | Minor | fs/s3 | Steve Loughran | Steve Loughran
YARN-5340 | Race condition in RollingLevelDBTimelineStore#getAndSetStartTime() | Critical | timelineserver | Sumana Sathish | Li Lu
HDFS-8914 | Document HA support in the HDFS HdfsDesign.md | Major | documentation | Ravindra Babu | Lars Francke
HADOOP-12588 | Fix intermittent test failure of TestGangliaMetrics | Major | . | Tsuyoshi Ozawa | Masatake Iwasaki
HADOOP-13240 | TestAclCommands.testSetfaclValidations fail | Minor | test | linbao111 | John Zhuge
HADOOP-13389 | TestS3ATemporaryCredentials.testSTS error when using IAM credentials | Major | fs/s3 | Steven K. Wong | Steven K. Wong
HADOOP-13406 | S3AFileSystem: Consider reusing filestatus in delete() and mkdirs() | Minor | fs/s3 | Rajesh Balamohan | Rajesh Balamohan
MAPREDUCE-6744 | Increase timeout on TestDFSIO tests | Major | . | Eric Badger | Eric Badger
HDFS-10688 | BPServiceActor may run into a tight loop for sending block report when hitting IOException | Major | datanode | Jing Zhao | Chen Liang
HDFS-10671 | Fix typo in HdfsRollingUpgrade.md | Trivial | documentation | Yiqun Lin | Yiqun Lin
HADOOP-13422 | ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process | Major | . | Sergey Shelukhin | Sergey Shelukhin
HDFS-10696 | TestHDFSCLI fails | Major | test | Akira Ajisaka | Kai Sasaki
YARN-5432 | Lock already held by another process while LevelDB cache store creation for dag | Critical | timelineserver | Karam Singh | Li Lu
YARN-5438 | TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM | Major | timelineserver | Karam Singh | Rohith Sharma K S
HADOOP-13381 | KMS clients should use KMS Delegation Tokens from current UGI. | Critical | kms | Xiao Chen | Xiao Chen
HDFS-10691 | FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException | Major | . | Yiqun Lin | Yiqun Lin
YARN-5121 | fix some container-executor portability issues | Blocker | nodemanager, security | Allen Wittenauer | Allen Wittenauer
MAPREDUCE-6724 | Single shuffle to memory must not exceed Integer#MAX_VALUE | Major | mrv2 | Haibo Chen | Haibo Chen
HDFS-5805 | TestCheckpoint.testCheckpoint fails intermittently on branch2 | Major | . | Mit Desai | Eric Badger
HADOOP-13459 | hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. | Minor | fs/azure, test | Chris Nauroth | Chris Nauroth
HDFS-742 | A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list | Minor | balancer & mover | Hairong Kuang | Mit Desai
YARN-4280 | CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster | Major | capacity scheduler | Kuhu Shukla | Kuhu Shukla
YARN-5462 | TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently | Major | . | Eric Badger | Eric Badger
HDFS-10710 | In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection | Major | namenode | Rui Gao | Rui Gao
YARN-5469 | Increase timeout of TestAmFilter.testFilter | Minor | . | Eric Badger | Eric Badger
HDFS-10569 | A bug causes OutOfIndex error in BlockListAsLongs | Minor | . | Weiwei Yang | Weiwei Yang
HADOOP-13434 | Add quoting to Shell class | Major | . | Owen O’Malley | Owen O’Malley
MAPREDUCE-6682 | TestMRCJCFileOutputCommitter fails intermittently | Major | test | Brahma Reddy Battula | Akira Ajisaka
HDFS-10716 | In Balancer, the target task should be removed when its size < 0. | Minor | balancer & mover | Yiqun Lin | Yiqun Lin
HDFS-10722 | Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs | Major | hdfs | Daryn Sharp | Daryn Sharp
HADOOP-13467 | Shell#getSignalKillCommand should use the bash builtin on Linux | Major | . | Arpit Agarwal | Arpit Agarwal
HDFS-10717 | Fix findbugs warnings of hadoop-hdfs-client in branch-2 | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-10343 | BlockManager#createLocatedBlocks may return blocks on failed storages | Major | hdfs | Daryn Sharp | Kuhu Shukla
HDFS-10715 | NPE when applying AvailableSpaceBlockPlacementPolicy | Major | namenode | Guangbin Zhu | Guangbin Zhu
YARN-4624 | NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-10823 | TestReloadingX509TrustManager is flaky | Major | . | Ratandeep Ratti | Mingliang Liu
HADOOP-13457 | Remove hardcoded absolute path for shell executable | Major | util | Arpit Agarwal | Chen Liang
HADOOP-13439 | Fix race between TestMetricsSystemImpl and TestGangliaMetrics | Minor | test | Masatake Iwasaki | Chen Liang
MAPREDUCE-6750 | TestHSAdminServer.testRefreshSuperUserGroups is failing | Minor | test | Kihwal Lee | Kihwal Lee
HADOOP-13473 | Tracing in IPC Server is broken | Major | . | Wei-Chiu Chuang | Daryn Sharp
HDFS-10738 | Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure | Major | test | Rakesh R | Rakesh R
HADOOP-13299 | JMXJsonServlet is vulnerable to TRACE | Minor | . | Haibo Chen | Haibo Chen
HDFS-8224 | Schedule a block for scanning if its metadata file is corrupt | Major | datanode | Rushabh S Shah | Rushabh S Shah
YARN-5382 | RM does not audit log kill request for active applications | Major | resourcemanager | Jason Lowe | Vrushali C
HDFS-10643 | Namenode should use loginUser(hdfs) to generateEncryptedKey | Major | encryption, namenode | Xiaoyu Yao | Xiaoyu Yao
HDFS-8897 | Balancer should handle fs.defaultFS trailing slash in HA | Major | balancer & mover | LINTE | John Zhuge
HDFS-10731 | FSDirectory#verifyMaxDirItems does not log path name | Minor | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-5476 | Not existed application reported as ACCEPTED state by YarnClientImpl | Critical | yarn | Yesha Vora | Junping Du
YARN-5491 | Random Failure TestCapacityScheduler#testCSQueueBlocked | Major | test | Bibin A Chundatt | Bibin A Chundatt
HDFS-9696 | Garbage snapshot records lingering forever | Critical | . | Kihwal Lee | Kihwal Lee
HADOOP-13333 | testConf.xml ls comparators in wrong order | Trivial | fs | John Zhuge | Vrushali C
HADOOP-13470 | GenericTestUtils$LogCapturer is flaky | Major | test, util | Mingliang Liu | Mingliang Liu
HADOOP-13494 | ReconfigurableBase can log sensitive information | Major | security | Sean Mackrory | Sean Mackrory
HDFS-9530 | ReservedSpace is not cleared for abandoned Blocks | Critical | datanode | Fei Hui | Brahma Reddy Battula
HDFS-10549 | Correctly revoke file leases when closing files | Major | hdfs-client | Yiqun Lin | Yiqun Lin
HADOOP-13513 | Java 1.7 support for org.apache.hadoop.fs.azure testcases | Minor | fs/azure | Tibor Kiss | Tibor Kiss
HADOOP-13512 | ReloadingX509TrustManager should keep reloading in case of exception | Critical | security | Mingliang Liu | Mingliang Liu
HDFS-10763 | Open files can leak permanently due to inconsistent lease update | Critical | . | Kihwal Lee | Kihwal Lee
YARN-4307 | Display blacklisted nodes for AM container in the RM web UI | Major | resourcemanager, webapp | Naganarasimha G R | Naganarasimha G R
MAPREDUCE-6763 | Shuffle server listen queue is too small | Major | mrv2 | Jason Lowe | Jason Lowe
YARN-4837 | User facing aspects of ‘AM blacklisting’ feature need fixing | Critical | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
MAPREDUCE-6310 | Add jdiff support to MapReduce | Blocker | . | Li Lu | Li Lu
YARN-3388 | Allocation in LeafQueue could get stuck because DRF calculator isn’t well supported when computing user-limit | Major | capacityscheduler | Nathan Roberts | Nathan Roberts
YARN-4685 | Disable AM blacklisting by default to mitigate situations that application get hanged | Critical | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HADOOP-13428 | Fix hadoop-common to generate jdiff | Blocker | . | Wangda Tan | Wangda Tan
HDFS-10764 | Fix INodeFile#getBlocks to not return null | Major | namenode | Arpit Agarwal | Arpit Agarwal
HDFS-10692 | Point JDiff base version for HDFS from 2.6.0 to 2.7.2 | Blocker | . | Wangda Tan | Wangda Tan
HADOOP-13487 | Hadoop KMS should load old delegation tokens from Zookeeper on startup | Major | kms | Alex Ivanov | Xiao Chen
HDFS-10783 | The option ‘-maxSize’ and ‘-step’ fail in OfflineImageViewer | Major | tools | Yiqun Lin | Yiqun Lin
HADOOP-13524 | mvn eclipse:eclipse generates .gitignore’able files | Major | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HADOOP-13497 | fix wrong command in CredentialProviderAPI.md | Trivial | documentation | Yuanbo Liu | Yuanbo Liu
MAPREDUCE-6761 | Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure | Major | mrv2 | Peter Vary | Peter Vary
HDFS-10748 | TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout | Major | test | Xiaoyu Yao | Yiqun Lin
HDFS-10793 | Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184 | Blocker | . | Andrew Wang | Manoj Govindassamy
HDFS-10652 | Add a unit test for HDFS-4660 | Major | datanode, hdfs | Yongjun Zhang | Vinayakumar B
HADOOP-13552 | RetryInvocationHandler logs all remote exceptions | Blocker | ipc | Jason Lowe | Jason Lowe
HADOOP-12765 | HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections | Major | . | Min Shen | Min Shen
MAPREDUCE-6768 | TestRecovery.testSpeculative failed with NPE | Major | mrv2 | Haibo Chen | Haibo Chen
HADOOP-13559 | Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes | Minor | fs | Aaron Fabbri | Aaron Fabbri
HDFS-4210 | Throw helpful exception when DNS entry for JournalNode cannot be resolved | Trivial | ha, journal-node, namenode | Damien Hardy | John Zhuge
MAPREDUCE-4784 | TestRecovery occasionally fails | Major | mrv2, test | Jason Lowe | Haibo Chen
HDFS-10760 | DataXceiver#run() should not log InvalidToken exception as an error | Major | . | Pan Yuxuan | Pan Yuxuan
HDFS-10729 | Improve log message for edit loading failures caused by FS limit checks. | Major | namenode | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-13375 | o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky | Major | security, test | Mingliang Liu | Weiwei Yang
YARN-5555 | Scheduler UI: “% of Queue” is inaccurate if leaf queue is hierarchically nested. | Minor | . | Eric Payne | Eric Payne
YARN-5549 | AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately | Critical | resourcemanager | Daniel Templeton | Daniel Templeton
HDFS-10841 | Remove duplicate or unused variable in appendFile() | Minor | . | Kihwal Lee | Kihwal Lee
HADOOP-13558 | UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket | Major | security | Alejandro Abdelnur | Xiao Chen
HDFS-9038 | DFS reserved space is erroneously counted towards non-DFS used. | Major | datanode | Chris Nauroth | Brahma Reddy Battula
HDFS-10832 | Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions | Critical | httpfs | Andrew Wang | Andrew Wang
YARN-5632 | UPDATE_EXECUTION_TYPE causes UpdateContainerRequestPBImpl to throw | Major | api | Jason Lowe | Jason Lowe
HDFS-9781 | FsDatasetImpl#getBlockReports can occasionally throw NullPointerException | Major | datanode | Wei-Chiu Chuang | Manoj Govindassamy
HDFS-10830 | FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use | Major | hdfs | Manoj Govindassamy | Arpit Agarwal
YARN-5190 | Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl | Blocker | . | Junping Du | Junping Du
HDFS-10856 | Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport | Minor | documentation | Akira Ajisaka | Yiqun Lin
YARN-5630 | NM fails to start after downgrade from 2.8 to 2.7 | Blocker | nodemanager | Jason Lowe | Jason Lowe
HADOOP-13616 | Broken code snippet area in Hadoop Benchmarking | Minor | documentation | Kai Sasaki | Kai Sasaki
HDFS-10862 | Typos in 4 log messages | Trivial | . | Mehran Hassani | Mehran Hassani
YARN-4232 | TopCLI console support for HA mode | Minor | . | Bibin A Chundatt | Bibin A Chundatt
YARN-5655 | TestContainerManagerSecurity#testNMTokens is asserting | Major | . | Jason Lowe | Robert Kanter
HDFS-10879 | TestEncryptionZonesWithKMS#testReadWrite fails intermittently | Major | . | Xiao Chen | Xiao Chen
YARN-5539 | TimelineClient failed to retry on “java.net.SocketTimeoutException: Read timed out” | Critical | yarn | Sumana Sathish | Junping Du
HADOOP-13643 | Math error in AbstractContractDistCpTest | Minor | . | Aaron Fabbri | Aaron Fabbri
HDFS-10886 | Replace “fs.default.name” with “fs.defaultFS” in viewfs document | Minor | documentation, federation | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10843 | Update space quota when a UC block is completed rather than committed. | Major | hdfs, namenode | Erik Krogen | Erik Krogen
HADOOP-13535 | Add jetty6 acceptor startup issue workaround to branch-2 | Major | . | Wei-Chiu Chuang | Min Shen
YARN-5664 | Fix Yarn documentation to link to correct versions. | Minor | . | Xiao Chen | Xiao Chen
YARN-5663 | Small refactor in ZKRMStateStore | Minor | resourcemanager | Oleksii Dymytrov | Oleksii Dymytrov
HADOOP-12597 | In kms-site.xml configuration “hadoop.security.keystore.JavaKeyStoreProvider.password” should be updated with new name | Minor | security | huangyitian | Surendra Singh Lilhore
HADOOP-13638 | KMS should set UGI’s Configuration object properly | Major | kms | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-9885 | Correct the distcp counters name while displaying counters | Minor | distcp | Archana T | Surendra Singh Lilhore
YARN-5660 | Wrong audit constants are used in Get/Put of priority in RMWebService | Trivial | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HDFS-10889 | Remove outdated Fault Injection Framework documentaion | Major | documentation | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10713 | Throttle FsNameSystem lock warnings | Major | logging, namenode | Arpit Agarwal | Hanisha Koneru
HDFS-10426 | TestPendingInvalidateBlock failed in trunk | Major | test | Yiqun Lin | Yiqun Lin
HDFS-10828 | Fix usage of FsDatasetImpl object lock in ReplicaMap | Blocker | . | Arpit Agarwal | Arpit Agarwal
YARN-5631 | Missing refreshClusterMaxPriority usage in rmadmin help message | Minor | . | Kai Sasaki | Kai Sasaki
HDFS-9444 | Add utility to find set of available ephemeral ports to ServerSocketUtil | Major | . | Brahma Reddy Battula | Masatake Iwasaki
HADOOP-11780 | Prevent IPC reader thread death | Critical | ipc | Daryn Sharp | Daryn Sharp
HDFS-10824 | MiniDFSCluster#storageCapacities has no effects on real capacity | Major | . | Xiaobing Zhou | Xiaobing Zhou
HDFS-10914 | Move remnants of oah.hdfs.client to hadoop-hdfs-client | Critical | hdfs-client | Andrew Wang | Andrew Wang
MAPREDUCE-6771 | RMContainerAllocator sends container diagnostics event after corresponding completion event | Major | mrv2 | Haibo Chen | Haibo Chen
HADOOP-13640 | Fix findbugs warning in VersionInfoMojo.java | Major | . | Tsuyoshi Ozawa | Yuanbo Liu
HDFS-10850 | getEZForPath should NOT throw FNF | Blocker | hdfs | Daryn Sharp | Andrew Wang
HDFS-10945 | Fix the Findbugwaring FSNamesystem#renameTo(String, String, boolean) in branch-2 | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10810 | Setreplication removing block from underconstrcution temporarily when batch IBR is enabled. | Major | namenode | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10944 | Correct the javadoc of dfsadmin#disallowSnapshot | Minor | documentation | Jagadesh Kiran N | Jagadesh Kiran N
HDFS-10947 | Correct the API name for truncate in webhdfs document | Major | documentation | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-12667 | s3a: Support createNonRecursive API | Major | fs/s3 | Sean Mackrory | Sean Mackrory
HDFS-10609 | Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications | Major | encryption | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-10962 | TestRequestHedgingProxyProvider is flaky | Major | test | Andrew Wang | Andrew Wang
MAPREDUCE-6740 | Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval | Minor | mr-am | Haibo Chen | Haibo Chen
YARN-5101 | YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order | Major | . | Xuan Gong | Sunil Govindan
YARN-5659 | getPathFromYarnURL should use standard methods | Major | . | Sergey Shelukhin | Sergey Shelukhin
HADOOP-12611 | TestZKSignerSecretProvider#testMultipleInit occasionally fail | Major | . | Wei-Chiu Chuang | Eric Badger
HDFS-10797 | Disk usage summary of snapshots causes renamed blocks to get counted twice | Major | snapshots | Sean Mackrory | Sean Mackrory
HDFS-10991 | Export hdfsTruncateFile symbol in libhdfs | Blocker | libhdfs | Surendra Singh Lilhore | Surendra Singh Lilhore
HADOOP-13700 | Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures | Critical | fs | Haibo Chen | Andrew Wang
HDFS-11002 | Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md | Major | documentation | Mingliang Liu | Mingliang Liu
HDFS-11000 | webhdfs PUT does not work if requests are routed to call queue. | Major | . | Kihwal Lee | Kihwal Lee
HDFS-10987 | Make Decommission less expensive when lot of blocks present. | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-13024 | Distcp with -delete feature on raw data not implemented | Major | tools/distcp | Mavin Martin | Mavin Martin
HDFS-10986 | DFSAdmin should log detailed error message if any | Major | tools | Mingliang Liu | Mingliang Liu
HDFS-10990 | TestPendingInvalidateBlock should wait for IBRs | Minor | . | Yiqun Lin | Yiqun Lin
HDFS-10735 | Distcp using webhdfs on secure HA clusters fails with StandbyException | Major | webhdfs | Benoy Antony | Benoy Antony
HDFS-10883 | `getTrashRoot`’s behavior is not consistent in DFS after enabling EZ. | Major | . | Yuanbo Liu | Yuanbo Liu
HADOOP-13707 | If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed | Major | . | Yuanbo Liu | Yuanbo Liu
HDFS-10301 | BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order | Critical | namenode | Konstantin Shvachko | Vinitha Reddy Gankidi
HDFS-10712 | Fix TestDataNodeVolumeFailure on 2.* branches. | Major | . | Konstantin Shvachko | Vinitha Reddy Gankidi
HDFS-10920 | TestStorageMover#testNoSpaceDisk is failing intermittently | Major | test | Rakesh R | Rakesh R
HDFS-10960 | TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove | Minor | hdfs | Manoj Govindassamy | Manoj Govindassamy
HDFS-10752 | Several log refactoring/improvement suggestion in HDFS | Major | . | Nemo Chen | Hanisha Koneru
HDFS-11025 | TestDiskspaceQuotaUpdate fails in trunk due to Bind exception | Minor | . | Yiqun Lin | Yiqun Lin
HDFS-11018 | Incorrect check and message in FsDatasetImpl#invalidate | Major | datanode | Wei-Chiu Chuang | Yiqun Lin
HADOOP-13236 | truncate will fail when we use viewfilesystem | Major | . | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-13749 | KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used | Critical | . | Sergey Shelukhin | Xiaoyu Yao
HDFS-11042 | Add missing cleanupSSLConfig() call for tests that use setupSSLConfig() | Major | test | Kuhu Shukla | Kuhu Shukla
HDFS-11015 | Enforce timeout in balancer | Major | balancer & mover | Kihwal Lee | Kihwal Lee
YARN-5677 | RM should transition to standby when connection is lost for an extended period | Critical | resourcemanager | Daniel Templeton | Daniel Templeton
HDFS-11054 | Suppress verbose log message in BlockPlacementPolicyDefault | Major | . | Arpit Agarwal | Chen Liang
HDFS-11050 | Change log level to ‘warn’ when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR | Major | . | Kuhu Shukla | Kuhu Shukla
HDFS-10921 | TestDiskspaceQuotaUpdate doesn’t wait for NN to get out of safe mode | Major | . | Eric Badger | Eric Badger
HDFS-8492 | DN should notify NN when client requests a missing block | Major | . | Daryn Sharp | Walter Su
MAPREDUCE-6541 | Exclude scheduled reducer memory when calculating available mapper slots from headroom to avoid deadlock | Major | . | Wangda Tan | Varun Saxena
YARN-3848 | TestNodeLabelContainerAllocation is not timing out | Major | test | Jason Lowe | Varun Saxena
HADOOP-13201 | Print the directory paths when ViewFs denies the rename operation on internal dirs | Major | viewfs | Tianyin Xu | Rakesh R
YARN-4831 | Recovered containers will be killed after NM stateful restart | Major | nodemanager | Siqi Li | Siqi Li
YARN-3432 | Cluster metrics have wrong Total Memory when there is reserved memory on CS | Major | capacityscheduler, resourcemanager | Thomas Graves | Brahma Reddy Battula
HDFS-9500 | datanodesSoftwareVersions map may counting wrong when rolling upgrade | Major | . | Phil Yang | Erik Krogen
MAPREDUCE-2631 | Potential resource leaks in BinaryProtocol$TeeOutputStream.java | Major | . | Ravi Teja Ch N V | Sunil Govindan
HADOOP-13770 | Shell.checkIsBashSupported swallowed an interrupted exception | Minor | util | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-5027 | NM should clean up app log dirs after NM restart | Major | nodemanager | sandflee | sandflee
YARN-5767 | Fix the order that resources are cleaned up from the local Public/Private caches | Major | . | Chris Trezzo | Chris Trezzo
HDFS-11061 | Update dfs -count -t command line help and documentation | Minor | documentation, fs | Wei-Chiu Chuang | Yiqun Lin
YARN-5773 | RM recovery too slow due to LeafQueue#activateApplication() | Critical | capacity scheduler, rolling upgrade | Bibin A Chundatt | Bibin A Chundatt
HDFS-10455 | Logging the username when deny the setOwner operation | Minor | namenode | Tianyin Xu | Rakesh R
HADOOP-13773 | wrong HADOOP_CLIENT_OPTS in hadoop-env on branch-2 | Major | conf | Fei Hui | Fei Hui
YARN-5001 | Aggregated Logs root directory is created with wrong group if nonexistent | Major | log-aggregation, nodemanager, security | Haibo Chen | Haibo Chen
YARN-5815 | Random failure of TestApplicationPriority.testOrderOfActivatingThePriorityApplicationOnRMRestart | Major | . | Bibin A Chundatt | Bibin A Chundatt
HDFS-11097 | Fix the jenkins warning related to the deprecated method StorageReceivedDeletedBlocks | Major | . | Yiqun Lin | Yiqun Lin
YARN-5837 | NPE when getting node status of a decommissioned node after an RM restart | Major | . | Robert Kanter | Robert Kanter
HADOOP-13798 | TestHadoopArchives times out | Major | test | Akira Ajisaka | Akira Ajisaka
HADOOP-13797 | Remove hardcoded absolute path for ls | Major | util | Christine Koppelt | Christine Koppelt
HADOOP-13804 | MutableStat mean loses accuracy if add(long, long) is used | Minor | metrics | Erik Krogen | Erik Krogen
HDFS-11128 | CreateEditsLog throws NullPointerException | Major | hdfs | Hanisha Koneru | Hanisha Koneru
HDFS-11129 | TestAppendSnapshotTruncate fails with bind exception | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-13813 | TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing | Major | security, test | Mingliang Liu | Mingliang Liu
HDFS-11087 | NamenodeFsck should check if the output writer is still writable. | Major | namenode | Konstantin Shvachko | Erik Krogen
HDFS-11135 | The tests in TestBalancer run fails due to NPE | Major | test | Yiqun Lin | Yiqun Lin
HDFS-11056 | Concurrent append and read operations lead to checksum error | Major | datanode, httpfs | Wei-Chiu Chuang | Wei-Chiu Chuang
MAPREDUCE-6797 | Job history server scans can become blocked on a single, slow entry | Critical | jobhistoryserver | Prabhu Joseph | Prabhu Joseph
YARN-4355 | NPE while processing localizer heartbeat | Major | nodemanager | Jason Lowe | Varun Saxena
YARN-4218 | Metric for resource*time that was preempted | Major | resourcemanager | Chang Li | Chang Li
YARN-5875 | TestTokenClientRMService#testTokenRenewalWrongUser fails | Major | . | Varun Saxena | Gergely Novák
HADOOP-13815 | TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk | Major | test | Brahma Reddy Battula | Xiao Chen
YARN-5836 | Malicious AM can kill containers of other apps running in any node its containers are running | Minor | nodemanager | Botong Huang | Botong Huang
HDFS-11134 | Fix bind exception threw in TestRenameWhileOpen | Major | . | Yiqun Lin | Yiqun Lin
MAPREDUCE-6801 | Fix flaky TestKill.testKillJob() | Major | mrv2 | Haibo Chen | Haibo Chen
HADOOP-13814 | Sample configuration of KMS HTTP Authentication signature is misleading | Minor | conf, documentation, kms | Masahiro Tanaka | Masahiro Tanaka
HDFS-11144 | TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-11101 | TestDFSShell#testMoveWithTargetPortEmpty fails intermittently | Major | test | Brahma Reddy Battula | Brahma Reddy Battula
YARN-5859 | TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails | Major | test | Jason Lowe | Eric Badger
HADOOP-13663 | Index out of range in SysInfoWindows | Major | native, util | Íñigo Goiri | Íñigo Goiri
HDFS-11174 | Wrong HttpFS test command in doc | Minor | documentation, httpfs | John Zhuge | John Zhuge
HADOOP-13820 | Replace ugi.getUsername() with ugi.getShortUserName() in viewFS | Minor | viewfs | Archana T | Brahma Reddy Battula
HADOOP-13838 | KMSTokenRenewer should close providers | Critical | kms | Xiao Chen | Xiao Chen
HADOOP-13830 | Intermittent failure of ITestS3NContractRootDir#testRecursiveRootListing: “Can not create a Path from an empty string” | Minor | fs/s3, test | Steve Loughran | Steve Loughran
YARN-5915 | ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write | Major | timelineserver | Atul Sikaria | Atul Sikaria
MAPREDUCE-6815 | Fix flaky TestKill.testKillTask() | Major | mrv2 | Haibo Chen | Haibo Chen
HDFS-11181 | Fuse wrapper has a typo | Trivial | fuse-dfs | Wei-Chiu Chuang | Wei-Chiu Chuang
HADOOP-13847 | KMSWebApp should close KeyProviderCryptoExtension | Major | kms | Anthony Young-Garner | John Zhuge
YARN-5559 | Analyse 2.8.0/3.0.0 jdiff reports and fix any issues | Blocker | resourcemanager | Wangda Tan | Akira Ajisaka
HADOOP-13861 | Spelling errors in logging and exceptions for code | Major | common, fs, io, security | Grant Sohn | Grant Sohn
HDFS-11180 | Intermittent deadlock in NameNode when failover happens. | Blocker | namenode | Abhishek Modi | Akira Ajisaka
HDFS-11198 | NN UI should link DN web address using hostnames | Critical | . | Kihwal Lee | Weiwei Yang
MAPREDUCE-6816 | Progress bars in Web UI always at 100% | Blocker | webapps | Shen Yinjie | Shen Yinjie
YARN-5184 | Fix up incompatible changes introduced on ContainerStatus and NodeReport | Blocker | api | Karthik Kambatla | Sangjin Lee
YARN-5921 | Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState | Major | . | Varun Saxena | Varun Saxena
HDFS-11140 | Directory Scanner should log startup message time correctly | Minor | . | Xiao Chen | Yiqun Lin
HDFS-11223 | Fix typos in HttpFs documentations | Trivial | documentation | Yiqun Lin | Yiqun Lin
HDFS-11197 | Listing encryption zones fails when deleting a EZ that is on a snapshotted directory | Minor | hdfs | Wellington Chevreuil | Wellington Chevreuil
HDFS-11224 | Lifeline message should be ignored for dead nodes | Critical | . | Vinayakumar B | Vinayakumar B
HADOOP-13824 | FsShell can suppress the real error if no error message is present | Major | fs | Rob Vesse | John Zhuge
MAPREDUCE-6820 | Fix dead links in Job relevant classes | Minor | documentation | Yiqun Lin | Yiqun Lin
HDFS-8870 | Lease is leaked on write failure | Major | hdfs-client | Rushabh S Shah | Kuhu Shukla
HADOOP-13565 | KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request | Major | security | Xiaoyu Yao | Xiaoyu Yao
HDFS-11229 | HDFS-11056 failed to close meta file | Blocker | datanode | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-10570 | Remove classpath conflicts of netty-all jar in hadoop-hdfs-client | Minor | test | Vinayakumar B | Vinayakumar B
HDFS-10684 | WebHDFS DataNode calls fail without parameter createparent | Blocker | webhdfs | Samuel Low | John Zhuge
HDFS-11204 | Document the missing options of hdfs zkfc command | Minor | documentation | Yiqun Lin | Yiqun Lin
HADOOP-13890 | Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing | Major | test | Brahma Reddy Battula | Xiaoyu Yao
HDFS-11094 | Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter | Major | datanode | Eric Badger | Eric Badger
HDFS-11160 | VolumeScanner reports write-in-progress replicas as corrupt incorrectly | Major | datanode | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-11263 | ClassCastException when we use Bzipcodec for Fsimage compression | Critical | . | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-11195 | Return error when appending files by webhdfs rest api fails | Major | . | Yuanbo Liu | Yuanbo Liu
HDFS-11261 | Document missing NameNode metrics | Minor | documentation | Yiqun Lin | Yiqun Lin
HDFS-11258 | File mtime change could not save to editlog | Critical | . | Jimmy Xiang | Jimmy Xiang
HDFS-11271 | Typo in NameNode UI | Trivial | namenode, ui | Wei-Chiu Chuang | Wei-Chiu Chuang
HDFS-11250 | Fix a typo in ReplicaUnderRecovery#setRecoveryID | Trivial | . | Yiqun Lin | Yiqun Lin
HDFS-11270 | Document the missing options of NameNode bootstrap command | Minor | documentation | Yiqun Lin | Yiqun Lin
HDFS-11252 | TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException | Major | . | Jason Lowe | Yiqun Lin
YARN-6024 | Capacity Scheduler ‘continuous reservation looking’ doesn’t work when sum of queue’s used and reserved resources is equal to max | Major | . | Wangda Tan | Wangda Tan
HADOOP-13883 | Add description of -fs option in generic command usage | Minor | documentation | Yiqun Lin | Yiqun Lin
YARN-6029 | CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by one thread and LeafQueue#assignContainers is releasing excessive reserved container by another thread | Critical | capacityscheduler | Tao Yang | Tao Yang
HADOOP-12733 | Remove references to obsolete io.seqfile configuration variables | Minor | . | Ray Chiang | Ray Chiang
HDFS-11280 | Allow WebHDFS to reuse HTTP connections to NN | Major | hdfs | Zheng Shao | Zheng Shao
MAPREDUCE-6711 | JobImpl fails to handle preemption events on state COMMITTING | Major | . | Li Lu | Prabhu Joseph
HADOOP-13958 | Bump up release year to 2017 | Blocker | . | Junping Du | Junping Du
YARN-6068 | Log aggregation get failed when NM restart even with recovery | Blocker | . | Junping Du | Junping Du
YARN-4148 | When killing app, RM releases app’s resource before they are released by NM | Major | resourcemanager | Jun Gong | Jason Lowe
HDFS-11312 | Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto | Blocker | . | Sean Mackrory | Sean Mackrory
YARN-6072 | RM unable to start in secure mode | Blocker | resourcemanager | Bibin A Chundatt | Ajith S
HDFS-10733 | NameNode terminated after full GC thinking QJM is unresponsive. | Major | namenode, qjm | Konstantin Shvachko | Vinitha Reddy Gankidi
HADOOP-14001 | Improve delegation token validity checking | Major | . | Akira Ajisaka | Akira Ajisaka
HDFS-11376 | Revert HDFS-8377 Support HTTP/2 in datanode | Major | datanode | Andrew Wang | Xiao Chen
YARN-6151 | FS preemption does not consider child queues over fairshare if the parent is under | Major | fairscheduler | Yufei Gu | Yufei Gu
YARN-5271 | ATS client doesn’t work with Jersey 2 on the classpath | Major | client, timelineserver | Steve Loughran | Weiwei Yang
YARN-3933 | FairScheduler: Multiple calls to completedContainer are not safe | Major | fairscheduler | Lavkesh Lahngir | Shiwei Guo
YARN-6177 | Yarn client should exit with an informative error message if an incompatible Jersey library is used at client | Major | . | Weiwei Yang | Weiwei Yang
HDFS-11379 | DFSInputStream may infinite loop requesting block locations | Critical | hdfs-client | Daryn Sharp | Daryn Sharp
HADOOP-14092 | Typo in hadoop-aws index.md | Trivial | fs/s3 | John Zhuge | John Zhuge
HADOOP-13826 | S3A Deadlock in multipart copy due to thread pool limits. | Critical | fs/s3 | Sean Mackrory | Sean Mackrory
HADOOP-14017 | User friendly name for ADLS user and group | Major | fs/adl | John Zhuge | Vishwajeet Dusane
YARN-6175 | FairScheduler: Negative vcore for resource needed to preempt | Major | fairscheduler | Yufei Gu | Yufei Gu
HADOOP-14028 | S3A BlockOutputStreams doesn’t delete temporary files in multipart uploads or handle part upload failures | Critical | fs/s3 | Seth Fitzsimmons | Steve Loughran
YARN-1728 | Workaround guice3x-undecoded pathInfo in YARN WebApp | Major | . | Abraham Elmahrek | Yuanbo Liu
HADOOP-12979 | IOE in S3a: ${hadoop.tmp.dir}/s3a not configured | Major | . | Steve Loughran | Steve Loughran
YARN-6270 | WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA setting | Major | . | Sumana Sathish | Xuan Gong
HDFS-11498 | Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0 | Major | . | Andrew Wang | Andrew Wang
HADOOP-14087 | S3A typo in pom.xml test exclusions | Major | fs/s3 | Aaron Fabbri | Aaron Fabbri
HADOOP-14062 | ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled | Critical | . | Steven Rand | Steven Rand
HDFS-11431 | hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider | Blocker | build, hdfs-client | Steven Rand | Steven Rand
YARN-4925 | ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression | Major | . | Bibin A Chundatt | Bibin A Chundatt
MAPREDUCE-6433 | launchTime may be negative | Major | jobhistoryserver, mrv2 | Allen Wittenauer | zhihai xu
HADOOP-12751 | While using kerberos Hadoop incorrectly assumes names with ‘@’ to be non-simple | Critical | security | Bolke de Bruin | Bolke de Bruin

### TESTS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
MAPREDUCE-6191 | TestJavaSerialization fails with getting incorrect MR job result | Minor | test | sam liu | sam liu
YARN-3339 | TestDockerContainerExecutor should pull a single image and not the entire centos repository | Minor | test | Ravindra Kumar Naik | Ravindra Kumar Naik
YARN-1880 | Cleanup TestApplicationClientProtocolOnHA | Trivial | test | Tsuyoshi Ozawa | Tsuyoshi Ozawa
HDFS-6263 | Remove DRFA.MaxBackupIndex config from log4j.properties | Minor | . | Akira Ajisaka | Abhiraj Butala
HDFS-6408 | Remove redundant definitions in log4j.properties | Minor | test | Abhiraj Butala | Abhiraj Butala
YARN-2666 | TestFairScheduler.testContinuousScheduling fails Intermittently | Major | scheduler | Tsuyoshi Ozawa | zhihai xu
HDFS-8247 | TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing | Major | test | Anu Engineer | Xiaoyu Yao
HADOOP-11881 | test-patch.sh javac result is wildly wrong | Major | build, test | Allen Wittenauer | Kengo Seki
HADOOP-11904 | test-patch.sh goes into an infinite loop on non-maven builds | Critical | test | Allen Wittenauer | Allen Wittenauer
YARN-3343 | TestCapacitySchedulerNodeLabelUpdate.testNodeUpdate sometime fails in trunk | Minor | . | Xuan Gong | Rohith Sharma K S
YARN-3580 | [JDK 8] TestClientRMService.testGetLabelsToNodes fails | Major | test | Robert Kanter | Robert Kanter
HDFS-7559 | Create unit test to automatically compare HDFS related classes and hdfs-default.xml | Minor | . | Ray Chiang | Ray Chiang
HADOOP-11906 | test-patch.sh should use ‘file’ command for patch determinism | Major | . | Allen Wittenauer | Sean Busbey
YARN-3602 | TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup | Minor | test | zhihai xu | zhihai xu
HDFS-8243 | Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. | Minor | test | Ruth Wisniewski | Ruth Wisniewski
HADOOP-11884 | test-patch.sh should pull the real findbugs version | Minor | test | Allen Wittenauer | Kengo Seki
HADOOP-11944 | add option to test-patch to avoid relocating patch process directory | Minor | . | Sean Busbey | Sean Busbey
HADOOP-11949 | Add user-provided plugins to test-patch | Major | . | Sean Busbey | Sean Busbey
HADOOP-12000 | cannot use –java-home in test-patch | Major | scripts | Allen Wittenauer | Allen Wittenauer
MAPREDUCE-6204 | TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS | Minor | test | sam liu | sam liu
HADOOP-12035 | shellcheck plugin displays a wrong version potentially | Trivial | build | Kengo Seki | Kengo Seki
HADOOP-12030 | test-patch should only report on newly introduced findbugs warnings. | Major | . | Sean Busbey | Sean Busbey
HADOOP-11930 | test-patch in offline mode should tell maven to be in offline mode | Major | . | Sean Busbey | Sean Busbey
HADOOP-11965 | determine-flaky-tests needs a summary mode | Minor | . | Allen Wittenauer | Yufei Gu
HDFS-8645 | Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2 | Major | namenode | Zhe Zhang | Zhe Zhang
YARN-2871 | TestRMRestart#testRMRestartGetApplicationList sometime fails in trunk | Minor | . | Ted Yu | zhihai xu
YARN-3956 | Fix TestNodeManagerHardwareUtils fails on Mac | Minor | nodemanager | Varun Vasudev | Varun Vasudev
HDFS-8834 | TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482 | Minor | datanode | Lei (Eddy) Xu | Lei (Eddy) Xu
YARN-3992 | TestApplicationPriority.testApplicationPriorityAllocation fails intermittently | Major | . | Zhijie Shen | Sunil Govindan
HDFS-2070 | Add more unit tests for FsShell getmerge | Major | test | XieXianshan | Daniel Templeton
MAPREDUCE-5045 | UtilTest#isCygwin method appears to be unused | Trivial | contrib/streaming, test | Chris Nauroth | Neelesh Srinivas Salian
YARN-3573 | MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated | Major | timelineserver | Mit Desai | Brahma Reddy Battula
HDFS-9295 | Add a thorough test of the full KMS code path | Critical | security, test | Daniel Templeton | Daniel Templeton
HDFS-9339 | Extend full test of KMS ACLs | Major | test | Daniel Templeton | Daniel Templeton
HDFS-9354 | Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows | Major | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-9410 | Some tests should always reset sysout and syserr | Minor | test | Xiao Chen | Xiao Chen
HADOOP-12564 | Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package | Trivial | test | Dustin Cote | Dustin Cote
HDFS-9153 | Pretty-format the output for DFSIO | Major | . | Kai Zheng | Kai Zheng
HDFS-9429 | Tests in TestDFSAdminWithHA intermittently fail with EOFException | Major | test | Xiao Chen | Xiao Chen
HADOOP-10729 | Add tests for PB RPC in case version mismatch of client and server | Major | ipc | Junping Du | Junping Du
HDFS-7553 | fix the TestDFSUpgradeWithHA due to BindException | Major | test | Liang Xie | Xiao Chen
HDFS-9626 | TestBlockReplacement#testBlockReplacement fails occasionally | Minor | test | Xiao Chen | Xiao Chen
HADOOP-12696 | Add Tests for S3FileSystem Contract | Major | tools | Matthew Paduano | Matthew Paduano
MAPREDUCE-6614 | Remove unnecessary code in TestMapreduceConfigFields | Minor | test | Akira Ajisaka | Kai Sasaki
HADOOP-12736 | TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out | Major | . | Xiao Chen | Xiao Chen
HADOOP-12715 | TestValueQueue#testgetAtMostPolicyALL fails intermittently | Major | . | Xiao Chen | Xiao Chen
HDFS-9773 | Remove dead code related to SimulatedFSDataset in tests | Minor | test | Akira Ajisaka | Brahma Reddy Battula
HDFS-9888 | Allow reseting KerberosName in unit tests | Minor | . | Xiao Chen | Xiao Chen
YARN-4717 | TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup | Minor | nodemanager | Daniel Templeton | Daniel Templeton
HDFS-9949 | Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared | Minor | . | Harsh J | Harsh J
HADOOP-12738 | Create unit test to automatically compare Common related classes and core-default.xml | Minor | . | Ray Chiang | Ray Chiang
HADOOP-12101 | Add automatic search of default Configuration variables to TestConfigurationFieldsBase | Major | test | Ray Chiang | Ray Chiang
YARN-4947 | Test timeout is happening for TestRMWebServicesNodes | Major | test | Bibin A Chundatt | Bibin A Chundatt
YARN-5069 | TestFifoScheduler.testResourceOverCommit race condition | Major | test | Eric Badger | Eric Badger
YARN-5114 | Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8 | Minor | . | Bibin A Chundatt | Bibin A Chundatt
HDFS-10375 | Remove redundant TestMiniDFSCluster.testDualClusters | Trivial | test | John Zhuge | Jiayi Zhou
YARN-5023 | TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry random failure | Major | . | Bibin A Chundatt | sandflee
YARN-5318 | TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider fails intermittently. | Minor | . | sandflee | Jun Gong
YARN-5037 | TestRMRestart#testQueueMetricsOnRMRestart random failure | Major | . | sandflee | sandflee
YARN-5317 | testAMRestartNotLostContainerCompleteMsg may fail | Minor | . | sandflee | sandflee
YARN-5159 | Wrong Javadoc tag in MiniYarnCluster | Major | documentation | Andras Bokor | Andras Bokor
MAPREDUCE-6738 | TestJobListCache.testAddExisting failed intermittently in slow VM testbed | Minor | . | Junping Du | Junping Du
YARN-5092 | TestRMDelegationTokens fails intermittently | Major | test | Rohith Sharma K S | Jason Lowe
HADOOP-10980 | TestActiveStandbyElector fails occasionally in trunk | Minor | . | Ted Yu | Eric Badger
HADOOP-13395 | Enhance TestKMSAudit | Minor | kms | Xiao Chen | Xiao Chen
YARN-5492 | TestSubmitApplicationWithRMHA is failing sporadically during precommit builds | Major | test | Jason Lowe | Vrushali C
YARN-5544 | TestNodeBlacklistingOnAMFailures fails on trunk | Major | test | Varun Saxena | Sunil Govindan
HDFS-9745 | TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts | Minor | . | Xiao Chen | Xiao Chen
YARN-5389 | TestYarnClient#testReservationDelete fails | Major | . | Rohith Sharma K S | Sean Po
YARN-5560 | Clean up bad exception catching practices in TestYarnClient | Major | . | Sean Po | Sean Po
HDFS-10657 | testAclCLI.xml setfacl test should expect mask r-x | Minor | . | John Zhuge | John Zhuge
HDFS-9333 | Some tests using MiniDFSCluster errored complaining port in use | Minor | test | Kai Zheng | Masatake Iwasaki
HADOOP-13686 | Adding additional unit test for Trash (I) | Major | . | Xiaoyu Yao | Weiwei Yang
YARN-3568 | TestAMRMTokens should use some random port | Major | test | Gera Shegalov | Takashi Ohnishi
MAPREDUCE-6804 | Add timeout when starting JobHistoryServer in MiniMRYarnCluster | Minor | test | Andras Bokor | Andras Bokor
HDFS-11272 | Refine the assert messages in TestFSDirAttrOp | Minor | test | Akira Ajisaka | Jimmy Xiang
HDFS-11278 | Add missing @Test annotation for TestSafeMode.testSafeModeUtils() | Trivial | namenode | Lukas Majercak | Lukas Majercak
YARN-5608 | TestAMRMClient.setup() fails with ArrayOutOfBoundsException | Major | test | Daniel Templeton | Daniel Templeton

### SUB-TASKS:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-3356 | Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. | Major | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan
YARN-3345 | Add non-exclusive node label API to RMAdmin protocol and NodeLabelsManager | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
HDFS-7854 | Separate class DataStreamer out of DFSOutputStream | Major | hdfs-client | Li Bo | Li Bo
HDFS-7713 | Implement mkdirs in the HDFS Web UI | Major | ui | Ravi Prakash | Ravi Prakash
YARN-2495 | Allow admin specify labels from each NM (Distributed configuration) | Major | resourcemanager | Wangda Tan | Naganarasimha G R
HDFS-7893 | Update the POM to create a separate hdfs-client jar | Major | build | Haohui Mai | Haohui Mai
YARN-3365 | Add support for using the ‘tc’ tool via container-executor | Major | nodemanager | Sidharta Seethana | Sidharta Seethana
HDFS-8034 | Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao
YARN-3110 | Few issues in ApplicationHistory web ui | Minor | applications, timelineserver | Bibin A Chundatt | Naganarasimha G R
HDFS-8049 | Annotation client implementation as private | Major | hdfs-client | Tsz Wo Nicholas Sze | Takuya Fukudome
HDFS-8079 | Separate the client retry conf from DFSConfigKeys | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8080 | Separate JSON related routines used by WebHdfsFileSystem to a package local class | Minor | hdfs-client | Haohui Mai | Haohui Mai
HDFS-8085 | Move CorruptFileBlockIterator to the hdfs.client.impl package | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8089 | Move o.a.h.hdfs.web.resources.* to the client jars | Minor | build | Haohui Mai | Haohui Mai
HDFS-8102 | Separate webhdfs retry configuration keys from DFSConfigKeys | Minor | hdfs-client | Haohui Mai | Haohui Mai
YARN-1376 | NM need to notify the log aggregation status to RM through Node heartbeat | Major | . | Xuan Gong | Xuan Gong
HDFS-8100 | Refactor DFSClient.Conf to a standalone class | Minor | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8103 | Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifier | Minor | security | Haohui Mai | Haohui Mai
HDFS-8084 | Separate the client failover conf from DFSConfigKeys | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8083 | Separate the client write conf from DFSConfigKeys | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-3347 | Improve YARN log command to get AMContainer logs as well as running containers logs | Major | log-aggregation | Xuan Gong | Xuan Gong
YARN-3443 | Create a ‘ResourceHandler’ subsystem to ease addition of support for new resource types on the NM | Major | nodemanager | Sidharta Seethana | Sidharta Seethana
HDFS-7701 | Support reporting per storage type quota and usage with hadoop/hdfs shell | Major | datanode, namenode | Xiaoyu Yao | Peter Shi
YARN-3361 | CapacityScheduler side changes to support non-exclusive node labels | Major | capacityscheduler | Wangda Tan | Wangda Tan
YARN-3318 | Create Initial OrderingPolicy Framework and FifoOrderingPolicy | Major | scheduler | Craig Welch | Craig Welch
YARN-3326 | Support RESTful API for getLabelsToNodes | Minor | resourcemanager | Naganarasimha G R | Naganarasimha G R
YARN-3354 | Container should contains node-labels asked by original ResourceRequests | Major | api, capacityscheduler, nodemanager, resourcemanager | Wangda Tan | Wangda Tan
HDFS-8082 | Separate the client read conf from DFSConfigKeys | Major | hdfs-client | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8165 | Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client | Major | build | Haohui Mai | Haohui Mai
YARN-1402 | Related Web UI, CLI changes on exposing client API to check log aggregation status | Major | . | Xuan Gong | Xuan Gong
YARN-2696 | Queue sorting in CapacityScheduler should consider node label | Major | capacityscheduler, resourcemanager | Wangda Tan | Wangda Tan
YARN-3487 | CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue | Critical | capacityscheduler | Jason Lowe | Jason Lowe
YARN-3136 | getTransferredContainers can be a bottleneck during AM registration | Major | scheduler | Jason Lowe | Sunil Govindan
HDFS-8169 | Move LocatedBlocks and related classes to hdfs-client | Major | build, hdfs-client | Haohui Mai | Haohui Mai
YARN-3463 | Integrate OrderingPolicy Framework with CapacityScheduler | Major | capacityscheduler | Craig Welch | Craig Welch
HDFS-8185 | Separate client related routines in HAUtil into a new class | Major | build, hdfs-client | Haohui Mai | Haohui Mai
YARN-3225 | New parameter or CLI for decommissioning node gracefully in RMAdmin CLI | Major | graceful | Junping Du | Devaraj K
HDFS-8218 | Move classes that used by ClientProtocol into hdfs-client | Major | build | Haohui Mai | Haohui Mai
YARN-3366 | Outbound network bandwidth : classify/shape traffic originating from YARN containers | Major | . | Sidharta Seethana | Sidharta Seethana
YARN-2605 | [RM HA] Rest api endpoints doing redirect incorrectly | Major | resourcemanager | bc Wong | Xuan Gong
YARN-3319 | Implement a FairOrderingPolicy | Major | scheduler | Craig Welch | Craig Welch
YARN-3413 | Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn’t be changeable at runtime | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
YARN-2498 | Respect labels in preemption policy of capacity scheduler for inter-queue preemption | Major | resourcemanager | Wangda Tan | Wangda Tan
YARN-2740 | Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled | Major | resourcemanager | Wangda Tan | Naganarasimha G R
YARN-3544 | AM logs link missing in the RM UI for a completed app | Blocker | . | Hitesh Shah | Xuan Gong
YARN-2619 | NodeManager: Add cgroups support for disk I/O isolation | Major | . | Wei Yan | Varun Vasudev
HDFS-8086 | Move LeaseRenewer to the hdfs.client.impl package | Minor | hdfs-client | Tsz Wo Nicholas Sze | Takanobu Asanuma
YARN-3006 | Improve the error message when attempting manual failover with auto-failover enabled | Minor | . | Akira Ajisaka | Akira Ajisaka
HDFS-8249 | Separate HdfsConstants into the client and the server side class | Major | hdfs-client | Haohui Mai | Haohui Mai
HDFS-8309 | Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows | Minor | test | Xiaoyu Yao | Xiaoyu Yao
HDFS-8237 | Move all protocol classes used by ClientProtocol to hdfs-client | Major | build | Haohui Mai | Haohui Mai
HDFS-8314 | Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users | Major | . | Haohui Mai | Li Lu
HDFS-8310 | Fix TestCLI.testAll ‘help: help for find’ on Windows | Minor | test | Xiaoyu Yao | Kiran Kumar M R
YARN-3301 | Fix the format issue of the new RM web UI and AHS web UI after YARN-3272 / YARN-3262 | Major | resourcemanager | Xuan Gong | Xuan Gong
YARN-3448 | Add Rolling Time To Lives Level DB Plugin Capabilities | Major | timelineserver | Jonathan Eagles | Jonathan Eagles
YARN-2918 | Don’t fail RM if queue’s configured labels are not existed in cluster-node-labels | Major | resourcemanager | Rohith Sharma K S | Wangda Tan
YARN-644 | Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer | Minor | nodemanager | Omkar Vinit Joshi | Varun Saxena
YARN-3593 | Add label-type and Improve “DEFAULT_PARTITION” in Node Labels Page | Major | webapp | Naganarasimha G R | Naganarasimha G R
YARN-2331 | Distinguish shutdown during supervision vs. shutdown for rolling upgrade | Major | nodemanager | Jason Lowe | Jason Lowe
YARN-3579 | CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings | Minor | resourcemanager | Sunil Govindan | Sunil Govindan
YARN-3505 | Node’s Log Aggregation Report with SUCCEED should not cached in RMApps | Critical | log-aggregation | Junping Du | Xuan Gong
HDFS-8403 | Eliminate retries in TestFileCreation#testOverwriteOpenForWrite | Major | test | Arpit Agarwal | Arpit Agarwal
HDFS-8157 | Writes to RAM DISK reserve locked memory for block files | Major | datanode | Arpit Agarwal | Arpit Agarwal
YARN-3541 | Add version info on timeline service / generic history web UI and REST API | Major | timelineserver | Zhijie Shen | Zhijie Shen
YARN-3565 | NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String | Blocker | api, client, resourcemanager | Wangda Tan | Naganarasimha G R
YARN-3583 | Support of NodeLabel object instead of plain String in YarnClient side. | Major | client | Sunil Govindan | Sunil Govindan
YARN-3609 | Move load labels from storage from serviceInit to serviceStart to make it works with RM HA case. | Major | resourcemanager | Wangda Tan | Wangda Tan
YARN-3684 | Change ContainerExecutor’s primary lifecycle methods to use a more extensible mechanism for passing information. | Major | yarn | Sidharta Seethana | Sidharta Seethana
HDFS-8454 | Remove unnecessary throttling in TestDatanodeDeath | Major | test | Arpit Agarwal | Arpit Agarwal
YARN-3632 | Ordering policy should be allowed to reorder an application when demand changes | Major | capacityscheduler | Craig Welch | Craig Welch
YARN-3686 | CapacityScheduler should trim default_node_label_expression | Critical | api, client, resourcemanager | Wangda Tan | Sunil Govindan
YARN-3647 | RMWebServices api’s should use updated api from CommonNodeLabelsManager to get NodeLabel object | Major | resourcemanager | Sunil Govindan | Sunil Govindan
YARN-3581 | Deprecate -directlyAccessNodeLabelStore in RMAdminCLI | Major | api, client, resourcemanager | Wangda Tan | Naganarasimha G R
HDFS-8482 | Rename BlockInfoContiguous to BlockInfo | Major | . | Zhe Zhang | Zhe Zhang
YARN-3700 | ATS Web Performance issue at load time when large number of jobs | Major | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong
YARN-3716 | Node-label-expression should be included by ResourceRequestPBImpl.toString | Minor | api | Xianyin Xin | Xianyin Xin
YARN-3740 | Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS | Major | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong
YARN-2900 | Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500) | Major | timelineserver | Jonathan Eagles | Mit Desai
HDFS-8489 | Subclass BlockInfo to represent contiguous blocks | Major | namenode | Zhe Zhang | Zhe Zhang
YARN-2392 | add more diags about app retry limits on AM failures | Minor | resourcemanager | Steve Loughran | Steve Loughran
YARN-3766 | ATS Web UI breaks because of YARN-3467 | Blocker | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong
YARN-1462 | AHS API and other AHS changes to handle tags for completed MR jobs | Major | . | Karthik Kambatla | Xuan Gong
YARN-3787 | loading applications by filtering appstartedTime period for ATS Web UI | Major | resourcemanager, webapp, yarn | Xuan Gong | Xuan Gong
HDFS-7923 | The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages | Major | . | Colin P. McCabe | Colin P. McCabe
HDFS-8540 | Mover should exit with NO_MOVE_BLOCK if no block can be moved | Major | balancer & mover | Tsz Wo Nicholas Sze | Surendra Singh Lilhore
YARN-3711 | Documentation of ResourceManager HA should explain configurations about listen addresses | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HDFS-8597 | Fix TestFSImage#testZeroBlockSize on Windows | Major | datanode, test | Xiaoyu Yao | Xiaoyu Yao
HDFS-7164 | Feature documentation for HDFS-6581 | Major | documentation | Arpit Agarwal | Arpit Agarwal
HDFS-8238 | Move ClientProtocol to the hdfs-client | Major | build | Haohui Mai | Takanobu Asanuma
HDFS-6249 | Output AclEntry in PBImageXmlWriter | Minor | tools | Akira Ajisaka | Surendra Singh Lilhore
YARN-3521 | Support return structured NodeLabel objects in REST API | Major | api, client, resourcemanager | Wangda Tan | Sunil Govindan
HDFS-8192 | Eviction should key off used locked memory instead of ram disk free space | Major | datanode | Arpit Agarwal | Arpit Agarwal
HDFS-8651 | Make hadoop-hdfs-project Native code -Wall-clean | Major | native | Alan Burlison | Alan Burlison
HADOOP-12036 | Consolidate all of the cmake extensions in one directory | Major | . | Allen Wittenauer | Alan Burlison
HDFS-7390 | Provide JMX metrics per storage type | Major | . | Benoy Antony | Benoy Antony
HADOOP-12104 | Migrate Hadoop Pipes native build to new CMake framework | Major | build | Alan Burlison | Alan Burlison
HADOOP-12112 | Make hadoop-common-project Native code -Wall-clean | Major | native | Alan Burlison | Alan Burlison
HDFS-8493 | Consolidate truncate() related implementation in a single class | Major | . | Haohui Mai | Rakesh R
HDFS-8635 | Migrate HDFS native build to new CMake framework | Major | build | Alan Burlison | Alan Burlison
YARN-3827 | Migrate YARN native build to new CMake framework | Major | build | Alan Burlison | Alan Burlison
MAPREDUCE-6376 | Add avro binary support for jhist files | Major | jobhistoryserver | Ray Chiang | Ray Chiang
HDFS-8620 | Clean up the checkstyle warinings about ClientProtocol | Major | . | Takanobu Asanuma | Takanobu Asanuma
HDFS-8726 | Move protobuf files that define the client-sever protocols to hdfs-client | Major | build | Haohui Mai | Haohui Mai
YARN-1012 | Report NM aggregated container resource utilization in heartbeat | Major | nodemanager | Arun C Murthy | Íñigo Goiri
YARN-3800 | Reduce storage footprint for ReservationAllocation | Major | capacityscheduler, fairscheduler, resourcemanager | Anubhav Dhoot | Anubhav Dhoot
YARN-3445 | Cache runningApps in RMNode for getting running apps on given NodeId | Major | nodemanager, resourcemanager | Junping Du | Junping Du
YARN-3116 | [Collector wireup] We need an assured way to determine if a container is an AM container on NM | Major | nodemanager, timelineserver | Zhijie Shen | Giovanni Matteo Fumarola
HDFS-8541 | Mover should exit with NO_MOVE_PROGRESS if there is no move progress | Minor | balancer & mover | Tsz Wo Nicholas Sze | Surendra Singh Lilhore
HDFS-8742 | Inotify: Support event for OP_TRUNCATE | Major | namenode | Surendra Singh Lilhore | Surendra Singh Lilhore
YARN-1449 | AM-NM protocol changes to support container resizing | Major | api | Wangda Tan (No longer used) | MENG DING
HADOOP-11974 | Fix FIONREAD #include on Solaris | Minor | net | Alan Burlison | Alan Burlison
YARN-3930 | FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown | Major | api, client, resourcemanager | Dian Fu | Dian Fu
YARN-3844 | Make hadoop-yarn-project Native code -Wall-clean | Major | build | Alan Burlison | Alan Burlison
HDFS-8794 | Improve CorruptReplicasMap#corruptReplicasMap | Major | . | Yi Liu | Yi Liu
HDFS-7483 | Display information per tier on the Namenode UI | Major | . | Benoy Antony | Benoy Antony
YARN-2003 | Support for Application priority : Changes in RM and Capacity Scheduler | Major | resourcemanager | Sunil Govindan | Sunil Govindan
HDFS-8721 | Add a metric for number of encryption zones | Major | encryption | Rakesh R | Rakesh R
YARN-1645 | ContainerManager implementation to support container resizing | Major | nodemanager | Wangda Tan | MENG DING
HDFS-8495 | Consolidate append() related implementation into a single class | Major | namenode | Rakesh R | Rakesh R
HDFS-8795 | Improve InvalidateBlocks#node2blocks | Major | . | Yi Liu | Yi Liu
HADOOP-12184 | Remove unused Linux-specific constants in NativeIO | Major | native | Martin Walsh | Martin Walsh
HDFS-8730 | Clean up the import statements in ClientProtocol | Minor | . | Takanobu Asanuma | Takanobu Asanuma
YARN-3969 | Allow jobs to be submitted to reservation that is active but does not have any allocations | Major | capacityscheduler, fairscheduler, resourcemanager | Subru Krishnan | Subru Krishnan
HADOOP-12170 | hadoop-common’s JNIFlags.cmake is redundant and can be removed | Minor | native | Alan Burlison | Alan Burlison
YARN-3656 | LowCost: A Cost-Based Placement Agent for YARN Reservations | Major | capacityscheduler, resourcemanager | Ishai Menache | Jonathan Yaniv
YARN-3852 | Add docker container support to container-executor | Major | yarn | Sidharta Seethana | Abin Shahab
YARN-3853 | Add docker container runtime support to LinuxContainterExecutor | Major | yarn | Sidharta Seethana | Sidharta Seethana
YARN-3867 | ContainerImpl changes to support container resizing | Major | nodemanager | MENG DING | MENG DING
HDFS-7192 | DN should ignore lazyPersist hint if the writer is not local | Major | datanode | Arpit Agarwal | Arpit Agarwal
YARN-433 | When RM is catching up with node updates then it should not expire acquired containers | Major | resourcemanager | Bikas Saha | Xuan Gong
MAPREDUCE-6394 | Speed up Task processing loop in HsTasksBlock#render() | Major | jobhistoryserver | Ray Chiang | Ray Chiang
HADOOP-7824 | NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values | Major | native | Dmytro Shteflyuk | Martin Walsh
YARN-3543 | ApplicationReport should be able to tell whether the Application is AM managed or not. | Major | api | Spandan Dutta | Rohith Sharma K S
YARN-4004 | container-executor should print output of docker logs if the docker container exits with non-0 exit status | Major | nodemanager | Varun Vasudev | Varun Vasudev
YARN-3736 | Add RMStateStore apis to store and load accepted reservations for failover | Major | capacityscheduler, fairscheduler, resourcemanager | Subru Krishnan | Anubhav Dhoot
YARN-1643 | Make ContainersMonitor can support change monitoring size of an allocated container in NM side | Major | nodemanager | Wangda Tan | MENG DING
YARN-3974 | Refactor the reservation system test cases to use parameterized base test | Major | capacityscheduler, fairscheduler | Subru Krishnan | Subru Krishnan
YARN-3948 | Display Application Priority in RM Web UI | Major | webapp | Sunil Govindan | Sunil Govindan
YARN-3873 | pendingApplications in LeafQueue should also use OrderingPolicy | Major | capacityscheduler | Sunil Govindan | Sunil Govindan
YARN-3887 | Support for changing Application priority during runtime | Major | capacityscheduler, resourcemanager | Sunil Govindan | Sunil Govindan
HDFS-8805 | Archival Storage: getStoragePolicy should not need superuser privilege | Major | balancer & mover, namenode | Hui Zheng | Brahma Reddy Battula
HDFS-8052 | Move WebHdfsFileSystem into hadoop-hdfs-client | Major | build | Haohui Mai | Haohui Mai
YARN-4023 | Publish Application Priority to TimelineServer | Major | timelineserver | Sunil Govindan | Sunil Govindan
HDFS-8824 | Do not use small blocks for balancing the cluster | Major | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-3534 | Collect memory/cpu usage on the node | Major | nodemanager, resourcemanager | Íñigo Goiri | Íñigo Goiri
HDFS-8801 | Convert BlockInfoUnderConstruction as a feature | Major | namenode | Zhe Zhang | Jing Zhao
HDFS-8792 | BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory | Major | . | Yi Liu | Yi Liu
HDFS-8862 | BlockManager#excessReplicateMap should use a HashMap | Major | namenode | Yi Liu | Yi Liu
HDFS-8278 | HDFS Balancer should consider remaining storage % when checking for under-utilized machines | Major | balancer & mover | Gopal V | Tsz Wo Nicholas Sze
HDFS-8826 | Balancer may not move blocks efficiently in some cases | Major | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
HDFS-8803 | Move DfsClientConf to hdfs-client | Major | build | Haohui Mai | Mingliang Liu
YARN-2923 | Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup | Major | nodemanager | Naganarasimha G R | Naganarasimha G R
YARN-1644 | RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing | Major | nodemanager | Wangda Tan | MENG DING
YARN-3868 | ContainerManager recovery for container resizing | Major | nodemanager | MENG DING | MENG DING
HDFS-8823 | Move replication factor into individual blocks | Major | . | Haohui Mai | Haohui Mai
YARN-221 | NM should provide a way for AM to tell it not to aggregate logs. | Major | log-aggregation, nodemanager | Robert Joseph Evans | Ming Ma
HDFS-8934 | Move ShortCircuitShm to hdfs-client | Major | build | Mingliang Liu | Mingliang Liu
HDFS-8948 | Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure | Major | build | Mingliang Liu | Mingliang Liu
YARN-4014 | Support user cli interface in for Application Priority | Major | client, resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HDFS-8951 | Move the shortcircuit package to hdfs-client | Major | build | Mingliang Liu | Mingliang Liu
HDFS-8248 | Store INodeId instead of the INodeFile object in BlockInfoContiguous | Major | . | Haohui Mai | Haohui Mai
HDFS-8962 | Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf | Major | build | Mingliang Liu | Mingliang Liu
YARN-3250 | Support admin cli interface in for Application Priority | Major | resourcemanager | Sunil Govindan | Rohith Sharma K S
HDFS-8925 | Move BlockReaderLocal to hdfs-client | Major | build | Mingliang Liu | Mingliang Liu
HDFS-8980 | Remove unnecessary block replacement in INodeFile | Major | namenode | Jing Zhao | Jing Zhao
HDFS-8990 | Move RemoteBlockReader to hdfs-client module | Major | build | Mingliang Liu | Mingliang Liu
YARN-4092 | RM HA UI redirection needs to be fixed when both RMs are in standby mode | Major | resourcemanager | Xuan Gong | Xuan Gong
YARN-4082 | Container shouldn’t be killed when node’s label updated. | Major | capacity scheduler | Wangda Tan | Wangda Tan
YARN-2801 | Add documentation for node labels feature | Major | documentation | Gururaj Shetty | Wangda Tan
YARN-3893 | Both RM in active state when Admin#transitionToActive failure from refeshAll() | Critical | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-8890 | Allow admin to specify which blockpools the balancer should run on | Major | balancer & mover | Chris Trezzo | Chris Trezzo
YARN-4101 | RM should print alert messages if Zookeeper and Resourcemanager gets connection issue | Critical | yarn | Yesha Vora | Xuan Gong
YARN-3970 | REST api support for Application Priority | Major | webapp | Sunil Govindan | Naganarasimha G R
HDFS-9002 | Move o.a.h.hdfs.net/*Peer classes to hdfs-client | Major | build | Mingliang Liu | Mingliang Liu
HDFS-9012 | Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module | Major | build | Mingliang Liu | Mingliang Liu
HDFS-8984 | Move replication queues related methods in FSNamesystem to BlockManager | Major | . | Haohui Mai | Haohui Mai
YARN-2884 | Proxying all AM-RM communications | Major | nodemanager, resourcemanager | Carlo Curino | Kishore Chaliparambil
YARN-4136 | LinuxContainerExecutor loses info when forwarding ResourceHandlerException | Trivial | nodemanager | Steve Loughran | Bibin A Chundatt
HDFS-9041 | Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client | Major | build | Haohui Mai | Mingliang Liu
HDFS-9010 | Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key | Major | build | Mingliang Liu | Mingliang Liu
YARN-1651 | CapacityScheduler side changes to support increase/decrease container resource. | Major | resourcemanager, scheduler | Wangda Tan | Wangda Tan
YARN-313 | Add Admin API for supporting node resource configuration in command line | Critical | client, graceful | Junping Du | Íñigo Goiri
HDFS-9008 | Balancer#Parameters class could use a builder pattern | Minor | balancer & mover | Chris Trezzo | Chris Trezzo
YARN-3635 | Get-queue-mapping should be a common interface of YarnScheduler | Major | scheduler | Wangda Tan | Tan, Wangda
YARN-3717 | Expose app/am/queue’s node-label-expression to RM web UI / CLI / REST-API | Major | . | Naganarasimha G R | Naganarasimha G R
HDFS-7986 | Allow files / directories to be deleted from the NameNode UI | Major | ui | Ravi Prakash | Ravi Prakash
HDFS-7995 | Implement chmod in the HDFS Web UI | Major | ui | Ravi Prakash | Ravi Prakash
YARN-4034 | Render cluster Max Priority in scheduler metrics in RM web UI | Minor | resourcemanager, webapp | Rohith Sharma K S | Rohith Sharma K S
HDFS-9022 | Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client | Major | hdfs-client | Mingliang Liu | Mingliang Liu
YARN-4171 | Resolve findbugs/javac warnings in YARN-1197 branch | Major | api, nodemanager, resourcemanager | Wangda Tan | Wangda Tan
YARN-3212 | RMNode State Transition Update with DECOMMISSIONING state | Major | graceful, resourcemanager | Junping Du | Junping Du
HDFS-9101 | Remove deprecated NameNode.getUri() static helper method | Major | . | Mingliang Liu | Mingliang Liu
HDFS-9004 | Add upgrade domain to DatanodeInfo | Major | . | Ming Ma | Ming Ma
HDFS-9111 | Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient | Major | . | Mingliang Liu | Mingliang Liu
HDFS-9039 | Separate client and server side methods of o.a.h.hdfs.NameNodeProxies | Major | . | Mingliang Liu | Mingliang Liu
HDFS-8733 | Keep server related definition in hdfs.proto on server side | Major | . | Yi Liu | Mingliang Liu
HDFS-9131 | Move config keys used by hdfs-client to HdfsClientConfigKeys | Major | . | Mingliang Liu | Mingliang Liu
HDFS-7529 | Consolidate encryption zone related implementation into a single class | Major | . | Haohui Mai | Rakesh R
HDFS-9134 | Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants | Major | . | Mingliang Liu | Mingliang Liu
HADOOP-11918 | Listing an empty s3a root directory throws FileNotFound. | Minor | fs/s3 | Lei (Eddy) Xu | Lei (Eddy) Xu
HDFS-8053 | Move DFSIn/OutputStream and related classes to hadoop-hdfs-client | Major | build | Haohui Mai | Mingliang Liu
HDFS-8740 | Move DistributedFileSystem to hadoop-hdfs-client | Major | build | Yi Liu | Mingliang Liu
YARN-4141 | Runtime Application Priority change should not throw exception for applications at finishing states | Major | resourcemanager | Sunil Govindan | Sunil Govindan
HDFS-9165 | Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client | Major | build | Haohui Mai | Mingliang Liu
HDFS-9166 | Move hftp / hsftp filesystem to hfds-client | Major | build | Haohui Mai | Mingliang Liu
HDFS-8971 | Remove guards when calling LOG.debug() and LOG.trace() in client package | Major | build | Mingliang Liu | Mingliang Liu
HDFS-9015 | Refactor TestReplicationPolicy to test different block placement policies | Major | . | Ming Ma | Ming Ma
YARN-1897 | CLI and core support for signal container functionality | Major | api | Ming Ma | Ming Ma
HDFS-9158 | [OEV-Doc] : Document does not mention about “-f” and “-r” options | Major | . | nijel | nijel
HDFS-9155 | OEV should treat .XML files as XML even when the file name extension is uppercase | Major | . | nijel | nijel
YARN-4215 | RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request | Major | resourcemanager | Naganarasimha G R | Naganarasimha G R
HDFS-9170 | Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client | Major | . | Haohui Mai | Haohui Mai
HDFS-9159 | [OIV] : return value of the command is not correct if invalid value specified in “-p (processor)” option | Major | . | nijel | nijel
YARN-3964 | Support NodeLabelsProvider at Resource Manager side | Major | . | Dian Fu | Dian Fu
YARN-4230 | Increasing container resource while there is no headroom left will cause ResourceManager to crash | Critical | resourcemanager | MENG DING | MENG DING
HDFS-9006 | Provide BlockPlacementPolicy that supports upgrade domain | Major | . | Ming Ma | Ming Ma
HDFS-9160 | [OIV-Doc] : Missing details of “delimited” for processor options | Major | . | nijel | nijel
HDFS-9167 | Update pom.xml in other modules to depend on hdfs-client instead of hdfs | Major | build | Haohui Mai | Mingliang Liu
YARN-4255 | container-executor does not clean up docker operation command files. | Minor | . | Sidharta Seethana | Sidharta Seethana
HDFS-9223 | Code cleanup for DatanodeDescriptor and HeartbeatManager | Minor | namenode | Jing Zhao | Jing Zhao
YARN-4258 | Add support for controlling capabilities for docker containers | Major | yarn | Sidharta Seethana | Sidharta Seethana
HDFS-9157 | [OEV and OIV] : Unnecessary parsing for mandatory arguements if “-h” option is specified as the only option | Major | . | nijel | nijel
HADOOP-12475 | Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client | Major | conf, io, ipc | Walter Su | Walter Su
YARN-4162 | CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API | Major | api, client, resourcemanager | Naganarasimha G R | Naganarasimha G R
YARN-4170 | AM need to be notified with priority in AllocateResponse | Major | resourcemanager | Sunil Govindan | Sunil Govindan
YARN-2556 | Tool to measure the performance of the timeline server | Major | timelineserver | Jonathan Eagles | Chang Li
YARN-4262 | Allow whitelisted users to run privileged docker containers. | Major | yarn | Sidharta Seethana | Sidharta Seethana
YARN-4267 | Add additional logging to container launch implementations in container-executor | Major | yarn | Sidharta Seethana | Sidharta Seethana
YARN-3985 | Make ReservationSystem persist state using RMStateStore reservation APIs | Major | resourcemanager | Anubhav Dhoot | Anubhav Dhoot
YARN-2513 | Host framework UIs in YARN for use with the ATS | Major | timelineserver | Jonathan Eagles | Jonathan Eagles
YARN-3739 | Add reservation system recovery to RM recovery process | Major | capacityscheduler, fairscheduler, resourcemanager | Subru Krishnan | Subru Krishnan
YARN-4243 | Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit | Major | resourcemanager | Xuan Gong | Xuan Gong
YARN-3738 | Add support for recovery of reserved apps running under dynamic queues | Major | capacityscheduler, resourcemanager | Subru Krishnan | Subru Krishnan
YARN-3724 | Use POSIX nftw(3) instead of fts(3) | Major | . | Malcolm Kavalsky | Alan Burlison
YARN-2729 | Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup | Major | nodemanager | Naganarasimha G R | Naganarasimha G R
HDFS-9304 | Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses | Major | build | Mingliang Liu | Mingliang Liu
YARN-3216 | Max-AM-Resource-Percentage should respect node labels | Critical | resourcemanager | Wangda Tan | Sunil Govindan
HADOOP-12457 | [JDK8] Fix a failure of compiling common by javadoc | Major | . | Tsuyoshi Ozawa | Akira Ajisaka
HDFS-9168 | Move client side unit test to hadoop-hdfs-client | Major | build | Haohui Mai | Haohui Mai
HDFS-9343 | Empty caller context considered invalid | Major | . | Mingliang Liu | Mingliang Liu
HDFS-9362 | TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. | Minor | test | Chris Nauroth | Chris Nauroth
HDFS-9007 | Fix HDFS Balancer to honor upgrade domain policy | Major | . | Ming Ma | Ming Ma
HDFS-9379 | Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes | Major | test | Mingliang Liu | Mingliang Liu
YARN-1510 | Make NMClient support change container resources | Major | nodemanager | Wangda Tan (No longer used) | MENG DING
YARN-4345 | yarn rmadmin -updateNodeResource doesn’t work | Critical | graceful, resourcemanager | Sushmitha Sreenivasan | Junping Du
YARN-1509 | Make AMRMClient support send increase container request and get increased/decreased containers | Major | resourcemanager | Wangda Tan (No longer used) | MENG DING
HDFS-9387 | Fix namenodeUri parameter parsing in NNThroughputBenchmark | Major | test | Mingliang Liu | Mingliang Liu
HDFS-9421 | NNThroughputBenchmark replication test NPE with -namenode option | Major | benchmarks | Xiaoyu Yao | Mingliang Liu
YARN-4184 | Remove update reservation state api from state store as its not used by ReservationSystem | Major | capacityscheduler, fairscheduler, resourcemanager | Anubhav Dhoot | Sean Po
HADOOP-12582 | Using BytesWritable’s getLength() and getBytes() instead of get() and getSize() | Major | . | Tsuyoshi Ozawa | Akira Ajisaka
YARN-3454 | Add efficient merge operation to RLESparseResourceAllocation | Major | resourcemanager | Carlo Curino | Carlo Curino
HDFS-7796 | Include X-editable for slick contenteditable fields in the web UI | Major | ui | Ravi Prakash | Ravi Prakash
YARN-3980 | Plumb resource-utilization info in node heartbeat through to the scheduler | Major | resourcemanager, scheduler | Karthik Kambatla | Íñigo Goiri
HADOOP-11954 | Solaris does not support RLIMIT_MEMLOCK as in Linux | Major | . | Malcolm Kavalsky | Alan Burlison
YARN-4384 | updateNodeResource CLI should not accept negative values for resource | Major | graceful, resourcemanager | Sushmitha Sreenivasan | Junping Du
HDFS-9438 | TestPipelinesFailover assumes Linux ifconfig | Minor | test | Alan Burlison | John Zhuge
YARN-4292 | ResourceUtilization should be a part of NodeInfo REST API | Major | . | Wangda Tan | Sunil Govindan
HDFS-9436 | Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default | Minor | test | Mingliang Liu | Mingliang Liu
HDFS-9484 | NNThroughputBenchmark$BlockReportStats should not send empty block reports | Major | test | Mingliang Liu | Mingliang Liu
YARN-4405 | Support node label store in non-appendable file system | Major | api, client, resourcemanager | Wangda Tan | Wangda Tan
HDFS-9214 | Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart | Major | datanode | Xiaobing Zhou | Xiaobing Zhou
YARN-4248 | REST API for submit/update/delete Reservations | Major | resourcemanager | Carlo Curino | Carlo Curino
YARN-4358 | Improve relationship between SharingPolicy and ReservationAgent | Major | capacityscheduler, fairscheduler, resourcemanager | Carlo Curino | Carlo Curino
YARN-3946 | Update exact reason as to why a submitted app is in ACCEPTED state to app’s diagnostic message | Major | capacity scheduler, resourcemanager | Sumit Nigam | Naganarasimha G R
YARN-4309 | Add container launch related debug information to container logs when a container fails | Major | nodemanager | Varun Vasudev | Varun Vasudev
YARN-4293 | ResourceUtilization should be a part of yarn node CLI | Major | . | Wangda Tan | Sunil Govindan
YARN-4416 | Deadlock due to synchronised get Methods in AbstractCSQueue | Minor | capacity scheduler, resourcemanager | Naganarasimha G R | Naganarasimha G R
YARN-3226 | UI changes for decommissioning node | Major | graceful | Junping Du | Sunil Govindan
YARN-4164 | Retrospect update ApplicationPriority API return type | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
YARN-4234 | New put APIs in TimelineClient for ats v1.5 | Major | timelineserver | Xuan Gong | Xuan Gong
YARN-4098 | Document ApplicationPriority feature | Major | resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HDFS-7779 | Support changing ownership, group and replication in HDFS Web UI | Major | ui | Ravi Prakash | Ravi Prakash
YARN-2902 | Killing a container that is localizing can orphan resources in the DOWNLOADING state | Major | nodemanager | Jason Lowe | Varun Saxena
YARN-4393 | TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently | Major | test | Varun Saxena | Varun Saxena
YARN-4479 | Retrospect app-priority in pendingOrderingPolicy during recovering applications | Major | api, resourcemanager | Rohith Sharma K S | Rohith Sharma K S
HDFS-9621 | getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory | Critical | erasure-coding | Sushmitha Sreenivasan | Jing Zhao
YARN-4537 | Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy | Major | capacity scheduler | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11262 | Enable YARN to use S3A | Major | fs/s3 | Thomas Demoor | Pieter Reuse
YARN-4265 | Provide new timeline plugin storage to support fine-grained entity caching | Major | timelineserver | Li Lu | Li Lu
YARN-4304 | AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics | Major | webapp | Sunil Govindan | Sunil Govindan
YARN-4557 | Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=* | Major | resourcemanager | Naganarasimha G R | Naganarasimha G R
HDFS-9601 | NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block | Major | test | Masatake Iwasaki | Masatake Iwasaki
YARN-4614 | TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority fails occasionally | Major | test | Jason Lowe | Sunil Govindan
HDFS-9672 | o.a.h.hdfs.TestLeaseRecovery2 fails intermittently | Major | test | Mingliang Liu | Mingliang Liu
YARN-4573 | TestRMAppTransitions.testAppRunningKill and testAppKilledKilled fail on trunk | Major | resourcemanager, test | Takashi Ohnishi | Takashi Ohnishi
YARN-4643 | Container recovery is broken with delegating container runtime | Critical | yarn | Sidharta Seethana | Sidharta Seethana
YARN-4219 | New levelDB cache storage for timeline v1.5 | Major | . | Li Lu | Li Lu
YARN-4543 | TestNodeStatusUpdater.testStopReentrant fails + JUnit misusage | Minor | nodemanager | Akihiro Suda | Akihiro Suda
YARN-4340 | Add “list” API to reservation system | Major | capacityscheduler, fairscheduler, resourcemanager | Carlo Curino | Sean Po
YARN-4100 | Add Documentation for Distributed and Delegated-Centralized Node Labels feature | Major | api, client, resourcemanager | Naganarasimha G R | Naganarasimha G R
HDFS-9503 | Replace -namenode option with -fs for NNThroughputBenchmark | Major | test | Konstantin Shvachko | Mingliang Liu
HADOOP-12292 | Make use of DeleteObjects optional | Major | fs/s3 | Thomas Demoor | Thomas Demoor
YARN-4667 | RM Admin CLI for refreshNodesResources throws NPE when nothing is configured | Critical | client | Naganarasimha G R | Naganarasimha G R
HADOOP-12752 | Improve diagnostics/use of envvar/sysprop credential propagation | Minor | security | Steve Loughran | Steve Loughran
YARN-4138 | Roll back container resource allocation after resource increase token expires | Major | api, nodemanager, resourcemanager | MENG DING | MENG DING
YARN-2575 | Create separate ACLs for Reservation create/update/delete/list ops | Major | capacityscheduler, fairscheduler, resourcemanager | Subru Krishnan | Sean Po
HADOOP-11613 | Remove commons-httpclient dependency from hadoop-azure | Major | . | Akira Ajisaka | Masatake Iwasaki
HDFS-9084 | Pagination, sorting and filtering of files/directories in the HDFS Web UI | Major | ui | Ravi Prakash | Ravi Prakash
YARN-3223 | Resource update during NM graceful decommission | Major | graceful, nodemanager, resourcemanager | Junping Du | Brook Zhou
YARN-4680 | TimerTasks leak in ATS V1.5 Writer | Major | timelineserver | Xuan Gong | Xuan Gong
HADOOP-12711 | Remove dependency on commons-httpclient for ServletUtil | Major | . | Wei-Chiu Chuang | Wei-Chiu Chuang
YARN-4566 | TestMiniYarnClusterNodeUtilization sometimes fails on trunk | Major | test | Takashi Ohnishi | Takashi Ohnishi
HADOOP-12813 | Migrate TestRPC and related codes to rebase on ProtobufRpcEngine | Major | . | Kai Zheng | Kai Zheng
YARN-4749 | Generalize config file handling in container-executor | Major | nodemanager | Sidharta Seethana | Sidharta Seethana
YARN-4696 | Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency | Major | timelineserver | Steve Loughran | Steve Loughran
MAPREDUCE-6520 | Migrate MR Client test cases part 1 | Trivial | test | Dustin Cote | Dustin Cote
YARN-4545 | Allow YARN distributed shell to use ATS v1.5 APIs | Major | timelineserver | Li Lu | Li Lu
YARN-4817 | Change Log Level to DEBUG for putDomain call in ATS 1.5 | Trivial | timelineserver | Xuan Gong | Xuan Gong
YARN-4108 | CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request | Major | capacity scheduler | Wangda Tan | Wangda Tan
HADOOP-12819 | Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine | Major | . | Kai Zheng | Kai Zheng
YARN-4815 | ATS 1.5 timelineclient impl try to create attempt directory for every event call | Major | timelineserver | Xuan Gong | Xuan Gong
YARN-4814 | ATS 1.5 timelineclient impl call flush after every event write | Major | timelineserver | Xuan Gong | Xuan Gong
YARN-998 | Keep NM resource updated through dynamic resource config for RM/NM restart | Major | graceful, nodemanager, scheduler | Junping Du | Junping Du
MAPREDUCE-6543 | Migrate MR Client test cases part 2 | Trivial | test | Dustin Cote | Dustin Cote
YARN-4822 | Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates | Major | . | Wangda Tan | Wangda Tan
YARN-4634 | Scheduler UI/Metrics need to consider cases like non-queue label mappings | Major | . | Sunil Govindan | Sunil Govindan
HADOOP-12169 | ListStatus on empty dir in S3A lists itself instead of returning an empty list | Major | fs/s3 | Pieter Reuse | Pieter Reuse
HDFS-10186 | DirectoryScanner: Improve logs by adding full path of both actual and expected block directories | Minor | datanode | Rakesh R | Rakesh R
YARN-4826 | Document configuration of ReservationSystem for CapacityScheduler | Minor | capacity scheduler | Subru Krishnan | Subru Krishnan
HADOOP-12444 | Support lazy seek in S3AInputStream | Major | fs/s3 | Rajesh Balamohan | Rajesh Balamohan
YARN-4928 | Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon | Minor | test | Gergely Novák | Gergely Novák
YARN-4168 | Test TestLogAggregationService.testLocalFileDeletionOnDiskFull failing | Critical | test | Steve Loughran | Takashi Ohnishi
HADOOP-12973 | make DU pluggable | Major | . | Elliott Clark | Elliott Clark
YARN-4886 | Add HDFS caller context for EntityGroupFSTimelineStore | Major | timelineserver | Li Lu | Li Lu
HDFS-10281 | o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently | Major | test | Mingliang Liu | Mingliang Liu
YARN-4909 | Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter | Blocker | . | Brahma Reddy Battula | Bibin A Chundatt
YARN-4468 | Document the general ReservationSystem functionality, and the REST API | Major | capacityscheduler, fairscheduler, resourcemanager | Carlo Curino | Carlo Curino
HADOOP-13011 | Clearly Document the Password Details for Keystore-based Credential Providers | Major | documentation | Larry McCay | Larry McCay
YARN-3215 | Respect labels in CapacityScheduler when computing headroom | Major | capacityscheduler | Wangda Tan | Naganarasimha G R
HDFS-10224 | Implement asynchronous rename for DistributedFileSystem | Major | fs, hdfs-client | Xiaobing Zhou | Xiaobing Zhou
YARN-4956 | findbug issue on LevelDBCacheTimelineStore | Major | timelineserver | Xuan Gong | Zhiyuan Yang
YARN-4851 | Metric improvements for ATS v1.5 storage components | Major | timelineserver | Li Lu | Li Lu
HADOOP-12749 | Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors | Major | . | Sidharta Seethana | Sidharta Seethana
HDFS-10346 | Implement asynchronous setPermission/setOwner for DistributedFileSystem | Major | hdfs, hdfs-client | Xiaobing Zhou | Xiaobing Zhou
HADOOP-13122 | Customize User-Agent header sent in HTTP requests by S3A. | Minor | fs/s3 | Chris Nauroth | Chris Nauroth
HADOOP-12844 | Recover when S3A fails on IOException in read() | Major | fs/s3 | Pieter Reuse | Pieter Reuse
HADOOP-13028 | add low level counter metrics for S3A; use in read performance tests | Major | fs/s3, metrics | Steve Loughran | Steve Loughran
HADOOP-13113 | Enable parallel test execution for hadoop-aws. | Minor | test | Chris Nauroth | Chris Nauroth
HADOOP-13158 | S3AFileSystem#toString might throw NullPointerException due to null cannedACL. | Minor | fs/s3 | Chris Nauroth | Chris Nauroth
YARN-4832 | NM side resource value should get updated if change applied in RM side | Critical | nodemanager, resourcemanager | Junping Du | Junping Du
HADOOP-13140 | FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes | Major | fs | Brahma Reddy Battula | Mingliang Liu
HADOOP-13130 | s3a failures can surface as RTEs, not IOEs | Major | fs/s3 | Steve Loughran | Steve Loughran
YARN-3362 | Add node label usage in RM CapacityScheduler web UI | Major | capacityscheduler, resourcemanager, webapp | Wangda Tan | Naganarasimha G R
HDFS-10390 | Implement asynchronous setAcl/getAclStatus for DistributedFileSystem | Major | fs | Xiaobing Zhou | Xiaobing Zhou
YARN-857 | Localization failures should be available in container diagnostics | Critical | . | Hitesh Shah | Vinod Kumar Vavilapalli
HDFS-8057 | Move BlockReader implementation to the client implementation package | Major | hdfs-client | Tsz Wo Nicholas Sze | Takanobu Asanuma
YARN-4957 | Add getNewReservation in ApplicationClientProtocol | Major | applications, client, resourcemanager | Subru Krishnan | Sean Po
HDFS-10431 | Refactor and speedup TestAsyncDFSRename | Minor | test | Xiaobing Zhou | Xiaobing Zhou
YARN-4987 | Read cache concurrency issue between read and evict in EntityGroupFS timeline store | Critical | . | Li Lu | Li Lu
HDFS-10430 | Reuse FileSystem#access in TestAsyncDFS | Major | hdfs | Xiaobing Zhou | Xiaobing Zhou
HADOOP-13162 | Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs | Minor | fs/s3 | Rajesh Balamohan | Rajesh Balamohan
HADOOP-13131 | Add tests to verify that S3A supports SSE-S3 encryption | Minor | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13171 | Add StorageStatistics to S3A; instrument some more operations | Minor | fs/s3 | Steve Loughran | Steve Loughran
YARN-1815 | Work preserving recovery of Unmanged AMs | Critical | resourcemanager | Karthik Kambatla | Subru Krishnan
YARN-5165 | Fix NoOvercommitPolicy to take advantage of RLE representation of plan | Major | capacityscheduler, fairscheduler, resourcemanager | Carlo Curino | Carlo Curino
YARN-5185 | StageAllocaterGreedyRLE: Fix NPE in corner case | Major | capacityscheduler, fairscheduler, resourcemanager | Carlo Curino | Carlo Curino
YARN-4525 | Fix bug in RLESparseResourceAllocation.getRangeOverlapping(…) | Major | . | Ishai Menache | Ishai Menache
HADOOP-13237 | s3a initialization against public bucket fails if caller lacks any credentials | Minor | fs/s3 | Steve Loughran | Chris Nauroth
YARN-5199 | Close LogReader in in AHSWebServices#getStreamingOutput and FileInputStream in NMWebServices#getLogs | Major | . | Xuan Gong | Xuan Gong
YARN-3426 | Add jdiff support to YARN | Blocker | . | Li Lu | Li Lu
YARN-1942 | Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. | Critical | api | Thomas Graves | Wangda Tan
HADOOP-13241 | document s3a better | Minor | documentation, fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13284 | FileSystemStorageStatistics must not attempt to read non-existent rack-aware read stats in branch-2.8 | Major | fs | Mingliang Liu | Mingliang Liu
HADOOP-12975 | Add jitter to CachingGetSpaceUsed’s thread | Major | . | Elliott Clark | Elliott Clark
HADOOP-13280 | FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps | Major | fs | Mingliang Liu | Mingliang Liu
HADOOP-13288 | Guard null stats key in FileSystemStorageStatistics | Major | fs | Mingliang Liu | Mingliang Liu
HADOOP-13291 | Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented | Major | fs | Mingliang Liu | Mingliang Liu
HDFS-10538 | Remove AsyncDistributedFileSystem API | Major | hdfs-client | Xiaobing Zhou | Xiaobing Zhou
HADOOP-13203 | S3A: Support fadvise “random” mode for high performance readPositioned() reads | Major | fs/s3 | Rajesh Balamohan | Rajesh Balamohan
HADOOP-12229 | Fix inconsistent subsection titles in filesystem.md | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-12242 | Add in-page TOC to filesystem specification pages | Minor | documentation | Masatake Iwasaki | Masatake Iwasaki
HADOOP-13305 | Define common statistics names across schemes | Major | fs | Mingliang Liu | Mingliang Liu
HADOOP-13283 | Support reset operation for new global storage statistics and per FS storage stats | Major | fs | Mingliang Liu | Mingliang Liu
YARN-5080 | Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM | Critical | yarn | Sumana Sathish | Xuan Gong
HADOOP-13366 | Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc | Minor | documentation | Rakesh R | Rakesh R
YARN-4484 | Available Resource calculation for a queue is not correct when used with labels | Major | capacity scheduler | Sunil Govindan | Sunil Govindan
HADOOP-13368 | DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation | Major | fs | Mingliang Liu | Mingliang Liu
HADOOP-13212 | Provide an option to set the socket buffers in S3AFileSystem | Minor | fs/s3 | Rajesh Balamohan | Rajesh Balamohan
HDFS-10653 | Optimize conversion from path string to components | Major | hdfs | Daryn Sharp | Daryn Sharp
HADOOP-13207 | Specify FileSystem listStatus, listFiles and RemoteIterator | Major | documentation, fs | Steve Loughran | Steve Loughran
HADOOP-13188 | S3A file-create should throw error rather than overwrite directories | Minor | fs/s3 | Raymie Stata | Steve Loughran
HDFS-10642 | TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently | Major | datanode, test | Mingliang Liu | Mingliang Liu
HDFS-10668 | TestDataNodeMXBean#testDataNodeMXBeanBlockCount fails intermittently | Major | test | Mingliang Liu | Mingliang Liu
YARN-5434 | Add -client|server argument for graceful decom | Blocker | graceful | Robert Kanter | Robert Kanter
HADOOP-13429 | Dispose of unnecessary SASL servers | Major | ipc | Daryn Sharp | Daryn Sharp
HADOOP-13426 | More efficiently build IPC responses | Major | . | Daryn Sharp | Daryn Sharp
HDFS-10656 | Optimize conversion of byte arrays back to path string | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10674 | Optimize creating a full path from an inode | Major | hdfs | Daryn Sharp | Daryn Sharp
YARN-5342 | Improve non-exclusive node partition resource allocation in Capacity Scheduler | Major | . | Wangda Tan | Sunil Govindan
HADOOP-13438 | Optimize IPC server protobuf decoding | Major | . | Daryn Sharp | Daryn Sharp
HADOOP-13418 | Fix javadoc warnings by JDK8 in hadoop-nfs package | Major | . | Kai Sasaki | Kai Sasaki
HDFS-10724 | Document the caller context config keys | Minor | ipc, namenode | Mingliang Liu | Mingliang Liu
HDFS-10678 | Documenting NNThroughputBenchmark tool | Major | benchmarks, test | Mingliang Liu | Mingliang Liu
HDFS-10641 | TestBlockManager#testBlockReportQueueing fails intermittently | Major | namenode, test | Mingliang Liu | Daryn Sharp
HADOOP-13324 | s3a tests don’t authenticate with S3 frankfurt (or other V4 auth only endpoints) | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13208 | S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories | Minor | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13405 | doc for “fs.s3a.acl.default” indicates incorrect values | Minor | fs/s3 | Shen Yinjie | Shen Yinjie
HDFS-10711 | Optimize FSPermissionChecker group membership check | Major | hdfs | Daryn Sharp | Daryn Sharp
HADOOP-13252 | Tune S3A provider plugin mechanism | Minor | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13446 | Support running isolated unit tests separate from AWS integration tests. | Major | fs/s3 | Chris Nauroth | Chris Nauroth
HDFS-10762 | Pass IIP for file status related methods | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10772 | Reduce byte/string conversions for get listing | Major | hdfs | Daryn Sharp | Daryn Sharp
YARN-3940 | Application moveToQueue should check NodeLabel permission | Major | resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HDFS-10768 | Optimize mkdir ops | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10655 | Fix path related byte array conversion bugs | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10662 | Optimize UTF8 string/byte conversions | Major | hdfs | Daryn Sharp | Daryn Sharp
HADOOP-13547 | Optimize IPC client protobuf decoding | Major | . | Daryn Sharp | Daryn Sharp
HADOOP-13549 | Eliminate intermediate buffer for server-side PB encoding | Major | ipc | Daryn Sharp | Daryn Sharp
HADOOP-13447 | Refactor S3AFileSystem to support introduction of separate metadata repository and tests. | Major | fs/s3 | Chris Nauroth | Chris Nauroth
HADOOP-13541 | explicitly declare the Joda time version S3A depends on | Minor | build, fs/s3 | Steve Loughran | Steve Loughran
YARN-5566 | Client-side NM graceful decom is not triggered when jobs finish | Major | nodemanager | Robert Kanter | Robert Kanter
HADOOP-10940 | RPC client does no bounds checking of responses | Critical | ipc | Daryn Sharp | Daryn Sharp
HADOOP-13540 | improve section on troubleshooting s3a auth problems | Minor | documentation, fs/s3 | Steve Loughran | Steve Loughran
HDFS-10673 | Optimize FSPermissionChecker’s internal path usage | Major | hdfs | Daryn Sharp | Daryn Sharp
HADOOP-13546 | Override equals and hashCode to avoid connection leakage | Major | ipc | Xiaobing Zhou | Xiaobing Zhou
HDFS-10744 | Internally optimize path component resolution | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10805 | Reduce runtime for append test | Minor | test | Gergely Novák | Gergely Novák
HADOOP-13544 | JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs | Blocker | . | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli
HDFS-10779 | Rename does not need to re-solve destination | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10892 | Add unit tests for HDFS command ‘dfs -tail’ and ‘dfs -stat’ | Major | fs, shell, test | Mingliang Liu | Mingliang Liu
HADOOP-13599 | s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-12974 | Create a CachingGetSpaceUsed implementation that uses df | Major | . | Elliott Clark | Elliott Clark
HDFS-10851 | FSDirStatAndListingOp: stop passing path as string | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10619 | Cache path in InodesInPath | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10934 | TestDFSShell.testStat fails intermittently | Major | test | Eric Badger | Eric Badger
HADOOP-13674 | S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. | Minor | fs/s3 | Chris Nauroth | Chris Nauroth
HDFS-10956 | Remove rename/delete performance penalty when not using snapshots | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10896 | Move lock logging logic from FSNamesystem into FSNamesystemLock | Major | namenode | Erik Krogen | Erik Krogen
HDFS-10745 | Directly resolve paths into INodesInPath | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10955 | Pass IIP for FSDirAttr methods | Major | hdfs | Daryn Sharp | Daryn Sharp
HADOOP-12977 | s3a to handle delete(“/”, true) robustly | Minor | fs/s3 | Steve Loughran | Steve Loughran
HDFS-10939 | Reduce performance penalty of encryption zones | Major | hdfs | Daryn Sharp | Daryn Sharp
HADOOP-13692 | hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts. | Minor | fs/s3 | Chris Nauroth | Chris Nauroth
HDFS-10979 | Pass IIP for FSDirDeleteOp methods | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10980 | Optimize check for existence of parent directory | Major | hdfs | Daryn Sharp | Daryn Sharp
HDFS-10988 | Refactor TestBalancerBandwidth | Major | balancer & mover, test | Brahma Reddy Battula | Brahma Reddy Battula
HDFS-10985 | o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions | Minor | ha, test | Mingliang Liu | Mingliang Liu
HDFS-10972 | Add unit test for HDFS command ‘dfsadmin -getDatanodeInfo’ | Major | fs, shell, test | Xiaobing Zhou | Xiaobing Zhou
HDFS-10965 | Add unit test for HDFS command ‘dfsadmin -printTopology’ | Major | fs, shell, test | Xiaobing Zhou | Xiaobing Zhou
HDFS-11008 | Change unit test for testing parsing “-source” parameter in Balancer CLI | Major | test | Mingliang Liu | Mingliang Liu
HADOOP-13419 | Fix javadoc warnings by JDK8 in hadoop-common package | Major | . | Kai Sasaki | Kai Sasaki
HDFS-10922 | Adding additional unit tests for Trash (II) | Major | test | Xiaoyu Yao | Weiwei Yang
HDFS-10906 | Add unit tests for Trash with HDFS encryption zones | Major | encryption | Xiaoyu Yao | Hanisha Koneru
HADOOP-13735 | ITestS3AFileContextStatistics.testStatistics() failing | Minor | fs/s3 | Steve Loughran | Pieter Reuse
HDFS-10998 | Add unit tests for HDFS command ‘dfsadmin -fetchImage’ in HA | Major | test | Xiaobing Zhou | Xiaobing Zhou
HADOOP-13727 | S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. | Minor | fs/s3 | Rajesh Balamohan | Chris Nauroth
HADOOP-12774 | s3a should use UGI.getCurrentUser.getShortname() for username | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13309 | Document S3A known limitations in file ownership and permission model. | Minor | fs/s3 | Chris Nauroth | Chris Nauroth
HDFS-11011 | Add unit tests for HDFS command ‘dfsadmin -set/clrSpaceQuota’ | Major | hdfs-client | Xiaobing Zhou | Xiaobing Zhou
HADOOP-13614 | Purge some superfluous/obsolete S3 FS tests that are slowing test runs down | Minor | fs/s3, test | Steve Loughran | Steve Loughran
HADOOP-10597 | RPC Server signals backoff to clients when all request queues are full | Major | . | Ming Ma | Ming Ma
HADOOP-13680 | fs.s3a.readahead.range to use getLongBytes | Major | fs/s3 | Steve Loughran | Abhishek Modi
HDFS-11030 | TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing) | Major | datanode, test | Mingliang Liu | Mingliang Liu
HDFS-10997 | Reduce number of path resolving methods | Major | namenode | Daryn Sharp | Daryn Sharp
HDFS-11065 | Add space quota tests for heterogenous storages | Major | hdfs | Xiaobing Zhou | Xiaobing Zhou
HDFS-11031 | Add additional unit test for DataNode startup behavior when volumes fail | Major | datanode, test | Mingliang Liu | Mingliang Liu
HADOOP-10300 | Allowed deferred sending of call responses | Major | ipc | Daryn Sharp | Daryn Sharp
HDFS-11076 | Add unit test for extended Acls | Major | test | Chen Liang | Chen Liang
HDFS-11085 | Add unit test for NameNode failing to start when name dir is unwritable | Major | namenode, test | Mingliang Liu | Xiaobing Zhou
YARN-5802 | updateApplicationPriority api in scheduler should ensure to re-insert app to correct ordering policy | Critical | capacity scheduler | Bibin A Chundatt | Bibin A Chundatt
HDFS-11083 | Add unit test for DFSAdmin -report command | Major | shell, test | Mingliang Liu | Xiaobing Zhou
YARN-4498 | Application level node labels stats to be available in REST | Major | api, client, resourcemanager | Bibin A Chundatt | Bibin A Chundatt
HADOOP-13720 | Add more info to the msgs printed in AbstractDelegationTokenSecretManager for better supportability | Trivial | common, security | Yongjun Zhang | Yongjun Zhang
HDFS-11122 | TestDFSAdmin#testReportCommand fails due to timed out | Minor | test | Yiqun Lin | Yiqun Lin
HDFS-10872 | Add MutableRate metrics for FSNamesystemLock operations | Major | namenode | Erik Krogen | Erik Krogen
HDFS-11105 | TestRBWBlockInvalidation#testRWRInvalidation fails intermittently | Major | namenode, test | Yiqun Lin | Yiqun Lin
HADOOP-13822 | Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics() | Major | fs | Brahma Reddy Battula | Brahma Reddy Battula
HADOOP-11601 | Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files | Minor | fs, test | Steve Loughran | Steve Loughran
HADOOP-13655 | document object store use with fs shell and distcp | Major | documentation, fs, fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13801 | regression: ITestS3AMiniYarnCluster failing | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-12804 | Read Proxy Password from Credential Providers in S3 FileSystem | Minor | fs/s3 | Larry McCay | Larry McCay
HADOOP-13823 | s3a rename: fail if dest file exists | Blocker | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13857 | S3AUtils.translateException to map (wrapped) InterruptedExceptions to InterruptedIOEs | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13855 | Fix a couple of the s3a statistic names to be consistent with the rest | Major | fs/s3 | Steve Loughran | Steve Loughran
HADOOP-13257 | Improve Azure Data Lake contract tests. | Major | fs/adl | Chris Nauroth | Vishwajeet Dusane
YARN-4390 | Do surgical preemption based on reserved container in CapacityScheduler | Major | capacity scheduler | Eric Payne | Wangda Tan
HDFS-8630 | WebHDFS : Support get/set/unset StoragePolicy | Major | webhdfs | nijel | Surendra Singh Lilhore
HADOOP-13871 | ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful | Major | fs/s3 | Steve Loughran | Steve Loughran
YARN-2009 | CapacityScheduler: Add intra-queue preemption for app priority support | Major | capacityscheduler | Devaraj K | Sunil Govindan
YARN-4844 | Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource | Blocker | api | Wangda Tan | Wangda Tan
YARN-4990 | Re-direction of a particular log file within in a container in NM UI does not redirect properly to Log Server ( history ) on container completion | Major | . | Hitesh Shah | Xuan Gong
YARN-3866 | AM-RM protocol changes to support container resizing | Blocker | api | MENG DING | MENG DING
HADOOP-13336 | S3A to support per-bucket configuration | Major | fs/s3 | Steve Loughran | Steve Loughran
HDFS-8377 | Support HTTP/2 in datanode | Major | . | Duo Zhang | Duo Zhang
HADOOP-14019 | fix some typos in the s3a docs | Minor | documentation, fs/s3 | Steve Loughran | Steve Loughran
HADOOP-14081 | S3A: Consider avoiding array copy in S3ABlockOutputStream (ByteArrayBlock) | Minor | fs/s3 | Rajesh Balamohan | Rajesh Balamohan
YARN-6143 | Fix incompatible issue caused by YARN-3583 | Blocker | rolling upgrade | Wangda Tan | Sunil Govindan
HADOOP-14113 | review ADL Docs | Minor | documentation, fs/adl | Steve Loughran | Steve Loughran
HADOOP-14123 | Remove misplaced ADL service provider config file for FileSystem | Minor | fs/adl | John Zhuge | John Zhuge
HADOOP-14153 | ADL module has messed doc structure | Major | fs/adl | Mingliang Liu | Mingliang Liu
HADOOP-14173 | Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE | Trivial | fs/adl | John Zhuge | John Zhuge
HDFS-7964 | Add support for async edit logging | Major | namenode | Daryn Sharp | Daryn Sharp
HDFS-8818 | Allow Balancer to run faster | Major | balancer & mover | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze
YARN-4140 | RM container allocation delayed incase of app submitted to Nodelabel partition | Major | scheduler | Bibin A Chundatt | Bibin A Chundatt

### OTHER:

JIRA | Summary | Priority | Component | Reporter | Contributor
--- | --- | --- | --- | --- | ---
YARN-3357 | Move TestFifoScheduler to FIFO package | Major | scheduler, test | Rohith Sharma K S | Rohith Sharma K S
HADOOP-11814 | Reformat hadoop-annotations, o.a.h.classification.tools | Minor | . | Li Lu | Li Lu
MAPREDUCE-6388 | Remove deprecation warnings from JobHistoryServer classes | Minor | jobhistoryserver | Ray Chiang | Ray Chiang
YARN-3026 | Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp | Major | capacityscheduler | Wangda Tan | Wangda Tan
HDFS-8938 | Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager | Major | . | Mingliang Liu | Mingliang Liu
HDFS-9027 | Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method | Major | . | Mingliang Liu | Mingliang Liu
MAPREDUCE-6477 | Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem | Major | . | Mingliang Liu | Mingliang Liu
MAPREDUCE-6483 | Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials | Major | test | Mingliang Liu | Mingliang Liu
HDFS-9130 | Use GenericTestUtils#setLogLevel to the logging level | Major | . | Mingliang Liu | Mingliang Liu
HADOOP-12446 | Undeprecate createNonRecursive() | Major | . | Ted Yu | Ted Yu
HDFS-8979 | Clean up checkstyle warnings in hadoop-hdfs-client module | Major | . | Mingliang Liu | Mingliang Liu
HADOOP-11791 | Update src/site/markdown/releases to include old versions of Hadoop | Major | build, documentation | Allen Wittenauer | Allen Wittenauer
HADOOP-12514 | Make static fields in GenericTestUtils for assertExceptionContains() package-private and final | Minor | test | Mingliang Liu | Mingliang Liu
HDFS-9377 | Fix findbugs warnings in FSDirSnapshotOp | Major | namenode | Mingliang Liu | Mingliang Liu
HADOOP-12567 | NPE in SaslRpcServer | Major | . | Sergey Shelukhin | Sergey Shelukhin
YARN-4653 | Document YARN security model from the perspective of Application Developers | Major | site | Steve Loughran | Steve Loughran
HDFS-10200 | Docs for WebHDFS still describe GETDELEGATIONTOKENS operation | Trivial | documentation | Wellington Chevreuil | Wellington Chevreuil
HDFS-9353 | Code and comment mismatch in JavaKeyStoreProvider | Trivial | . | nijel | Andras Bokor
HDFS-10984 | Expose nntop output as metrics | Major | namenode | Siddharth Wagle | Siddharth Wagle
YARN-5704 | Provide config knobs to control enabling/disabling new/work in progress features in container-executor | Major | yarn | Sidharta Seethana | Sidharta Seethana
HADOOP-14091 | AbstractFileSystem implementaion for ‘wasbs’ scheme | Major | fs/azure | Varada Hemeswari | Varada Hemeswari
YARN-6274 | Documentation refers to incorrect nodemanager health checker interval property | Trivial | documentation | Charles Zhang | Weiwei Yang