Explanation of the new feature of Hadoop 2.X, the recycle bin function

By turning on the Recycle Bin function, you can restore the original data of deleted files without timing out, thus preventing accidental deletion and providing backup.

1. Recycle Bin parameter settings and working mechanism

2. Enable Recycle Bin

Modify core-site.xml and set the garbage collection time to 1 minute.

<property>
  <name>fs.trash.interval</name>
<value>1</value>
</property>

3. View Recycle Bin

The path of the recycle bin in the cluster: /user/username/.Trash/….

4. Modify the user name for accessing the Recycle Bin

The user name for entering the trash bin is dr.who by default, change it to the user name

[core-site.xml]

<property>
 <name>hadoop.http.staticuser.user</name>
 <value>Username</value>
</property>

5. Files deleted by the program will not go through the Recycle Bin. You need to call moveToTrash() to enter the Recycle Bin.

Trash trash = New Trash(conf);
trash.moveToTrash(path);

6. Restore Recycle Bin Data

hadoop fs -mv
/user/atguigu/.Trash/Current/user/atguigu/input /user/atguigu/input

7. Empty the Recycle Bin

hadoop fs -expunge

Summarize

The above is the full content of this article. I hope that the content of this article will have certain reference learning value for your study or work. Thank you for your support of 123WORDPRESS.COM. If you want to learn more about this, please check out the following links