dir0/file2đ 10:39 10:39đ34217728đđĐĐ -rw-r-r- root supergroupĭetectCorruption processor generates a text representation of the errors of the fsimage, if there’s any. Path Replication ModificationTimeĚccessTime PreferredBlockSizeělocksCountğileSize NSQUOTAĝSQUOTA Permission UserName GroupName Users can specify the address to listen by -addr option (default by localhost:5978). Web processor launches a HTTP server which exposes read-only WebHDFS API. This processor makes it easy to create fsimages for testing, and manually edit fsimages when there is corruption. ReverseXML (experimental): This is the opposite of the XML processor it reconstructs an fsimage from an XML file. Note that the check is not exhaustive, and only catches missing nodes during the namespace reconstruction. Outputs a summary of the found corruptions in a delimited format. The default delimiter is \t, though this may be changed via the -delimiter argument.ĭetectCorruption (experimental): Detect potential corruption of the image by selectively loading parts of it and actively searching for inconsistencies. In addition, the Size column will be changed to the Size Range column.ĭelimited (experimental): Generate a text file with all of the elements common to both inodes and inodes-under-construction, separated by a delimiter. By specifying the option -format, the output file will be formatted in a human-readable fashion rather than a number of bytes that showed in Size column. Where Size represents the start of the segment, and numFiles is the number of files form the image which size falls in this segment. By default, the output file is formatted as a tab separated two column table: Size and NumFiles. Note that files larger than maxSize always fall into the very last segment. The range of integers is divided into segments of size step:, …, s, maxSize], and the processor calculates how many files in the system fall into each segment, s). In order to run the tool one should define a range of integers by specifying maxSize and a step. Due to the verbosity of the XML syntax, this processor will also generate the largest amount of output.įileDistribution is the tool for analyzing file sizes in the namespace image. The output of this processor is amenable to automated processing and analysis with XML tools. XML creates an XML document of the fsimage and includes all of the information within the fsimage. It does not support secure mode, nor HTTPS. Users can investigate the namespace interactively by using HTTP REST API. It launches a HTTP server that exposes read-only WebHDFS API. The Offline Image Viewer provides several output processors: The Offline Image Viewer does not require a Hadoop cluster to be running it is entirely offline in its operation. If the tool is not able to process an image file, it will exit cleanly. If you want to handle older layout formats, you can use the Offline Image Viewer of Hadoop 2.3 or oiv_legacy Command. The tool handles the layout formats that were included with Hadoop versions 2.4 and up. The tool is able to process very large image files relatively quickly. The Offline Image Viewer is a tool to dump the contents of hdfs fsimage files to a human-readable format and provide read-only WebHDFS API in order to allow offline analysis and examination of an Hadoop cluster’s namespace. Running Applications in runC Containers.Running Applications in Docker Containers.
0 Comments
Leave a Reply. |