Metadata Management

Introduction

UHadoop supports deploying the database of Hive-Metastore independently from the Hadoop cluster, and also supports multiple clusters to access the same Hive metadata database, which can be managed on the console.

Product Architecture

Hive metadata is stored in UDB MySQL.

Metadata Management

• When creating a cluster, you can enable independent metadata management on the console.

In the same project, all cluster’s Hive metadata are stored in the same database.

If this feature is enabled for the first time, UHadoop will create a new UDB MySQL for the user.

If the project has already enabled independent metadata management, when the new cluster enables this feature, it will not create a new UDB, but store the Hive metadata of the new cluster in the existing UDB.

• After setting up, the database status can be viewed on the [Metadata Management] page, and the UDB name is fixed as [uhadoop-metastore].

The monitoring information of the database can be viewed on the UDB console. In order to ensure the normal execution of tasks in the UHadoop cluster, please be careful when operating this UDB.

• If the cluster has enabled [Independent Metadata Management], you can view the associated UDB MySQL resource ID in cluster details.