The Apache Hive data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data already in storage. A command line tool and JDBC driver are provided to connect users to Hive.
Prerequisites
Set environment variable HADOOP_CLIENT_OPTS as follows:
export HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS -Dcom.sun.management.jmxremote \ -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false \ -Dcom.sun.management.jmxremote.port=8808"Note: If you want to any other port then define in the detection YAML file.
For Virtual machines, install the Linux agent.
Configuring the credentials
Configure the credentials in the directory /opt/opsramp/agent/conf/app.d/creds.yaml
hive:
- name: hive
user: <username>
pwd: <Password>
encoding-type: plain
labels:
key1: val1
key2: val2
Configuring the application
Virtual machine
Configure the application in the directory /opt/opsramp/agent/conf/app/discovery/auto-detection.yaml
- name: hive
instance-checks:
service-check:
- hive
process-check:
- hive
port-check:
- 10002
mon-type: "jmx"
misc:
jmx-port: "8808"
Docker environment
Configure the application in the directory /opt/opsramp/agent/conf/app/discovery/auto-container-detection.yaml
- name: hive
container-checks:
image-check:
- hive
port-check:
- 10002
mon-type: "jmx"
misc:
jmx-port: "8808"
Kubernetes environment
Configure the application in config.yaml
- name: hive
container-checks:
image-check:
- hive
port-check:
- 10002
mon-type: "jmx"
misc:
jmx-port: "8808"
Validate
Go to Resources under the Infrastructure tab to check if your resources are onboarded and the metrics are collected.
Metrics
| OpsRamp Metric | Metric Display Name | Unit | Description |
|---|---|---|---|
| hive_open_operations_Count | Open Operations Count | Number of open operations count | |
| hive_memory_heap_usage_Value | Memory Heap Usage Value | bytes | Memory heap usage value |
| hive_memory_heap_used_Value | Memory Heap Used Value | bytes | Memory heap used value |
| hive_memory_heap_max_Value | Memory Heap Max Value | bytes | Memory heap max value |
| hive_memory_heap_committed_Value | Memory Heap Committed Value | bytes | Memory heap committed value |
| hive_memory_non_heap_init_Value | Memory Non Heap Init Value | bytes | Memory non heap init value |
| hive_memory_non_heap_used_Value | Memory Non Heap Used Value | bytes | Memory non heap used value |
| hive_memory_non_heap_max_Value | Memory Non Heap Max Value | bytes | Memory non heap max value |
| hive_memory_non_heap_committed_Value | Memory Non Heap Committed Value | bytes | Memory non heap committed value |
| hive_memory_total_init_Value | Memory Total Init Value | bytes | Memory total init value |
| hive_memory_total_usage_Value | Memory Total Usage Value | bytes | Memory total usage value |
| hive_memory_total_used_Value | Memory Total Used Value | bytes | Memory total used value |
| hive_memory_total_max_Value | Memory Total Max Value | bytes | Memory total max value |
| hive_memory_total_committed_Value | Memory Total Committed Value | bytes | Memory total committed value |
| hive_open_connections_Count | Open Connections Count | Number of open connections count | |
| hive_create_total_count_dbs_Count | Create Total Count Dbs Count | Number of create total count dbs count | |
| hive_delete_total_count_dbs_Count | Delete Total Count Dbs Count | Number of delete total count dbs count | |
| hive_init_total_count_dbs_Value | Init Total Count Dbs Value | Number of init total count dbs value | |
| hive_create_total_count_tables_Count | Create Total Count Tables Count | Number of create total count tables count | |
| hive_delete_total_count_tables_Count | Delete Total Count Tables Count | Number of delete total count tables count | |
| hive_init_total_count_tables_Value | Init Total Count Tables Value | init total count tables value | |
| hive_create_total_count_partitions_Count | Create Total Count Partitions Count | Number of number of create total count partitions count | |
| hive_delete_total_count_partitions_Count | Delete Total Count Partitions Count | Number of number of delete total count partitions count | |
| hive_init_total_count_partitions_Value | Init Total Count Partitions Value | init total count partitions value | |
| hive_directsql_errors_Count | Directsql Errors Count | Number of directsql errors count | |
| hive_memory_heap_init_Value | Memory Heap Init Value | Memory heap init value | |
| hive_api_create_table_Count | Api Create Table Count | Number of api create table count | |
| hive_active_calls_api_create_table_Count | Active Calls Api Create Table Count | Number of active calls api create table count | |
| hive_api_get_table_Count | Api Get Table Count | Number of api get table count | |
| hive_active_calls_api_get_table_Count | Active Calls Api Get Table Count | Active calls api get table count | |
| hive_api_drop_table_Count | Api Drop Table Count | Api drop table count | |
| hive_active_calls_api_drop_table_Count | Active Calls Api Drop Table Count | Number of active calls api drop table count | |
| hive_api_init_Count | Api Init Count | Number of total api init count | |
| hive_active_calls_api_init_Count | Active Calls Api Init Count | Number of active calls api init count | |
| hive_api_get_all_databases_Count | Api Get All Databases Count | Number of api get all databases count | |
| hive_active_calls_api_get_all_databases_Count | Active Calls Api Get All Databases Count | Number of active calls api get all databases count | |
| hive_api_get_database_Count | Api Get Database Count | Number of api get database count | |
| hive_active_calls_api_get_database_Count | Active Calls Api Get Database Count | Number of active calls api get database count | |
| hive_api_get_all_tables_Count | Api Get All Tables Count | Number of api get all tables count | |
| hive_active_calls_api_get_all_tables_Count | Active Calls Api Get All Tables Count | Number of active calls api get all tables count | |
| hive_api_shutdown_Count | Api Shutdown Count | Api shutdown count | |
| hive_active_calls_api_shutdown_Count | Active Calls Api Shutdown Count | Number of active calls api shutdown count | |
| hive_api_flushCache_Count | Api Flushcache Count | Number of api flushCache count | |
| hive_active_calls_api_flushCache_Count | Active Calls Api Flushcache Count | Number of active calls api flushCache count | |
| hive_api_alter_table_Count | Api Alter Table Count | Number of api alter table count | |
| hive_active_calls_api_alter_table_Count | Active Calls Api Alter Table Count | Number of active calls api alter table count | |
| hive_api_get_all_functions_Count | Api Get All Functions Count | Number of api get all functions count | |
| hive_active_calls_api_get_all_functions_Count | Active Calls Api Get All Functions Count | Number of active calls api get all functions count | |
| hive_api_get_table_req_Count | Api Get Table Req Count | Number of api get table req count | |
| hive_active_calls_api_get_table_req_Count | Active Calls Api Get Table Req Count | Number of active calls api get table req count |