Monitoring Cloudera Edge Flow Manager and Cloudera Streams Messaging Manager with Apache NiFi

Timothy Spann. 🇺🇦 - Dec 3 '19 - - Dev Community

Monitoring Cloudera Edge Flow Manager and Cloudera Streams Messaging Manager with Apache NiFi

http://SERVER:10080/efm/actuator/health

{"status":{"code":"UP","description":""},"details":{"db":{"status":{"code":"UP","description":""},"details":{"database":"MySQL","hello":1}},"diskSpace":{"status":{"code":"UP","description":""},"details":{"total":1073729220608,"free":1023731712000,"threshold":10485760}}}}









[http://SERVER:10080/efm/actuator/heapdump](http://server:10080/efm/actuator/heapdump)





[http://SERVER:10080/efm/actuator/env](http://server:10080/efm/actuator/env)





[http://SERVER:10080/efm/actuator/httptrace](http://server:10080/efm/actuator/httptrace)





**Check REST API Made Available During EFM Startup**

2019-08-21 22:30:25.045  INFO 100056 --- [          main] o.e.jetty.server.AbstractConnector       : Started ServerConnector@747d1932{HTTP/1.1,[http/1.1]}{cloudera:10080}




2019-08-21 22:30:25.047  INFO 100056 --- [          main] o.s.b.web.embedded.jetty.JettyWebServer  : Jetty started on port(s) 10080 (http/1.1) with context path **'/efm'**




2019-08-21 22:30:25.050  INFO 100056 --- [          main] com.cloudera.cem.efm.C2Application       : Started C2Application in 10.102 seconds (JVM running for 10.741)




2019-08-21 22:30:25.056  INFO 100056 --- [          main] com.cloudera.cem.efm.C2Application       : The Edge Flow Manager has started. Services available at the following URLs:




2019-08-21 22:30:25.056  INFO 100056 --- [          main] com.cloudera.cem.efm.C2Application       : \>\>\> Access User Interface: **http://cloudera:10080/efm/ui**




2019-08-21 22:30:25.056  INFO 100056 --- [          main] com.cloudera.cem.efm.C2Application       : \>\>\> Base URL for REST API: **http://cloudera:10080/efm/api**




2019-08-21 22:30:25.057  INFO 100056 --- [          main] com.cloudera.cem.efm.C2Application       : \>\>\> Swagger REST API docs: **http://cloudera:10080/efm/swagger**




2019-08-21 22:30:25.057  INFO 100056 --- [          main] com.cloudera.cem.efm.C2Application       : \>\>\> Status and management: **http:/cloudera:10080/efm/actuator**



Enter fullscreen mode Exit fullscreen mode

Agent Classes

http://SERVER:10080/efm/api/agent-classes




[  
 {  
 "name": "iot-1",  
 "agentManifests": [  
 "agent-manifest-id"  
 ]  
 },  
 {  
 "name": "nanojetsonjava",  
 "agentManifests": [  
 "agent-manifest-id"  
 ]  
 },  
 {  
 "name": "raspianjava",  
 "agentManifests": [  
 "agent-manifest-id"  
 ]  
 },  
 {  
 "name": "rpi3javamovidiussensehat",  
 "agentManifests": [  
 "agent-manifest-id"  
 ]  
 },  
 {  
 "name": "rpi4java",  
 "agentManifests": [  
 "agent-manifest-id"  
 ]  
 },  
 {  
 "name": "rpijavamovidiussensehat",  
 "agentManifests": [  
 "agent-manifest-id"  
 ]  
 }  
]



**EFM Agent Manifests**

http://server:10080/efm/api/agent-manifests



**EFM Agents**

http://server:10080/efm/api/agents



**EFM C2 Configuration - NiFi Registry**

http://server:10080/efm/api/c2-configuration/nifi-registry



**EFM Designer Flows**

http://server:10080/efm/api/designer/flows



**EFM API FLOWS**

http://server:10080/efm/api/flows





**Monitoring SMM Metrics with NiFi**



**Aggregated Topics for Last Hour**



http://server:9991/api/v1/admin/metrics/aggregated/topics?duration=LAST\_ONE\_HOUR&state=all



**Aggregated Brokers for the Last Hour**



http://server:9991/api/v1/admin/metrics/aggregated/brokers?duration=LAST\_ONE\_HOUR











**EFM Events**



http://server:10080/efm/api/events



**EFM Event by Event ID**



http://server:10080/efm/api/events/9db708ca-3b7e-42bf-941a-a945fefa6fa6



**Get a Heartbeat from a Device by HBDI**



http://server:10080/efm/api/heartbeats/HBID



For Auto-configuring your processor, list of fields available



**EFM Events / Fields**
http://server:10080/efm/api/events/fields

**What Flows available**

http://server:10080/efm/api/designer/flows

http://server:10080/efm/api/designer/flows/summaries

**Get One Flow**

### [GET](https://docs.cloudera.com/cem/1.0.0/rest-api-reference/index.html#!/Flow_Designer/getFlow) [/designer/flows/{flowId}](https://docs.cloudera.com/cem/1.0.0/rest-api-reference/index.html#!/Flow_Designer/getFlow)

http://server:10080/efm/api/designer/flows/46cac951-217d-41f7-9442-086e9199c044

Get That Flows Events

### [GET](https://docs.cloudera.com/cem/1.0.0/rest-api-reference/index.html#!/Flow_Designer/getFlowEvents) [/designer/flows/{flowId}/events](https://docs.cloudera.com/cem/1.0.0/rest-api-reference/index.html#!/Flow_Designer/getFlowEvents)

http://server:10080/efm/api/designer/flows/46cac951-217d-41f7-9442-086e9199c044/events

**Get All Flows and Buckets**

http://server:10080/efm/api/flows

**Agent Classes**

http://server:10080/efm/api/agent-classes

**Agents**

http://server:10080/efm/api/agents

**Agent Manifests**

http://server:10080/efm/api/agent-manifests

**What NiFi Registry**

http://server:10080/efm/api/c2-configuration/nifi-registry

**What EFM Server**

http://server:10080/efm/api/c2-configuration

**SMM API**

[https://docs.cloudera.com/smm/1.2.1/rest-api-reference/index.html](https://docs.cloudera.com/smm/1.2.1/rest-api-reference/index.html)

**EFM Flow Designer**

http://server:10080/efm/ui/#/flow-designer/flow/4ae72206-372d-4f3e-916a-d7c1faf09811  
For a Great Real World Usage Example  
[https://github.com/asdaraujo/edge2ai-workshop#lab\_1](https://github.com/asdaraujo/edge2ai-workshop#lab_1)  

Enter fullscreen mode Exit fullscreen mode

http://hostname:10080/efm/api/agent-classes

http://hostname:10080/efm/api/agent-manifests?class=

http://hostname:10080/efm/swagger/





Enter fullscreen mode Exit fullscreen mode
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .