Versions Compared

Old Version 2

changes.mady.by.user Baseer Khan

Saved on

compared with

New Version 3

changes.mady.by.user Baseer Khan

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Some of the parameters that are monitored are:

ParameterDescription
AlarmCountTQL engine has internal memory management program. This program raises alarm when memory utilization is found to be continuously crossing the threshold. This variable displays the count of how many times Alarm has been triggered
AlarmLevelThis denotes the level of memory consumption reached by the engine at which Alarm was triggered. That means if AlarmLevel is 0.6 then it means Alarm was triggered when memory consumption had reached up to 60%
FreeChannelThis is the number of free / available Sockets or Channels in the system
FreeMemoryThis is the available or free memory which JVM can still use without any issues
JarsIncludedList of all the jars that are in CLASSPATH or included or leveraged by TQL engine
JavaVersionJava version that is being used by TQL engine
MaxMemoryThis is the size of maximum memory that is currently allocated to TQL engine or its JVM
MaxQueueCheckThis is an action which will be taken by the engine should any internal queue exceed maximum allowed size. Default action will give you a warning including queue name and size. Queue name corresponds to subscriber ID so you should be able to determine overloaded subscribers (i.e. subscribers which process jobs slower than new jobs are coming)
MaxQueueSizeThis is maximum internal queue size. Internal queues are used to serialize background jobs like TQL reporting and topic publishing processing (i.e. each subscriber would have its own queue and process all publishing requests in order)
NioAcceptedSocketChannelNumber of Accepted SocketChannels. Higher is this number higher are the chances of memory leak. Hence monitoring this parameter can be crucial
NioServerSocketChannelNumber of channels that are listening for incoming TCP connections
NullChannelNumber of Socket Channels that are not yet instantiated
OSOperating System, its version and architecture, on which TQL engine is hosted and running
ProcessImportanceThis field is maintained by internal memory management program of TQL engine. It denotes the importance of processes involved TQL engine. This importance can range between 0.0 to 1.0. If this value is 0.4 then, all processes below 0.4 will be considered for garbage collection when its triggered due to Alarm going off
ProcessorsNumber of logical Processors or CPUs with which engine is running
ServerIPIP address of server on which TQL engine is hosted or running
ServerNameName of the server or box hosting the engine
TCPclientInfoThis field provides information on TCP connections formed at client side, read and written bytes, total reads and writes and average time taken by the connection for reads
TCPserverInfoThis field provides information on TCP connections formed at server side, read and written bytes, total reads and writes and average time taken by the connection for reads
TotalChannelsThis is total number of Sockets or Channels in the system
TotalMemoryTotal memory out of which heap memory is picked by JVM
UsedMemoryMemory currently used by JVM or TQL engine
UserCountryCountry or location where TQL engine is running
UserDirectoryTQL_HOME directory for current user, from where TQL engine is running
UserLanguageLanguage preferred and set by user on the system TQL is running
UserTimeZoneTime Zone where TQL engine is running

You can receive notifications about key parameter changes by Subscribing to a Monitoring Service over Websocket.

Monitoring Service Websocket End Point: 

Topic Name: Atomiton.MonitorService.ProjectMonitor

Code Block
languagexml
titleMonitoring Service Request
linenumberstrue
<Query Storage='TqlSubscription'>
  <Save>
    <TqlSubscription Label='TQEMonitor' sid='20'>
      <Topic>
        *Atomiton.MonitorService.ProjectMonitor*
      </Topic>
    </TqlSubscription>
  </Save>
</Query>

The Response is a delete/creation of new monitoring record:

Code Block
languagexml
titleMonitoring Service Response
linenumberstrue
<TqlNotification>
  <DeleteAll>
    <K7KVSRMFAAAH6AAAAEKGOJ7B>
      <Atomiton.MonitorService.ProjectMonitor.UsedMemory Value="402,382,672" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.NioServerSocketChannel Value="1" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.TotalMemory Value="429,391,872" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.UserCountry Value="US" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.OS Value="Mac OS X 10.1 x86_64" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.UserTimeZone Value="America/Los_Angeles" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.JavaVersion Value="1.8.0_91-b14" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.ServerIP Value="127.0.0.1" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.AlarmCount Value="0" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.TCPserverInfo Value="Total(connections/reads/writes): (1,172/1,190/5,788); Time(total/per read): (3,764/3.163) ms; read: 545,920 bytes; written: 7,059,745 bytes" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.ProcessImportance Value="0.0" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.TCPclientInfo Value="Total(connections/reads/writes): (418/418/417); Time(total/per read): (371/0.888) ms; read: 5,366,349 bytes; written: 114,867 bytes" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.MaxMemory Value="3,817,865,216" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.NullChannel Value="2" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.UserDirectory Value="/Users/baseerkhan/iot/atomiton/production/rel-105" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.JarsIncluded Value="jar/OdaLib-2.0.0.jar,jar/com.atomiton.sff.api.jar,jar/com.atomiton.sff.dataflow.jar,jar/com.atomiton.sff.imp.base.jar,jar/com.atomiton.sff.imp.facet.jar,jar/com.atomiton.sff.imp.netty.jar,jar/com.atomiton.sff.storage.mongo.jar,jar/com.google.guava-12.0.1.jar,jar/org.apache.commons.jexl-2.1.1.jar,jar/org.apache.commons.lang-2.6.0.jar,jar/org.apache.felix.configadmin-1.8.10.jar,jar/org.apache.felix.log-1.0.1.jar,jar/org.apache.felix.metatype-1.1.2.jar,jar/org.apache.felix.scr-2.0.6.jar,jar/org.hsqldb.hsqldb-2.3.4.jar,jar/org.jboss.netty-3.10.6.jar,jar/org.ops4j.pax.logging.pax-logging-api-1.8.3.jar,jar/org.ops4j.pax.logging.pax-logging-service-1.8.3.jar" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.Processors Value="8" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.NioAcceptedSocketChannel Value="5" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.TotalChannels Value="9" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.MaxQueueCheck Value="warning" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.FreeChannel Value="" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.UserLanguage Value="en" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.ServerName Value="bkhan" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.AlarmLevel Value="0.0" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.MaxQueueSize Value="10000" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.projectSysId Value="OnChange" Version="1" Timestamp="1476753180037"/>
      <Atomiton.MonitorService.ProjectMonitor.FreeMemory Value="27,009,200" Version="1" Timestamp="1476753180037"/>
    </K7KVSRMFAAAH6AAAAEKGOJ7B>
  </DeleteAll>
</TqlNotification>
<TqlNotification>
  <Create>
    <K7KVTOVXAAAH6AAAAHMC7TXN>
      <Atomiton.MonitorService.ProjectMonitor.projectSysId Value="OnChange" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.AlarmLevel Value="0.0" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.AlarmCount Value="0" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.ProcessImportance Value="0.0" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.OS Value="Mac OS X 10.1 x86_64" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.Processors Value="8" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.MaxMemory Value="3,817,865,216" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.UsedMemory Value="387,791,880" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.FreeMemory Value="64,144,376" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.TotalMemory Value="451,936,256" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.ServerName Value="bkhan" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.ServerIP Value="127.0.0.1" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.TCPserverInfo Value="Total(connections/reads/writes): (1,173/1,191/5,789); Time(total/per read): (3,770/3.165) ms; read: 546,077 bytes; written: 7,071,973 bytes" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.TCPclientInfo Value="Total(connections/reads/writes): (419/419/418); Time(total/per read): (372/0.888) ms; read: 5,378,577 bytes; written: 115,024 bytes" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.NioServerSocketChannel Value="1" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.NioAcceptedSocketChannel Value="5" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.NullChannel Value="2" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.FreeChannel Value="" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.TotalChannels Value="9" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.JavaVersion Value="1.8.0_91-b14" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.JarsIncluded Value="jar/OdaLib-2.0.0.jar,jar/com.atomiton.sff.api.jar,jar/com.atomiton.sff.dataflow.jar,jar/com.atomiton.sff.imp.base.jar,jar/com.atomiton.sff.imp.facet.jar,jar/com.atomiton.sff.imp.netty.jar,jar/com.atomiton.sff.storage.mongo.jar,jar/com.google.guava-12.0.1.jar,jar/org.apache.commons.jexl-2.1.1.jar,jar/org.apache.commons.lang-2.6.0.jar,jar/org.apache.felix.configadmin-1.8.10.jar,jar/org.apache.felix.log-1.0.1.jar,jar/org.apache.felix.metatype-1.1.2.jar,jar/org.apache.felix.scr-2.0.6.jar,jar/org.hsqldb.hsqldb-2.3.4.jar,jar/org.jboss.netty-3.10.6.jar,jar/org.ops4j.pax.logging.pax-logging-api-1.8.3.jar,jar/org.ops4j.pax.logging.pax-logging-service-1.8.3.jar" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.UserCountry Value="US" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.UserTimeZone Value="America/Los_Angeles" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.UserLanguage Value="en" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.UserDirectory Value="/Users/baseerkhan/iot/atomiton/production/rel-105" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.MaxQueueSize Value="10000" Version="1" Timestamp="1476753210039"/>
      <Atomiton.MonitorService.ProjectMonitor.MaxQueueCheck Value="warning" Version="1" Timestamp="1476753210039"/>
    </K7KVTOVXAAAH6AAAAHMC7TXN>
  </Create>
</TqlNotification>