Difference between revisions of "Stats Server"

From "PTTLink Wiki"
Jump to navigation Jump to search
Tag: visualeditor
 
(3 intermediate revisions by 2 users not shown)
Line 5: Line 5:
 
This consists of several C programs as CGI's and uses LMDB to store data nodes post to the server.  
 
This consists of several C programs as CGI's and uses LMDB to store data nodes post to the server.  
  
The source is under /usr/local/source/stats/  
+
The source is under /usr/local/src/status
  
 
* index.cgi - generates the code for the index page and textual output
 
* index.cgi - generates the code for the index page and textual output
Line 12: Line 12:
 
* getconn.cgi - not really needed for the user interface.  ?$NODE returns text with the total number of connected nodes and the state of each connected node separated by pipes
 
* getconn.cgi - not really needed for the user interface.  ?$NODE returns text with the total number of connected nodes and the state of each connected node separated by pipes
 
* statsdb.cgi - not needed for the interface.  If the compiled in IP is matched, it will return a dump of the database.   
 
* statsdb.cgi - not needed for the interface.  If the compiled in IP is matched, it will return a dump of the database.   
* jsondata.cgi - not needed for the interface, no sure what it does.
+
* jsondata.cgi - not needed for the interface, used for returning JSON formated node data from database.
 
* getstatus.cgi - generates the per node PNG image using getstatus and neato.  This is a bash script.  
 
* getstatus.cgi - generates the per node PNG image using getstatus and neato.  This is a bash script.  
 
* graphic-status.html - used to display the big network wide graph
 
* graphic-status.html - used to display the big network wide graph
Line 28: Line 28:
 
* /var/www/stats-private/stats-lmdb - location of the LMDB database.  This should be compiled in.  
 
* /var/www/stats-private/stats-lmdb - location of the LMDB database.  This should be compiled in.  
 
For speed we can run the stats db on a tempfs in memory.  I've disabled this for now.  but it could be enabled in /etc/fstab.
 
For speed we can run the stats db on a tempfs in memory.  I've disabled this for now.  but it could be enabled in /etc/fstab.
 +
 +
'''Note: The db hangs from time to time and one needs to run a cron job of /usr/local/src/liblmdb/mdb_stat -rr /var/www/stats-private/stats-lmdb to clear the stale readers. see: http://www.lmdb.tech/doc/index.html'''
 +
 +
[[Category: Infrastructure]]

Latest revision as of 18:39, 5 August 2018

Status server

Requires graphviz

This consists of several C programs as CGI's and uses LMDB to store data nodes post to the server.

The source is under /usr/local/src/status

  • index.cgi - generates the code for the index page and textual output
  • uhandler.cgi - receives the http get requests of data from the nodes and writes it to the LMDB
  • nodeinfo.cgi - gives the per node report text page
  • getconn.cgi - not really needed for the user interface. ?$NODE returns text with the total number of connected nodes and the state of each connected node separated by pipes
  • statsdb.cgi - not needed for the interface. If the compiled in IP is matched, it will return a dump of the database.
  • jsondata.cgi - not needed for the interface, used for returning JSON formated node data from database.
  • getstatus.cgi - generates the per node PNG image using getstatus and neato. This is a bash script.
  • graphic-status.html - used to display the big network wide graph

These next are not publicly accessible files and are called by the system for generating the various parts of the config.

These must be installed under /var/www/stats-private

  • updatenodesdb - updates the database from the registration server. The registration server must permit this.
  • dostatus - executed from roots crontab, and makes the overall network PNG
  • mkstatslmdb - makes the raw stats LMDB if not there, might be good to run on boot
  • mkstatus - used by dostatus, it makes the text data that neato uses to make the large graph
  • getstatus - used by getstatus.cgi, it makes the text data neato uses to build the per node graph
  • /var/www/stats-private/stats-lmdb - location of the LMDB database. This should be compiled in.

For speed we can run the stats db on a tempfs in memory. I've disabled this for now. but it could be enabled in /etc/fstab.

Note: The db hangs from time to time and one needs to run a cron job of /usr/local/src/liblmdb/mdb_stat -rr /var/www/stats-private/stats-lmdb to clear the stale readers. see: http://www.lmdb.tech/doc/index.html