* add the poller
* save text status stuff
* add initial app page stuff
* add history table and start work on graphs
* checkpoint
* re-work the poudriere graph bits a bit more
* fix the poller and start work on the graphs
* polling fix
* more work on the poudriere stuff
* poke stuff with php-cs-fix
* add some more graphs
* more style fixes
* another style fix
* add more graphs
* add Poudriere docs
* add tests data
* some minor tests fixes
* a test tweak
* more test tweaks
* some more test tweaks
* tweak .data.build_info data .data.build_info to make the app data test saner
* derp... missed a item
* add app data
* replace is_int with is_numeric
* update the docs for wireguard for the new extend
* relocate the app data bit
* update the data for the wireguard test
* start reworking the wg app page... details part done
* app page mostly done
* finish the wireguard app page
* style fix
* now sorted
* add additional info to the peer page
* style fixes
* a small fix for the links
* style fix
* make the pubkey column in details link to the peer page
* escape the pubkey
* checkpoint work for now
* polling should be good now
* re-work php-fpm some more
* re-work the php-fpm app page
* add php-fpm_v1_combined.inc.php
* add more graphs
* more work
* add last request cpu
* fix stats for pools
* more graph work
* update the docs for php-fpm
* more graph work
* more graph stuff
* graph stuff now done
* some style fixes
* another style fix
* remove a unneeded use line
* add new tests
* add some missing items to the test
* json fix
* remove start time and add data
* add nfs-shared.inc.php
* add nfs poller
* polling now works
* add nfs.inc.php page
* mount options works now
* format cleanup
* add some missing items to the stats
* commit work from last night so I can swap over to ldap
* add gauge support
* save the OS type for it
* more work on NFS stuff
* more nfs work
* display cleanup some
* more nfs work
* update docs for NFS
* add nfs_server_rpc
* style fix
* add snmprec file
* more test stuff
* data cleanup
* style cleanup
* more style fix
* another style fix
* add deleted_at
* add client_rpc_info_calls
* more test tweaks
* more tweaks
* set two items as gauges that should be gauges
* convert a few more things from counters to gauges
* a few more tweaks for NFSv4
* breakout handling of suricata extend v. 1 returns
* initial work for suricata 7.0.0
* add shared file for various Suricata related variables
* update handling for new Suricata stuff
* fix suricata rrd name bits
* update suricata app page a bit
* misc
* add a new v2 suricata graph
* more suricata v2 graphs
* fix app data for suricata
* more graph work
* fix initial graphs
* the page selector for suricata v2
* more cleanup for suricata stuff
* add more graphs
* add suricata_v2_pkt_drop.inc.php
* add suricata_v2_error_delta.inc.php
* add suricata app layer flows graph
* add app layer tx
* start work on bypassed
* add flow bypass stuff
* add suricata error stuff
* add more graphs
* more suricata v2 work
* ...
* add packets overview
* cleanup suricata_packets_overview.inc.php
* more work on the overview graphs
* error delta is now per second
* cleanup suricata_v2_app_layer_error_alloc.inc.php
* add new flow proto stuff
* add suricata_v2_flow_proto
* add new overview graph
* update v2 app layer flows graph
* more v2 graph cleanup
* suricata graph cleanup
* suricata_dec_proto_overview now works
* more graph work for suricata
* more graph work
* add another overview graph
* snmp fix
* add a new overview graph
* add a new over view
* more graph stuff
* more memory graphs
* tidy pages bit
* more work on decoder stuff
* more decoder work
* decoder stuff done
* cleanup suricata_packets_overview.inc.php
* appl layer tx work
* add app flow stuff
* fix suricata_v2_decoder__event__ethernet.inc.php
* fix suricata_v2_decoder__event__ipv4.inc.php
* fix suricata_v2_decoder__event__ipv6.inc.php
* add alloc error stuff
* more error related work
* more error stuff
* start work on internal errors
* add internal error graphs
* parser error stuff done
* more decoder work
* decoder icmpv4
* more decoder work
* ltnull done
* mpls decoder stuff
* nsh decoder work
* decoder ppp done
* more decoder work
* more decoder work
* more vlan work
* vntag decoder stuff done
* descr_len auto set for generic stats
* ipv6 decoder stuff done
* style fix
* style fix
* more style cleanup
* more suricata graph work
* fix require usage
* tweak drop info a bit
* add some checks for for with suricata 7.0.4
* more suricata tweaks
* fix sagan instance handling
* another minor fix
* fix improper munging
* rever something accidentally added to this repo
* add linux_suricata-v2.snmprex
* rename the metrics for instances from instance_ to instances_
* add linux_suricata-v2.json test data
* style fix
* minor munging tweak
* style cleanup
* some app data fixes
* remove a typo from test data
* add deleted_at and make sure discovered is numeric and not a string 1
* derp... json fix
* remove something accidentally added
* fix a small erorr in the test data
* add a missing variable to the test data
* try another tweak for suricata json test stuff
* derp... fix a type in the suricata poller
* revert a test data change
* re-order some the metrics in the test
* some more metric re-ordering
* add a missing status
* remove something that was accidentally added to this branch instead of another
* strcmp cleanup
* style fix
* update dhcp polling for version 3 of the extend
* add initial lease display for dhcp
* note where I copied it from
* document the new ISC DHCP stuff
* add in displaying pool and subnet info
* finalize the docs the new dhcpd stuff
* rework the dhcp page to display more information in a cleaner manner
* now display port and device info if known for a lease
* minor comment cleanup for the dhcp page
* add tests
* do not display the optionbar if the extend is not 3+
* update dhcp-stats doc for -w
* poke includes/html/functions.inc.php with php-cs-fixer
* poke includes/html/pages/device/apps/dhcp-stats.inc.php with php-cs-fixer
* derp... add the tests and not the snmprec twice
* strftime -> date
* fix naming of the linux dhcp-stats test data files
* minor tweaks to the rest results
* test fix
* more test cleanup
* minor test fix
* set the data value for v3
* minor test tweak
* add sortable_table blade template
* no longer need render_table
* formatting fix
* add regexp to make sure the mac is sane
* style fix
* formatting cleanup
* some more formatting fixes
* add borgbackup poller
* add borgbackup app page
* add graphs for borg backup
* minor borgbackup graph fixes and cleanups
* don't use custom colors for borg backup
* add metrics
* add borgbackup to the apps page
* add borgbackup snmprec for v1
* add test file for borgbackup v1
* add borg backup docs
* various style fixes
* add a missing key to the test data
* $total_vars -> $to_total
* remove a accidentally added space to applications.md
* test tweaks
* add no_hourly option to generic_stats
* add some more options to generic stats and don't display hourly since it is not really useful for borg backup
* style fix
Disc is typically used for optical media, not hard disks (so unlikely
to encounter discs in mdraid related circumstances).
mdadm and friends use the disk spelling, the host script also shows
shows this `"disc_count": $(maybe_get "${mdadmSysDev}/md/raid_disks"),`
Fixing the variable names as well would be nice, but that change would
be a lot bigger and probably break things as it would need host script
adjustment synchronising and all that, but I think we can at least
change the cosmetic spelling.
https://en.wikipedia.org/wiki/Spelling_of_disc
* rework into a json app and support the old style
* working now
* add health checking
* add some datapoints to make writing alerts easy
* add a few missing item for has checks
* rework the app page
* use the right var for id9
* print the self test log if we have it
* add a graph for the max temp
* display the max temp graph
* display the health pass in the disk list if we have the data
* fix legacy handling and set app as ok
* replace id190 and id194 with the more useful maxtemp graph on the apps page
* don't print the additional info area for legacy extends
* add id232
* add id252 graph support
* properly display id232 now
* do not display SSD graphs for non-SSD disks
* for legacy extends, make sure we don't have a bad line
* add missing label for Product value
* fix metrics
* rework the metrics stuff a bit more
* typo fix
* more smart metrics cleanup
* add exit info to metrics
* style cleanup and logic checking for when disks are all now fine
* fix checking for no more health errors
* update the docs for SMART for v1 and remove slightly pointless notes about useSN
* update the docs
* initial test stuff
* add missing tests for the legacy code
* save if it it is legacy or not
* style cleanup
* update the smart legacy test
* style cleanup
* more test tweaking
* some more style cleanup
* more test fixes
* correct the disk ID for the legacy test da0 -> Z304VCFY
* more tests update
* more test cleanup
* begin cleanup of the v1 tests
* more v1 test updates
* more tests for v1
* more test cleanup
* fix exit_nonzero and add unhealthy metric
* add smart alerts
* add the metric unhealthy to the stat test
* use app data for the smart-common.inc.php
* add poller for mojo cape submit
* mojo_cape_submit poller now works
* add app page for mojo_cape_submit
* add basic generic stat graphs for mojo cape submit
* general size stats graph for mojo_cape_submit
* make sure we update slugs that did not see anything submitted for them
* sort the slugs by sub count
* add app protos graph and sub top 12 graphs
* add mojo cape submit docs
* add tests for mojo_cape_submit
* add mojo_cape_submit to the apps page
* add string helper for mojo_cape_submit
* poke lots of stuff with php-cs-fixer
* remove a unneeded line
* add a missing metric and app data to test
* add logsize poller
* add set size info
* add more stats
* add min size
* more logsize files
* add logsize
* fix creating log file links
* add two new graphs
* add some graphs
* add no_minus_d
* add no minus d to app page
* add count of log files
* save logsizes in app data
* rename title log sizes
* only show top 12
* add mean median and mode
* cleanup naming a bit
* the values for the files hash is now a int instead of another hash
* add new stats and correct median name
* now properly handle unseen
* fix logsize bits
* add combined
* update metrics and add some tests
* add logsize graphs to apps page
* add the logsize bit
* add logszie docs
* add some example alert rules
* style cleanup
* more style cleanup
* fix a few things for metrics and update the test
* fix a variable name in the test and update the data
* add suricata_extract
* convert from dervive to gauge and use delta
* add suricata_extract to includes/html/pages/apps.inc.php
* graph cleanup
* add sub_size
* add sub_size graph
* add docs for suricata extract
* add tests for suricata_extract
* add rules for suricata extract
* minor test tweaks
* add privoxy
* various style fixes
* cleanup option bar
* save metrics for privoxy now
* add instructions for privoxy
* add privoxy test data
* regen the test data
* add a few missing depends to the instructions
* add apps.inc.php entry for privoxy
* note the required log settings for privoxy
* style fix
* code stuff done for Sneck
* whoops, correct the abs value post adding it post rrd update
* return a array for getting the sneck data and nicely print the raw return value
* add test stuff and freeze time at 1650911765 for tests
* move the freezeTime
* add use Illuminate\Support\Carbon;
* more test changes
* rework freezeTime a bit more
* more test stuff
* another test
* rework it a bit again
* correct variable spelling for $time_diff
* remove freezeTime as we are using a old version of Laravel
* finalize graphs
* misc
* finalize sneck page
* mve the sneck tests as it needs a newer version of laravel than we are using
* add documents for sneck
* finalize the poller
* formatting cleanup
* correct comment type
* correct the spelling of description
* more documentation
* save the check returns as metrics
* add some more examples
* fix some of the sneck alerts and add a few more examples
* turn off time to polling by default
* suggest using ntp if enabled
* since we are zeroing time_to_polling by default, this now works
* backout some suggested changes for once we change to larval 9
* remove del_sneck_data as it is no longer used
* add more docs on the metrics
* php-cs-fixer to fix a few things
* update and fix sneck tests
* remote a metric from the test
* another minor tweak to the test
* one more minor change
* ahh! derp! think I found it finally... hopefully hanging this for the last time...
* now use app data
* now logs check changes
* add a missing )
* add a missing )
* some style fixes
* update the sneck page use to the app data stuff
* update the poller to use the new app data
* misc
* update sneck to log check status changes
* correct alert log messages
* correct a comment
* fix metrics
* derp, another fix
* test fix
* re-order to avoid warning
* poller update
* update sneck graphs
* update sneck graphs
* remove a unneeded line
* test update for discovery
* minor tweaks to the test and fix update the polling a bit
* style fix
* fix return data printing
* fix the test data to include app data
* attempted test fix
* add config def to apps.sneck.polling_time_diff
* cleanup docs a bit
* minor config tweaks
* minor doc cleanup
* add linux_softnet_stat poller
* add graphs and app page for linux_softnet_stat
* fix polling
* rename a few items, clean up the app specific page, and add to the apps page
* convert from derive to counter
* save the budget and budget_usecs to app data
* display current value of the budgets
* now track budget values
* add tests data
* rename it
* add docs for Linux Softnet Stat
* re-order and add budget for app page graph order
* style fix
* correct data location
* fix metrics for the json
* add alerts for ZFS
* add initial l2 bits to the poller for zfs
* more minor tweaks to the ZFS poller
* more zfs bits
* add new ZFS graphs
* begin adding L2 stuff
* add linux_zfs-v3 bits
* update zfs app page
* style fix
* update the data for the zfs legacy test
* test update for zfs v1
* fix some zfs tests
* more zfs v3 test cleanup
* another zfs v3 test data fix
* more zfs v3 test data cleanup
* more test tweaks
* Fix undefined constants
These have been broken for a long time. Likely they are unused.
* Fix undefined constants
These have been broken for a long time. Likely they are unused.
* re-add it
* add cape app page
* add initial cape graphs
* now work for the general page
* more udpates
* add cape pending
* add pending and cleanup for if there are no packages(likely cuckoo, so don't add extra items)
* rework the lack of packages a bit more
* more cuckoo related cleanupgiot
* fix cape error logging
* minor cleanups
* add a new graph and use it with cape... also lots of cape cleanups
* misc cape updates
* add percentile values for stats
* add fix for weekly
* don't display 1 day average if under 17 hours
* zero timeslots of packages not used for this time slot
* add avg stat graphs for cape
* now use the average graphs and update the app page
* add a new graph
* add CAPEv2 docs
* add tests data
* lots of style cleanup
* another tweak for the test data
* fix misc style issues
* add cape to apps page
* add nicecase for cape
* case fix
* json fix for test data
* add a missing stat
* some more test data tweaking
* more misc test updates
* more test tweaking
* more test work...
* more test data work
* add what is hopefully the final test tweak
* add HV::Monitor support
* document hv monitor
* add HV Monitor tests
* style cleanup
* fix a few missed style items
* test fix
* more test cleanup
* more minor test tweaks
* more test cleanup
* more test tweaking
* test ordering fix all done... hopefully
* more test cleanup
* minor formatting change
* add new poller
* add a missing ;
* formatting cleanup
* graph stuff and metrics move
* add rrd name
* clean up metrics/rrd def
* more metric/rrd def cleanup
* cleanup
* add basic opensearch graphs
* add opensearch to apps.inc.php
* begin work on opensearch app page
* formatting cleanup
* add translog graphs
* add a missing graph
* fix pending tasks
* add the ability to fetch the saved cluster name
* add fetching the cluster name
* correct the opensearch comment
* add combined shard stats
* add indexing graphs
* correct graph name
* correct some units as being per second
* add more graphs
* add more items for graph sets
* cleanup of units and naming... also more graphs
* more graph stuff
* change the RRD def again and define a few more graphs
* finish basic graph sets
* more graph stuff
* another rrd def change
* add more graphs
* add some more graph sets
* correct unit for c_task_max_in_time
* more graph stuff
* more graph stuff
* correct the unit
* add missing tw_time and another rrd def change
* another unit change
* add trc graphs
* more graph stuff
* add tseg graphs
* add all shards graph to both cluster items
* more graph stuff
* update opensearch app page
* add Opensearch\Elasticsearch app
* add opensearch tests
* run php-cs-fixer on two files
* add alert examples for checking cluster status
* remove an item that was accidentally added as a metric in the test but is not
* derp! thanks jellyfrog
* make it come up as Elisticsearch\Opensearch in the webui
* no longer use components, but app_data, for cluster name change
* update the web side for opensearch for using app_data
* style fix
* update opensearch for new app data stuff
* update to the new Application model
* update poller and device app page for ES/OS
* style cleanup
* update graphs
* test fix
* more test cleanup
* Update alert_rules.json
* begin work on breaking out the RRDs
* update all non-multi rrd graphs for opensearch
* update time_all
* add a unass shards graph
* correct rrd name
* should all be good now
* add missing tm stats
* Un Assigned -> Unassigned
* style cleanup
* another style fix
* remove cluster_name from saved metrics as it is not a metric
Co-authored-by: Tony Murray <[email protected]>
Co-authored-by: Jellyfrog <[email protected]>
* add sagan instance fetch function
* add sagan discovery
* add sagan poller
* add sagan graphs
* add graph sources
* add sagan to apps page
* remove alert
* more app graph work
* polling fix
* re-order keys and add alert key
* correct field key usage
* add alert and fix a missing unit
* more unit fixes
* add alert status
* add alert rules for sagan
* fix a missing : after S while I am here in the json stat tool helper... also add tests
* now add the tests
* add docs
* point php-cs-fixer at two files
* remove-unneeded sagan instance fetch function
* convert to use app_data
* style fix
* apply bennet-esyoil's suggestions here as well
* update for the new app model
* convert poller to the new method
* convert the sagan device app page
* convert sagan
* doc cleanup
* initial work on add the ability to save/fetch app data
* update to use get_app_data for ZFS
* update the poller for the new app_data stuff
* ZFS now logs changes to pools
* add schema update for app_data stuff
* small formatting fix
* add a missing \
* now adds a column
* sql-schema is no longer used, so remove the file that was added here
* misc cleanups
* rename the method in database/migrations/2022_07_03_1947_add_app_data.php
* hopefully fix the migration bit
* add the column to misc/db_schema.yaml
* more misc small DB fixes
* update the test as the json column uses collat of utf8mb4_bin
* revert the last change and try manually setting it to what is expected
* remove a extra ;
* update suricata as well
* correct the instance -> instances in one location to prevent the old instance list from being stomped
* remove a extra ;
* update fail2ban to use it as well
* remove two unused functions as suricata and fail2ban no longer use components
* style cleanup
* postgres poller updated to use it
* update html side of the postgres bits
* chronyd now uses app data bits now as well
* portactivity now uses it as well
* style fix
* sort the returned arrays from app_data
* correct log message for port activity
* collocation change
* try re-ordering it
* add in the new data column to the tests
* remove a extra ,
* hmm... ->collate('utf8mb4_unicode_ci') is not usable as apparently collate does not exist
* change the column type from json to longtext
* mv chronyd stuff while I sort out the rest of the tests... damn thing is always buggy
* hmm... fix a missing line then likely move stuff back
* style fix
* add fillable
* add the expexcted data for fail2ban json
* escape a " I missed
* add data for portactivity
* add suricata app data
* add app data to zfs legacy test
* put the moved tests back into place and update zfs-v1 test
* add app data for chronyd test
* add app data for fail2ban legacy test
* update zfs v1 app data
* add some notes on application dev work
* add Developing/Application-Notes.md to mkdocs.yml
* add data column to it
* added various suggestions from bennet-esyoil
* convert from isset to sizeof
* type fix
* fully remove the old save app data function and move it into a helper function... the other still needs cleaned up prior to removal
* update docs
* get_app_data is fully removed now as well
* a few style fixes
* add $casts
* update chronyd test
* attempt to fix the data
* more doc cleanup and try changing the cast
* style fix
* revert the changes to the chronyd test
* apply a few of murrant's suggestions
* document working with ->data as json and non-josn
* remove two no-longer used in this PR exceptions
* ->data now operates transparently
* style fix
* update data tests
* fix json
* test fix
* update the app notes to reflect how app data now works
* app test fix
* app data fix for linux_lsi
* json fix
* minor doc cleanup
* remove duplicate querty and use json_decode instead
* style fix
* modelize the app poller
* use a anon func instead of foreach
* test update
* style cleanup
* style cleanup
* another test cleanup
* more test cleanup
* reverse the test changes and add in some more glue code
* revert one of the test changes
* another small test fix
* Make things use models
Left some array access, but those will still work just fine.
* missed chronyd and portactivity
* rename poll to avoid make it any confusion
* Remove extra save and fix timestamp
* save any changes made to app->data
* nope, that was not it
* What are magic methods and how do they work?
* fix two typos
* update linux_lsi test
* change quote type
Co-authored-by: Tony Murray <[email protected]>
* add poller
* add a generic alert graph
* add support for .total
* add the initial work on the suricata app page
* add applayer flow sources
* more rrd work and add more fields
* add a missing graph to the suricata page
* add suricata to the apps page
* all working now for suricata
* add some suricata alert examples
* all done with the php
* update the application docs for Suricata
* add another note about Suricata stats in the docs
* add the test file
* add the test JSON
* remove a unneeded newline from the appication docs
* correct the type uptime type
* packets graph should by packets/sec
* minor formatting cleanup
* one more minor formatting cleanup
* shot in the dark to see if something fixes the angry linter
* fix snmpsim file
* add metrics
* add values to the metrics
* add a missing comma to the json
* add a missing line to snmprec and cleanup json a bit
* a few more minor changes to see if this makes it happy... regened via scripts/json-app-tool.php
* see if this will make it happy
* add suricata to app discovery and hope that fixes it... take a shot in the dark as to why the linter errors strangely on two of the files
* fix json
* add a missing ] to the json
* rename two graphs so it does not trigger one alert and add a missing metric
* whoops, *_alertString is not a metric
Tony Murray
Zane C. Bowers-Hadley
Tarek
bnerickson
SourceDoctor
Jellyfrog
Arjen Zonneveld
Henne Van Och
Peca Nesovanovic
Mark Westerterp
Henne Van Och
djamp42