Files
librenms-librenms/tests/data/linux_zfs-legacy.json
Zane C. Bowers-Hadley 0bbcde1227 add the ability for storing app data to prevent spamming of the event log via via component usage (#14087)
* initial work on add the ability to save/fetch app data

* update to use get_app_data for ZFS

* update the poller for the new app_data stuff

* ZFS now logs changes to pools

* add schema update for app_data stuff

* small formatting fix

* add a missing \

* now adds a column

* sql-schema is no longer used, so remove the file that was added here

* misc cleanups

* rename the method in database/migrations/2022_07_03_1947_add_app_data.php

* hopefully fix the migration bit

* add the column to misc/db_schema.yaml

* more misc small DB fixes

* update the test as the json column uses collat of utf8mb4_bin

* revert the last change and try manually setting it to what is expected

* remove a extra ;

* update suricata as well

* correct the instance -> instances in one location to prevent the old instance list from being stomped

* remove a extra ;

* update fail2ban to use it as well

* remove two unused functions as suricata and fail2ban no longer use components

* style cleanup

* postgres poller updated to use it

* update html side of the postgres bits

* chronyd now uses app data bits now as well

* portactivity now uses it as well

* style fix

* sort the returned arrays from app_data

* correct log message for port activity

* collocation change

* try re-ordering it

* add in the new data column to the tests

* remove a extra ,

* hmm... ->collate('utf8mb4_unicode_ci') is not usable as apparently collate does not exist

* change the column type from json to longtext

* mv chronyd stuff while I sort out the rest of the tests... damn thing is always buggy

* hmm... fix a missing line then likely move stuff back

* style fix

* add fillable

* add the expexcted data for fail2ban json

* escape a " I missed

* add data for portactivity

* add suricata app data

* add app data to zfs legacy test

* put the moved tests back into place and update zfs-v1 test

* add app data for chronyd test

* add app data for fail2ban legacy test

* update zfs v1 app data

* add some notes on application dev work

* add Developing/Application-Notes.md to mkdocs.yml

* add data column to it

* added various suggestions from bennet-esyoil

* convert from isset to sizeof

* type fix

* fully remove the old save app data function and move it into a helper function... the other still needs cleaned up prior to removal

* update docs

* get_app_data is fully removed now as well

* a few style fixes

* add $casts

* update chronyd test

* attempt to fix the data

* more doc cleanup and try changing the cast

* style fix

* revert the changes to the chronyd test

* apply a few of murrant's suggestions

* document working with ->data as json and non-josn

* remove two no-longer used in this PR exceptions

* ->data now operates transparently

* style fix

* update data tests

* fix json

* test fix

* update the app notes to reflect how app data now works

* app test fix

* app data fix for linux_lsi

* json fix

* minor doc cleanup

* remove duplicate querty and use json_decode instead

* style fix

* modelize the app poller

* use a anon func instead of foreach

* test update

* style cleanup

* style cleanup

* another test cleanup

* more test cleanup

* reverse the test changes and add in some more glue code

* revert one of the test changes

* another small test fix

* Make things use models
Left some array access, but those will still work just fine.

* missed chronyd and portactivity

* rename poll to avoid make it any confusion

* Remove extra save and fix timestamp

* save any changes made to app->data

* nope, that was not it

* What are magic methods and how do they work?

* fix two typos

* update linux_lsi test

* change quote type

Co-authored-by: Tony Murray <murraytony@gmail.com>
2022-07-22 16:01:55 -05:00

414 lines
14 KiB
JSON

{
"applications": {
"discovery": {
"applications": [
{
"app_type": "zfs",
"app_state": "UNKNOWN",
"discovered": 1,
"app_state_prev": null,
"app_status": "",
"app_instance": "",
"data": null
}
]
},
"poller": {
"applications": [
{
"app_type": "zfs",
"app_state": "OK",
"discovered": 1,
"app_state_prev": "UNKNOWN",
"app_status": "",
"app_instance": "",
"data": "{\"pools\":[\"arc\"]}"
}
],
"application_metrics": [
{
"metric": "actual_hit_per",
"value": 91.264716658306,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "anon_hits",
"value": 1735151,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "anon_hits_per",
"value": 0.87447363662197,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "arc_accesses_total",
"value": 213732964,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "arc_hits",
"value": 198422334,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "arc_misses",
"value": 15310630,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "arc_size",
"value": 4811379336,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "arc_size_per",
"value": 14.893344946427,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "cache_hits_per",
"value": 92.836561233484,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "cache_miss_per",
"value": 7.1634387665162,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "data_demand_per",
"value": 98.185847580587,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "data_pre_per",
"value": 76.243415839277,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "deleted",
"value": 0,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "demand_data_hits",
"value": 1295901,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "demand_data_misses",
"value": 23944,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "demand_data_total",
"value": 1319845,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "demand_hits_per",
"value": 0.65310238715366,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "demand_meta_hits",
"value": 189163699,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "demand_meta_misses",
"value": 14348845,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "demand_misses_per",
"value": 0.15638807808692,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "evict_skip",
"value": 0,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "freq_used_per",
"value": 30.42081926587,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "meta_hits_per",
"value": 95.333874562729,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "meta_misses_per",
"value": 93.718187951769,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mfu_ghost_hits",
"value": 1032016,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mfu_ghost_per",
"value": 0.5201108056717,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mfu_hits",
"value": 159197014,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mfu_per",
"value": 80.231398749699,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mfu_size",
"value": 1463661012,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "min_size_per",
"value": 12.5,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mru_ghost_hits",
"value": 592383,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mru_ghost_per",
"value": 0.29854653357721,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mru_hits",
"value": 35865770,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mru_per",
"value": 18.07547027443,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "mutex_skip",
"value": 113,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "p",
"value": 3347718324,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pool_arc_alloc",
"value": 12194087313408,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pool_arc_cap",
"value": 45,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pool_arc_dedup",
"value": 76,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pool_arc_expandsz",
"value": 0,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pool_arc_frag",
"value": -1,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pool_arc_free",
"value": 3748831289344,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pool_arc_size",
"value": 15942918602752,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_data_hits",
"value": 32713,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_data_misses",
"value": 10193,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_data_total",
"value": 42906,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_hits_per",
"value": 0.016486551357671,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_meta_hits",
"value": 7930021,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_meta_hits_per",
"value": 3.9965364987593,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_meta_misses",
"value": 927648,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_meta_misses_per",
"value": 6.0588493092707,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "pre_misses_per",
"value": 0.066574660872871,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "real_hits",
"value": 195062784,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "rec_used_per",
"value": 69.579180734129,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "recycle_miss",
"value": 0,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "target_size",
"value": 5184353784,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "target_size_arat",
"value": 0.16047865661247,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "target_size_max",
"value": 32305565696,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "target_size_min",
"value": 4038195712,
"value_prev": null,
"app_type": "zfs"
},
{
"metric": "target_size_per",
"value": 16.047865661247,
"value_prev": null,
"app_type": "zfs"
}
]
}
},
"os": {
"discovery": {
"devices": [
{
"sysName": "<private>",
"sysObjectID": ".1.3.6.1.4.1.8072.3.2.10",
"sysDescr": "Linux server 3.10.0-693.5.2.el7.x86_64 #1 SMP Fri Oct 20 20:32:50 UTC 2017 x86_64",
"sysContact": "<private>",
"version": "3.10.0-693.5.2.el7.x86_64",
"hardware": "Generic x86 64-bit",
"features": null,
"os": "linux",
"type": "server",
"serial": null,
"icon": "linux.svg",
"location": "<private>"
}
]
},
"poller": "matches discovery"
}
}