mirror of
https://github.com/netdata/netdata.git
synced 2025-04-12 16:58:10 +00:00

* rrdset - in progress * rrdset optimal constructor; rrdset conflict * rrdset final touches * re-organization of rrdset object members * prevent use-after-free * dictionary dfe supports also counting of iterations * rrddim managed by dictionary * rrd.h cleanup * DICTIONARY_ITEM now is referencing actual dictionary items in the code * removed rrdset linked list * Revert "removed rrdset linked list" This reverts commit 690d6a588b4b99619c2c5e10f84e8f868ae6def5. * removed rrdset linked list * added comments * Switch chart uuid to static allocation in rrdset Remove unused functions * rrdset_archive() and friends... * always create rrdfamily * enable ml_free_dimension * rrddim_foreach done with dfe * most custom rrddim loops replaced with rrddim_foreach * removed accesses to rrddim->dimensions * removed locks that are no longer needed * rrdsetvar is now managed by the dictionary * set rrdset is rrdsetvar, fixes https://github.com/netdata/netdata/pull/13646#issuecomment-1242574853 * conflict callback of rrdsetvar now properly checks if it has to reset the variable * dictionary registered callbacks accept as first parameter the DICTIONARY_ITEM * dictionary dfe now uses internal counter to report; avoided excess variables defined with dfe * dictionary walkthrough callbacks get dictionary acquired items * dictionary reference counters that can be dupped from zero * added advanced functions for get and del * rrdvar managed by dictionaries * thread safety for rrdsetvar * faster rrdvar initialization * rrdvar string lengths should match in all add, del, get functions * rrdvar internals hidden from the rest of the world * rrdvar is now acquired throughout netdata * hide the internal structures of rrdsetvar * rrdsetvar is now acquired through out netdata * rrddimvar managed by dictionary; rrddimvar linked list removed; rrddimvar structures hidden from the rest of netdata * better error handling * dont create variables if not initialized for health * dont create variables if not initialized for health again * rrdfamily is now managed by dictionaries; references of it are acquired dictionary items * type checking on acquired objects * rrdcalc renaming of functions * type checking for rrdfamily_acquired * rrdcalc managed by dictionaries * rrdcalc double free fix * host rrdvars is always needed * attempt to fix deadlock 1 * attempt to fix deadlock 2 * Remove unused variable * attempt to fix deadlock 3 * snprintfz * rrdcalc index in rrdset fix * Stop storing active charts and computing chart hashes * Remove store active chart function * Remove compute chart hash function * Remove sql_store_chart_hash function * Remove store_active_dimension function * dictionary delayed destruction * formatting and cleanup * zero dictionary base on rrdsetvar * added internal error to log delayed destructions of dictionaries * typo in rrddimvar * added debugging info to dictionary * debug info * fix for rrdcalc keys being empty * remove forgotten unlock * remove deadlock * Switch to metadata version 5 and drop chart_hash chart_hash_map chart_active dimension_active v_chart_hash * SQL cosmetic changes * do not busy wait while destroying a referenced dictionary * remove deadlock * code cleanup; re-organization; * fast cleanup and flushing of dictionaries * number formatting fixes * do not delete configured alerts when archiving a chart * rrddim obsolete linked list management outside dictionaries * removed duplicate contexts call * fix crash when rrdfamily is not initialized * dont keep rrddimvar referenced * properly cleanup rrdvar * removed some locks * Do not attempt to cleanup chart_hash / chart_hash_map * rrdcalctemplate managed by dictionary * register callbacks on the right dictionary * removed some more locks * rrdcalc secondary index replaced with linked-list; rrdcalc labels updates are now executed by health thread * when looking up for an alarm look using both chart id and chart name * host initialization a bit more modular * init rrdlabels on host update * preparation for dictionary views * improved comment * unused variables without internal checks * service threads isolation and worker info * more worker info in service thread * thread cancelability debugging with internal checks * strings data races addressed; fixes https://github.com/netdata/netdata/issues/13647 * dictionary modularization * Remove unused SQL statement definition * unit-tested thread safety of dictionaries; removed data race conditions on dictionaries and strings; dictionaries now can detect if the caller is holds a write lock and automatically all the calls become their unsafe versions; all direct calls to unsafe version is eliminated * remove worker_is_idle() from the exit of service functions, because we lose the lock time between loops * rewritten dictionary to have 2 separate locks, one for indexing and another for traversal * Update collectors/cgroups.plugin/sys_fs_cgroup.c Co-authored-by: Vladimir Kobal <vlad@prokk.net> * Update collectors/cgroups.plugin/sys_fs_cgroup.c Co-authored-by: Vladimir Kobal <vlad@prokk.net> * Update collectors/proc.plugin/proc_net_dev.c Co-authored-by: Vladimir Kobal <vlad@prokk.net> * fix memory leak in rrdset cache_dir * minor dictionary changes * dont use index locks in single threaded * obsolete dict option * rrddim options and flags separation; rrdset_done() optimization to keep array of reference pointers to rrddim; * fix jump on uninitialized value in dictionary; remove double free of cache_dir * addressed codacy findings * removed debugging code * use the private refcount on dictionaries * make dictionary item desctructors work on dictionary destruction; strictier control on dictionary API; proper cleanup sequence on rrddim; * more dictionary statistics * global statistics about dictionary operations, memory, items, callbacks * dictionary support for views - missing the public API * removed warning about unused parameter * chart and context name for cloud * chart and context name for cloud, again * dictionary statistics fixed; first implementation of dictionary views - not currently used * only the master can globally delete an item * context needs netdata prefix * fix context and chart it of spins * fix for host variables when health is not enabled * run garbage collector on item insert too * Fix info message; remove extra "using" * update dict unittest for new placement of garbage collector * we need RRDHOST->rrdvars for maintaining custom host variables * Health initialization needs the host->host_uuid * split STRING to its own files; no code changes other than that * initialize health unconditionally * unit tests do not pollute the global scope with their variables * Skip initialization when creating archived hosts on startup. When a child connects it will initialize properly Co-authored-by: Stelios Fragkakis <52996999+stelfrag@users.noreply.github.com> Co-authored-by: Vladimir Kobal <vlad@prokk.net>
820 lines
26 KiB
C
820 lines
26 KiB
C
// SPDX-License-Identifier: GPL-3.0-or-later
|
|
|
|
#include "pluginsd_parser.h"
|
|
|
|
/*
|
|
* This is the action defined for the FLUSH command
|
|
*/
|
|
PARSER_RC pluginsd_set_action(void *user, RRDSET *st, RRDDIM *rd, long long int value)
|
|
{
|
|
UNUSED(user);
|
|
|
|
rrddim_set_by_pointer(st, rd, value);
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_flush_action(void *user, RRDSET *st)
|
|
{
|
|
UNUSED(user);
|
|
UNUSED(st);
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_begin_action(void *user, RRDSET *st, usec_t microseconds, int trust_durations)
|
|
{
|
|
UNUSED(user);
|
|
if (likely(st->counter_done)) {
|
|
if (likely(microseconds)) {
|
|
if (trust_durations)
|
|
rrdset_next_usec_unfiltered(st, microseconds);
|
|
else
|
|
rrdset_next_usec(st, microseconds);
|
|
} else
|
|
rrdset_next(st);
|
|
}
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
|
|
PARSER_RC pluginsd_end_action(void *user, RRDSET *st)
|
|
{
|
|
UNUSED(user);
|
|
|
|
rrdset_done(st);
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_chart_action(void *user, char *type, char *id, char *name, char *family, char *context, char *title, char *units, char *plugin,
|
|
char *module, int priority, int update_every, RRDSET_TYPE chart_type, char *options)
|
|
{
|
|
RRDSET *st = NULL;
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
|
|
st = rrdset_create(
|
|
host, type, id, name, family, context, title, units,
|
|
plugin, module, priority, update_every,
|
|
chart_type);
|
|
|
|
if (options && *options) {
|
|
if (strstr(options, "obsolete"))
|
|
rrdset_is_obsolete(st);
|
|
else
|
|
rrdset_isnot_obsolete(st);
|
|
|
|
if (strstr(options, "detail"))
|
|
rrdset_flag_set(st, RRDSET_FLAG_DETAIL);
|
|
else
|
|
rrdset_flag_clear(st, RRDSET_FLAG_DETAIL);
|
|
|
|
if (strstr(options, "hidden"))
|
|
rrdset_flag_set(st, RRDSET_FLAG_HIDDEN);
|
|
else
|
|
rrdset_flag_clear(st, RRDSET_FLAG_HIDDEN);
|
|
|
|
if (strstr(options, "store_first"))
|
|
rrdset_flag_set(st, RRDSET_FLAG_STORE_FIRST);
|
|
else
|
|
rrdset_flag_clear(st, RRDSET_FLAG_STORE_FIRST);
|
|
} else {
|
|
rrdset_isnot_obsolete(st);
|
|
rrdset_flag_clear(st, RRDSET_FLAG_DETAIL);
|
|
rrdset_flag_clear(st, RRDSET_FLAG_STORE_FIRST);
|
|
}
|
|
((PARSER_USER_OBJECT *)user)->st = st;
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
|
|
PARSER_RC pluginsd_disable_action(void *user)
|
|
{
|
|
UNUSED(user);
|
|
|
|
info("called DISABLE. Disabling it.");
|
|
((PARSER_USER_OBJECT *) user)->enabled = 0;
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
|
|
PARSER_RC pluginsd_variable_action(void *user, RRDHOST *host, RRDSET *st, char *name, int global, NETDATA_DOUBLE value)
|
|
{
|
|
UNUSED(user);
|
|
|
|
if (global) {
|
|
const RRDVAR_ACQUIRED *rva = rrdvar_custom_host_variable_add_and_acquire(host, name);
|
|
if (rva) {
|
|
rrdvar_custom_host_variable_set(host, rva, value);
|
|
rrdvar_custom_host_variable_release(host, rva);
|
|
}
|
|
else
|
|
error("cannot find/create HOST VARIABLE '%s' on host '%s'", name, rrdhost_hostname(host));
|
|
} else {
|
|
const RRDSETVAR_ACQUIRED *rsa = rrdsetvar_custom_chart_variable_add_and_acquire(st, name);
|
|
if (rsa) {
|
|
rrdsetvar_custom_chart_variable_set(st, rsa, value);
|
|
rrdsetvar_custom_chart_variable_release(st, rsa);
|
|
}
|
|
else
|
|
error("cannot find/create CHART VARIABLE '%s' on host '%s', chart '%s'", name, rrdhost_hostname(host), rrdset_id(st));
|
|
}
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
|
|
|
|
PARSER_RC pluginsd_dimension_action(void *user, RRDSET *st, char *id, char *name, char *algorithm, long multiplier, long divisor, char *options,
|
|
RRD_ALGORITHM algorithm_type)
|
|
{
|
|
UNUSED(user);
|
|
UNUSED(algorithm);
|
|
|
|
RRDDIM *rd = rrddim_add(st, id, name, multiplier, divisor, algorithm_type);
|
|
int unhide_dimension = 1;
|
|
|
|
rrddim_option_clear(rd, RRDDIM_OPTION_DONT_DETECT_RESETS_OR_OVERFLOWS);
|
|
if (options && *options) {
|
|
if (strstr(options, "obsolete") != NULL)
|
|
rrddim_is_obsolete(st, rd);
|
|
else
|
|
rrddim_isnot_obsolete(st, rd);
|
|
|
|
unhide_dimension = !strstr(options, "hidden");
|
|
|
|
if (strstr(options, "noreset") != NULL)
|
|
rrddim_option_set(rd, RRDDIM_OPTION_DONT_DETECT_RESETS_OR_OVERFLOWS);
|
|
if (strstr(options, "nooverflow") != NULL)
|
|
rrddim_option_set(rd, RRDDIM_OPTION_DONT_DETECT_RESETS_OR_OVERFLOWS);
|
|
} else
|
|
rrddim_isnot_obsolete(st, rd);
|
|
|
|
if (likely(unhide_dimension)) {
|
|
rrddim_option_clear(rd, RRDDIM_OPTION_HIDDEN);
|
|
if (rrddim_flag_check(rd, RRDDIM_FLAG_META_HIDDEN)) {
|
|
(void)sql_set_dimension_option(&rd->metric_uuid, NULL);
|
|
rrddim_flag_clear(rd, RRDDIM_FLAG_META_HIDDEN);
|
|
}
|
|
} else {
|
|
rrddim_option_set(rd, RRDDIM_OPTION_HIDDEN);
|
|
if (!rrddim_flag_check(rd, RRDDIM_FLAG_META_HIDDEN)) {
|
|
(void)sql_set_dimension_option(&rd->metric_uuid, "hidden");
|
|
rrddim_flag_set(rd, RRDDIM_FLAG_META_HIDDEN);
|
|
}
|
|
}
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_label_action(void *user, char *key, char *value, RRDLABEL_SRC source)
|
|
{
|
|
|
|
if(unlikely(!((PARSER_USER_OBJECT *) user)->new_host_labels))
|
|
((PARSER_USER_OBJECT *) user)->new_host_labels = rrdlabels_create();
|
|
|
|
rrdlabels_add(((PARSER_USER_OBJECT *)user)->new_host_labels, key, value, source);
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_clabel_action(void *user, char *key, char *value, RRDLABEL_SRC source)
|
|
{
|
|
if(unlikely(!((PARSER_USER_OBJECT *) user)->new_chart_labels))
|
|
((PARSER_USER_OBJECT *) user)->new_chart_labels = rrdlabels_create();
|
|
|
|
rrdlabels_add(((PARSER_USER_OBJECT *)user)->new_chart_labels, key, value, source);
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_clabel_commit_action(void *user, RRDHOST *host, DICTIONARY *new_chart_labels)
|
|
{
|
|
RRDSET *st = ((PARSER_USER_OBJECT *)user)->st;
|
|
if (unlikely(!st)) {
|
|
error("requested CLABEL_COMMIT on host '%s', without a BEGIN, ignoring it.", rrdhost_hostname(host));
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
rrdset_update_rrdlabels(st, new_chart_labels);
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_overwrite_action(void *user, RRDHOST *host, DICTIONARY *new_host_labels)
|
|
{
|
|
UNUSED(user);
|
|
|
|
if(!host->rrdlabels)
|
|
host->rrdlabels = rrdlabels_create();
|
|
|
|
rrdlabels_migrate_to_these(host->rrdlabels, new_host_labels);
|
|
sql_store_host_labels(host);
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_set(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *dimension = words[1];
|
|
char *value = words[2];
|
|
|
|
RRDSET *st = ((PARSER_USER_OBJECT *) user)->st;
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
|
|
if (unlikely(!dimension || !*dimension)) {
|
|
error("requested a SET on chart '%s' of host '%s', without a dimension. Disabling it.", rrdset_id(st), rrdhost_hostname(host));
|
|
goto disable;
|
|
}
|
|
|
|
if (unlikely(!value || !*value))
|
|
value = NULL;
|
|
|
|
if (unlikely(!st)) {
|
|
error(
|
|
"requested a SET on dimension %s with value %s on host '%s', without a BEGIN. Disabling it.", dimension,
|
|
value ? value : "<nothing>", rrdhost_hostname(host));
|
|
goto disable;
|
|
}
|
|
|
|
if (unlikely(rrdset_flag_check(st, RRDSET_FLAG_DEBUG)))
|
|
debug(D_PLUGINSD, "is setting dimension '%s'/'%s' to '%s'", rrdset_id(st), dimension, value ? value : "<nothing>");
|
|
|
|
if (value) {
|
|
RRDDIM *rd = rrddim_find(st, dimension);
|
|
if (unlikely(!rd)) {
|
|
error(
|
|
"requested a SET to dimension with id '%s' on stats '%s' (%s) on host '%s', which does not exist. Disabling it.",
|
|
dimension, rrdset_name(st), rrdset_id(st), rrdhost_hostname(st->rrdhost));
|
|
goto disable;
|
|
} else {
|
|
if (plugins_action->set_action) {
|
|
return plugins_action->set_action(
|
|
user, st, rd, strtoll(value, NULL, 0));
|
|
}
|
|
}
|
|
}
|
|
return PARSER_RC_OK;
|
|
|
|
disable:
|
|
((PARSER_USER_OBJECT *) user)->enabled = 0;
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
PARSER_RC pluginsd_begin(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *id = words[1];
|
|
char *microseconds_txt = words[2];
|
|
|
|
RRDSET *st = NULL;
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *)user)->host;
|
|
|
|
if (unlikely(!id)) {
|
|
error("requested a BEGIN without a chart id for host '%s'. Disabling it.", rrdhost_hostname(host));
|
|
goto disable;
|
|
}
|
|
|
|
st = rrdset_find(host, id);
|
|
if (unlikely(!st)) {
|
|
error("requested a BEGIN on chart '%s', which does not exist on host '%s'. Disabling it.", id, rrdhost_hostname(host));
|
|
goto disable;
|
|
}
|
|
((PARSER_USER_OBJECT *)user)->st = st;
|
|
|
|
usec_t microseconds = 0;
|
|
if (microseconds_txt && *microseconds_txt)
|
|
microseconds = str2ull(microseconds_txt);
|
|
|
|
if (plugins_action->begin_action) {
|
|
return plugins_action->begin_action(user, st, microseconds,
|
|
((PARSER_USER_OBJECT *)user)->trust_durations);
|
|
}
|
|
return PARSER_RC_OK;
|
|
disable:
|
|
((PARSER_USER_OBJECT *)user)->enabled = 0;
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
PARSER_RC pluginsd_end(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
UNUSED(words);
|
|
RRDSET *st = ((PARSER_USER_OBJECT *) user)->st;
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
|
|
if (unlikely(!st)) {
|
|
error("requested an END, without a BEGIN on host '%s'. Disabling it.", rrdhost_hostname(host));
|
|
((PARSER_USER_OBJECT *) user)->enabled = 0;
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
if (unlikely(rrdset_flag_check(st, RRDSET_FLAG_DEBUG)))
|
|
debug(D_PLUGINSD, "requested an END on chart '%s'", rrdset_id(st));
|
|
|
|
((PARSER_USER_OBJECT *) user)->st = NULL;
|
|
((PARSER_USER_OBJECT *) user)->count++;
|
|
if (plugins_action->end_action) {
|
|
return plugins_action->end_action(user, st);
|
|
}
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_chart(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
if (unlikely(!host && !((PARSER_USER_OBJECT *) user)->host_exists)) {
|
|
debug(D_PLUGINSD, "Ignoring chart belonging to missing or ignored host.");
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
char *type = words[1];
|
|
char *name = words[2];
|
|
char *title = words[3];
|
|
char *units = words[4];
|
|
char *family = words[5];
|
|
char *context = words[6];
|
|
char *chart = words[7];
|
|
char *priority_s = words[8];
|
|
char *update_every_s = words[9];
|
|
char *options = words[10];
|
|
char *plugin = words[11];
|
|
char *module = words[12];
|
|
|
|
int have_action = ((plugins_action->chart_action) != NULL);
|
|
|
|
// parse the id from type
|
|
char *id = NULL;
|
|
if (likely(type && (id = strchr(type, '.')))) {
|
|
*id = '\0';
|
|
id++;
|
|
}
|
|
|
|
// make sure we have the required variables
|
|
if (unlikely((!type || !*type || !id || !*id))) {
|
|
if (likely(host))
|
|
error("requested a CHART, without a type.id, on host '%s'. Disabling it.", rrdhost_hostname(host));
|
|
else
|
|
error("requested a CHART, without a type.id. Disabling it.");
|
|
((PARSER_USER_OBJECT *) user)->enabled = 0;
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
// parse the name, and make sure it does not include 'type.'
|
|
if (unlikely(name && *name)) {
|
|
// when data are streamed from child nodes
|
|
// name will be type.name
|
|
// so we have to remove 'type.' from name too
|
|
size_t len = strlen(type);
|
|
if (strncmp(type, name, len) == 0 && name[len] == '.')
|
|
name = &name[len + 1];
|
|
|
|
// if the name is the same with the id,
|
|
// or is just 'NULL', clear it.
|
|
if (unlikely(strcmp(name, id) == 0 || strcasecmp(name, "NULL") == 0 || strcasecmp(name, "(NULL)") == 0))
|
|
name = NULL;
|
|
}
|
|
|
|
int priority = 1000;
|
|
if (likely(priority_s && *priority_s))
|
|
priority = str2i(priority_s);
|
|
|
|
int update_every = ((PARSER_USER_OBJECT *) user)->cd->update_every;
|
|
if (likely(update_every_s && *update_every_s))
|
|
update_every = str2i(update_every_s);
|
|
if (unlikely(!update_every))
|
|
update_every = ((PARSER_USER_OBJECT *) user)->cd->update_every;
|
|
|
|
RRDSET_TYPE chart_type = RRDSET_TYPE_LINE;
|
|
if (unlikely(chart))
|
|
chart_type = rrdset_type_id(chart);
|
|
|
|
if (unlikely(name && !*name))
|
|
name = NULL;
|
|
if (unlikely(family && !*family))
|
|
family = NULL;
|
|
if (unlikely(context && !*context))
|
|
context = NULL;
|
|
if (unlikely(!title))
|
|
title = "";
|
|
if (unlikely(!units))
|
|
units = "unknown";
|
|
|
|
debug(
|
|
D_PLUGINSD,
|
|
"creating chart type='%s', id='%s', name='%s', family='%s', context='%s', chart='%s', priority=%d, update_every=%d",
|
|
type, id, name ? name : "", family ? family : "", context ? context : "", rrdset_type_name(chart_type),
|
|
priority, update_every);
|
|
|
|
if (have_action) {
|
|
return plugins_action->chart_action(
|
|
user, type, id, name, family, context, title, units,
|
|
(plugin && *plugin) ? plugin : ((PARSER_USER_OBJECT *)user)->cd->filename, module, priority, update_every,
|
|
chart_type, options);
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_dimension(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *id = words[1];
|
|
char *name = words[2];
|
|
char *algorithm = words[3];
|
|
char *multiplier_s = words[4];
|
|
char *divisor_s = words[5];
|
|
char *options = words[6];
|
|
|
|
RRDSET *st = ((PARSER_USER_OBJECT *) user)->st;
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
if (unlikely(!host && !((PARSER_USER_OBJECT *) user)->host_exists)) {
|
|
debug(D_PLUGINSD, "Ignoring dimension belonging to missing or ignored host.");
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
if (unlikely(!id)) {
|
|
error(
|
|
"requested a DIMENSION, without an id, host '%s' and chart '%s'. Disabling it.", rrdhost_hostname(host),
|
|
st ? rrdset_id(st) : "UNSET");
|
|
goto disable;
|
|
}
|
|
|
|
if (unlikely(!st && !((PARSER_USER_OBJECT *) user)->st_exists)) {
|
|
error("requested a DIMENSION, without a CHART, on host '%s'. Disabling it.", rrdhost_hostname(host));
|
|
goto disable;
|
|
}
|
|
|
|
long multiplier = 1;
|
|
if (multiplier_s && *multiplier_s) {
|
|
multiplier = strtol(multiplier_s, NULL, 0);
|
|
if (unlikely(!multiplier))
|
|
multiplier = 1;
|
|
}
|
|
|
|
long divisor = 1;
|
|
if (likely(divisor_s && *divisor_s)) {
|
|
divisor = strtol(divisor_s, NULL, 0);
|
|
if (unlikely(!divisor))
|
|
divisor = 1;
|
|
}
|
|
|
|
if (unlikely(!algorithm || !*algorithm))
|
|
algorithm = "absolute";
|
|
|
|
if (unlikely(st && rrdset_flag_check(st, RRDSET_FLAG_DEBUG)))
|
|
debug(
|
|
D_PLUGINSD,
|
|
"creating dimension in chart %s, id='%s', name='%s', algorithm='%s', multiplier=%ld, divisor=%ld, hidden='%s'",
|
|
rrdset_id(st), id, name ? name : "", rrd_algorithm_name(rrd_algorithm_id(algorithm)), multiplier, divisor,
|
|
options ? options : "");
|
|
|
|
if (plugins_action->dimension_action) {
|
|
return plugins_action->dimension_action(
|
|
user, st, id, name, algorithm,
|
|
multiplier, divisor, (options && *options)?options:NULL, rrd_algorithm_id(algorithm));
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
disable:
|
|
((PARSER_USER_OBJECT *)user)->enabled = 0;
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
PARSER_RC pluginsd_variable(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *name = words[1];
|
|
char *value = words[2];
|
|
NETDATA_DOUBLE v;
|
|
|
|
RRDSET *st = ((PARSER_USER_OBJECT *) user)->st;
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
|
|
int global = (st) ? 0 : 1;
|
|
|
|
if (name && *name) {
|
|
if ((strcmp(name, "GLOBAL") == 0 || strcmp(name, "HOST") == 0)) {
|
|
global = 1;
|
|
name = words[2];
|
|
value = words[3];
|
|
} else if ((strcmp(name, "LOCAL") == 0 || strcmp(name, "CHART") == 0)) {
|
|
global = 0;
|
|
name = words[2];
|
|
value = words[3];
|
|
}
|
|
}
|
|
|
|
if (unlikely(!name || !*name)) {
|
|
error("requested a VARIABLE on host '%s', without a variable name. Disabling it.", rrdhost_hostname(host));
|
|
((PARSER_USER_OBJECT *)user)->enabled = 0;
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
if (unlikely(!value || !*value))
|
|
value = NULL;
|
|
|
|
if (unlikely(!value)) {
|
|
error("cannot set %s VARIABLE '%s' on host '%s' to an empty value", (global) ? "HOST" : "CHART", name,
|
|
rrdhost_hostname(host));
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
if (!global && !st) {
|
|
error("cannot find/create CHART VARIABLE '%s' on host '%s' without a chart", name, rrdhost_hostname(host));
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
char *endptr = NULL;
|
|
v = (NETDATA_DOUBLE)str2ndd(value, &endptr);
|
|
if (unlikely(endptr && *endptr)) {
|
|
if (endptr == value)
|
|
error(
|
|
"the value '%s' of VARIABLE '%s' on host '%s' cannot be parsed as a number", value, name,
|
|
rrdhost_hostname(host));
|
|
else
|
|
error(
|
|
"the value '%s' of VARIABLE '%s' on host '%s' has leftovers: '%s'", value, name, rrdhost_hostname(host),
|
|
endptr);
|
|
}
|
|
|
|
if (plugins_action->variable_action) {
|
|
return plugins_action->variable_action(user, host, st, name, global, v);
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_flush(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
UNUSED(words);
|
|
debug(D_PLUGINSD, "requested a FLUSH");
|
|
RRDSET *st = ((PARSER_USER_OBJECT *) user)->st;
|
|
((PARSER_USER_OBJECT *) user)->st = NULL;
|
|
if (plugins_action->flush_action) {
|
|
return plugins_action->flush_action(user, st);
|
|
}
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_disable(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
UNUSED(user);
|
|
UNUSED(words);
|
|
|
|
if (plugins_action->disable_action) {
|
|
return plugins_action->disable_action(user);
|
|
}
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
PARSER_RC pluginsd_label(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *store;
|
|
|
|
if (!words[1] || !words[2] || !words[3]) {
|
|
error("Ignoring malformed or empty LABEL command.");
|
|
return PARSER_RC_OK;
|
|
}
|
|
if (!words[4])
|
|
store = words[3];
|
|
else {
|
|
store = callocz(PLUGINSD_LINE_MAX + 1, sizeof(char));
|
|
size_t remaining = PLUGINSD_LINE_MAX;
|
|
char *move = store;
|
|
int i = 3;
|
|
while (i < PLUGINSD_MAX_WORDS) {
|
|
size_t length = strlen(words[i]);
|
|
if ((length + 1) >= remaining)
|
|
break;
|
|
|
|
remaining -= (length + 1);
|
|
memcpy(move, words[i], length);
|
|
move += length;
|
|
*move++ = ' ';
|
|
|
|
i++;
|
|
if (!words[i])
|
|
break;
|
|
}
|
|
}
|
|
|
|
if (plugins_action->label_action) {
|
|
PARSER_RC rc = plugins_action->label_action(user, words[1], store, strtol(words[2], NULL, 10));
|
|
if (store != words[3])
|
|
freez(store);
|
|
return rc;
|
|
}
|
|
|
|
if (store != words[3])
|
|
freez(store);
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_clabel(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
if (!words[1] || !words[2] || !words[3]) {
|
|
error("Ignoring malformed or empty CHART LABEL command.");
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
if (plugins_action->clabel_action) {
|
|
PARSER_RC rc = plugins_action->clabel_action(user, words[1], words[2], strtol(words[3], NULL, 10));
|
|
return rc;
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_clabel_commit(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
UNUSED(words);
|
|
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
debug(D_PLUGINSD, "requested to commit chart labels");
|
|
|
|
PARSER_RC rc = PARSER_RC_OK;
|
|
|
|
if (plugins_action->clabel_commit_action)
|
|
rc = plugins_action->clabel_commit_action(user, host, ((PARSER_USER_OBJECT *)user)->new_chart_labels);
|
|
|
|
rrdlabels_destroy(((PARSER_USER_OBJECT *)user)->new_chart_labels);
|
|
((PARSER_USER_OBJECT *)user)->new_chart_labels = NULL;
|
|
|
|
return rc;
|
|
}
|
|
|
|
PARSER_RC pluginsd_overwrite(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
UNUSED(words);
|
|
|
|
RRDHOST *host = ((PARSER_USER_OBJECT *) user)->host;
|
|
debug(D_PLUGINSD, "requested to OVERWRITE host labels");
|
|
|
|
PARSER_RC rc = PARSER_RC_OK;
|
|
|
|
if (plugins_action->overwrite_action)
|
|
rc = plugins_action->overwrite_action(user, host, ((PARSER_USER_OBJECT *)user)->new_host_labels);
|
|
|
|
rrdlabels_destroy(((PARSER_USER_OBJECT *)user)->new_host_labels);
|
|
((PARSER_USER_OBJECT *)user)->new_host_labels = NULL;
|
|
|
|
return rc;
|
|
}
|
|
|
|
PARSER_RC pluginsd_guid(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *uuid_str = words[1];
|
|
uuid_t uuid;
|
|
|
|
if (unlikely(!uuid_str)) {
|
|
error("requested a GUID, without a uuid.");
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
if (unlikely(strlen(uuid_str) != GUID_LEN || uuid_parse(uuid_str, uuid) == -1)) {
|
|
error("requested a GUID, without a valid uuid string.");
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
debug(D_PLUGINSD, "Parsed uuid=%s", uuid_str);
|
|
if (plugins_action->guid_action) {
|
|
return plugins_action->guid_action(user, &uuid);
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_context(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *uuid_str = words[1];
|
|
uuid_t uuid;
|
|
|
|
if (unlikely(!uuid_str)) {
|
|
error("requested a CONTEXT, without a uuid.");
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
if (unlikely(strlen(uuid_str) != GUID_LEN || uuid_parse(uuid_str, uuid) == -1)) {
|
|
error("requested a CONTEXT, without a valid uuid string.");
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
debug(D_PLUGINSD, "Parsed uuid=%s", uuid_str);
|
|
if (plugins_action->context_action) {
|
|
return plugins_action->context_action(user, &uuid);
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC pluginsd_tombstone(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *uuid_str = words[1];
|
|
uuid_t uuid;
|
|
|
|
if (unlikely(!uuid_str)) {
|
|
error("requested a TOMBSTONE, without a uuid.");
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
if (unlikely(strlen(uuid_str) != GUID_LEN || uuid_parse(uuid_str, uuid) == -1)) {
|
|
error("requested a TOMBSTONE, without a valid uuid string.");
|
|
return PARSER_RC_ERROR;
|
|
}
|
|
|
|
debug(D_PLUGINSD, "Parsed uuid=%s", uuid_str);
|
|
if (plugins_action->tombstone_action) {
|
|
return plugins_action->tombstone_action(user, &uuid);
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
PARSER_RC metalog_pluginsd_host(char **words, void *user, PLUGINSD_ACTION *plugins_action)
|
|
{
|
|
char *machine_guid = words[1];
|
|
char *hostname = words[2];
|
|
char *registry_hostname = words[3];
|
|
char *update_every_s = words[4];
|
|
char *os = words[5];
|
|
char *timezone = words[6];
|
|
char *tags = words[7];
|
|
|
|
int update_every = 1;
|
|
if (likely(update_every_s && *update_every_s))
|
|
update_every = str2i(update_every_s);
|
|
if (unlikely(!update_every))
|
|
update_every = 1;
|
|
|
|
debug(D_PLUGINSD, "HOST PARSED: guid=%s, hostname=%s, reg_host=%s, update=%d, os=%s, timezone=%s, tags=%s",
|
|
machine_guid, hostname, registry_hostname, update_every, os, timezone, tags);
|
|
|
|
if (plugins_action->host_action) {
|
|
return plugins_action->host_action(
|
|
user, machine_guid, hostname, registry_hostname, update_every, os, timezone, tags);
|
|
}
|
|
|
|
return PARSER_RC_OK;
|
|
}
|
|
|
|
static void pluginsd_process_thread_cleanup(void *ptr) {
|
|
PARSER *parser = (PARSER *)ptr;
|
|
parser_destroy(parser);
|
|
}
|
|
|
|
// New plugins.d parser
|
|
|
|
inline size_t pluginsd_process(RRDHOST *host, struct plugind *cd, FILE *fp, int trust_durations)
|
|
{
|
|
int enabled = cd->enabled;
|
|
|
|
if (!fp || !enabled) {
|
|
cd->enabled = 0;
|
|
return 0;
|
|
}
|
|
|
|
if (unlikely(fileno(fp) == -1)) {
|
|
error("file descriptor given is not a valid stream");
|
|
cd->serial_failures++;
|
|
return 0;
|
|
}
|
|
clearerr(fp);
|
|
|
|
PARSER_USER_OBJECT user = {
|
|
.enabled = cd->enabled,
|
|
.host = host,
|
|
.cd = cd,
|
|
.trust_durations = trust_durations
|
|
};
|
|
|
|
PARSER *parser = parser_init(host, &user, fp, PARSER_INPUT_SPLIT);
|
|
|
|
// this keeps the parser with its current value
|
|
// so, parser needs to be allocated before pushing it
|
|
netdata_thread_cleanup_push(pluginsd_process_thread_cleanup, parser);
|
|
|
|
parser->plugins_action->begin_action = &pluginsd_begin_action;
|
|
parser->plugins_action->flush_action = &pluginsd_flush_action;
|
|
parser->plugins_action->end_action = &pluginsd_end_action;
|
|
parser->plugins_action->disable_action = &pluginsd_disable_action;
|
|
parser->plugins_action->variable_action = &pluginsd_variable_action;
|
|
parser->plugins_action->dimension_action = &pluginsd_dimension_action;
|
|
parser->plugins_action->label_action = &pluginsd_label_action;
|
|
parser->plugins_action->overwrite_action = &pluginsd_overwrite_action;
|
|
parser->plugins_action->chart_action = &pluginsd_chart_action;
|
|
parser->plugins_action->set_action = &pluginsd_set_action;
|
|
parser->plugins_action->clabel_commit_action = &pluginsd_clabel_commit_action;
|
|
parser->plugins_action->clabel_action = &pluginsd_clabel_action;
|
|
|
|
user.parser = parser;
|
|
|
|
while (likely(!parser_next(parser))) {
|
|
if (unlikely(netdata_exit || parser_action(parser, NULL)))
|
|
break;
|
|
}
|
|
|
|
// free parser with the pop function
|
|
netdata_thread_cleanup_pop(1);
|
|
|
|
cd->enabled = user.enabled;
|
|
size_t count = user.count;
|
|
|
|
if (likely(count)) {
|
|
cd->successful_collections += count;
|
|
cd->serial_failures = 0;
|
|
}
|
|
else
|
|
cd->serial_failures++;
|
|
|
|
return count;
|
|
}
|