0
0
Fork 0
mirror of https://github.com/netdata/netdata.git synced 2025-05-21 16:27:14 +00:00
Commit graph

12 commits

Author SHA1 Message Date
Stelios Fragkakis
1bd8a25544
Add support for persistent metadata ()
* Implemented collector metadata logging 
* Added persistent GUIDs for charts and dimensions
* Added metadata log replay and automatic compaction
* Added detection of charts with no active collector (archived)
* Added new endpoint to report archived charts via `/api/v1/archivedcharts`
* Added support for collector metadata update

Co-authored-by: Markos Fountoulakis <44345837+mfundul@users.noreply.github.com>
2020-06-12 10:35:17 +03:00
Markos Fountoulakis
6b119d9170
Drop dirty dbengine pages if disk cannot keep up ()
* Introduce dirty page pressure handling in the dbengine page cache that invalidates pages when the disk cannot keep up with the flushing speed.
2020-02-06 21:58:13 +02:00
thiagoftsm
c8ded37b25
Fix race condition in dbengine ()
* fix_db_race_condition: unit test

Adjust unit test for dbengine

* fix_db_race_condition: page cache

Fix database

* fix_db_race_condition: Missing function call

This commit brings the correct function call inside rrdengine.c
2019-12-18 16:37:02 +00:00
Andrew Moss
fe45b4961e
Revert "Fix race condition in dbengine ()" ()
We are removing this fix for further internal testing, it will be returning after we iron out
some bugs.

This reverts commit 53ab093d84.
2019-12-17 19:15:17 +01:00
Markos Fountoulakis
53ab093d84
Fix race condition in dbengine () 2019-12-16 16:14:55 +02:00
Markos Fountoulakis
69e5e128f6
Fix counter reset detection ()
* Removed support for 16-bit and 8-bit counter overflow

* Improve behaviour of counter overflow detection versus counter resets.

* Added support for signed 32-bit and 64-bit limits for counter overflows.

* Fixed signed incremental counter issues and added unit tests.
2019-10-30 15:38:46 +02:00
Markos Fountoulakis
95119afff4
Make dbengine the default memory mode ()
* Basic functionality for dbengine stress test.

* Fix coverity defects

* Refactored dbengine stress test to be configurable

* Added benchmark results and evaluation in dbengine documentation

* Make dbengine the default memory mode
2019-10-03 17:04:51 +03:00
Markos Fountoulakis
4c9d6a3713
Stress test insertions into dbengine and bugfixes ()
* Fix memory corruption during deallocation of page cache

* Refactored dataset generator in order to support the upcoming self-validating stress test and multithreading.

* Fix starvation in database engine loop when the command queues are continuously populated

* Fixing disk quota limits for dbengine dataset generator
2019-09-12 13:39:16 +03:00
Markos Fountoulakis
2a06960117
Variable Granularity support for data collection ()
* Variable Granularity support for data collection in the dbengine.

* Variable Granularity support for data collection in the daemon.

* Added tests to validate the data being queried after having been collected by changing data collection interval

* Fix memory corruption

* Updated database engine documentation about data collection frequency behaviour
2019-08-28 17:33:51 +03:00
Markos Fountoulakis
6ca6d840dd Database engine ()
* Database engine prototype version 0

* Database engine initial integration with netdata POC

* Scalable database engine with file and memory management.

* Database engine integration with netdata

* Added MIN MAX definitions to fix alpine build of travis CI

* Bugfix for backends and new DB engine, remove useless rrdset_time2slot() calls and erroneous checks

* DB engine disk protocol correction

* Moved DB engine storage file location to /var/cache/netdata/{host}/dbengine

* Fix configure to require openSSL for DB engine

* Fix netdata daemon health not holding read lock when iterating chart dimensions

* Optimized query API for new DB engine and old netdata DB fallback code-path

* netdata database internal query API improvements and cleanup

* Bugfix for DB engine queries returning empty values

* Added netdata internal check for data queries for old and new DB

* Added statistics to DB engine and fixed memory corruption bug

* Added preliminary charts for DB engine statistics

* Changed DB engine ratio statistics to incremental

* Added netdata statistics charts for DB engine internal statistics

* Fix for netdata not compiling successfully when missing dbengine dependencies

* Added DB engine functional test to netdata unittest command parameter

* Implemented DB engine dataset generator based on example.random chart

* Fix build error in CI

* Support older versions of libuv1

* Fixes segmentation fault when using multiple DB engine instances concurrently

* Fix memory corruption bug

* Fixed createdataset advanced option not exiting

* Fix for DB engine not working on FreeBSD

* Support FreeBSD library paths of new dependencies

* Workaround for unsupported O_DIRECT in OS X

* Fix unittest crashing during cleanup

* Disable DB engine FS caching in Apple OS X since O_DIRECT is not available

* Fix segfault when unittest and DB engine dataset generator don't have permissions to create temporary host

* Modified DB engine dataset generator to create multiple files

* Toned down overzealous page cache prefetcher

* Reduce internal memory fragmentation for page-cache data pages

* Added documentation describing the DB engine

* Documentation bugfixes

* Fixed unit tests compilation errors since last rebase

* Added note to back-up the DB engine files in documentation

* Added codacy fix.

* Support old gcc versions for atomic counters in DB engine
2019-05-15 08:28:06 +03:00
Costa Tsaousis
36199f4498
incremental overflows should not show zeros values ()
* incremental overflows do not show zeros; fixes 

* use the max per metric per session for detecting counter size
2018-11-04 21:53:19 +02:00
Costa Tsaousis
8fbf817ef8
modularized all source code ()
* modularized all external plugins

* added README.md in plugins

* fixed title

* fixed typo

* relative link to external plugins

* external plugins configuration README

* added plugins link

* remove plugins link

* plugin names are links

* added links to external plugins

* removed unecessary spacing

* list to table

* added language

* fixed typo

* list to table on internal plugins

* added more documentation to internal plugins

* moved python, node, and bash code and configs into the external plugins

* added statsd README

* fix bug with corrupting config.h every 2nd compilation

* moved all config files together with their code

* more documentation

* diskspace info

* fixed broken links in apps.plugin

* added backends docs

* updated plugins readme

* move nc-backend.sh to backends

* created daemon directory

* moved all code outside src/

* fixed readme identation

* renamed plugins.d.plugin to plugins.d

* updated readme

* removed linux- from linux plugins

* updated readme

* updated readme

* updated readme

* updated readme

* updated readme

* updated readme

* fixed README.md links

* fixed netdata tree links

* updated codacy, codeclimate and lgtm excluded paths

* update CMakeLists.txt

* updated automake options at top directory

* libnetdata slit into directories

* updated READMEs

* updated READMEs

* updated ARL docs

* updated ARL docs

* moved /plugins to /collectors

* moved all external plugins outside plugins.d

* updated codacy, codeclimate, lgtm

* updated README

* updated url

* updated readme

* updated readme

* updated readme

* updated readme

* moved api and web into webserver

* web/api web/gui web/server

* modularized webserver

* removed web/gui/version.txt
2018-10-15 23:16:42 +03:00
Renamed from src/unit_test.c (Browse further)