use calculator app instead of spreadsheet
I think we should use the app instead of a spreadsheet.
- It's a better user experience.
- It's easier to maintain and open for all since it just lives here: https://github.com/netdata/netdata-storage-calculator.
- Anyone who wants to customize it or play with it can also just open the notebook in colab.
- It feels a bit more polished.
* update link to point at demo spaces
* Update docs/Demo-Sites.md
Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
* Provide Details on Label Filtering/Custom Labels
Adding documentation for the new Chart Label Filtering feature and custom labels for collectors.
* Add screenshots to label filtering
* Update docs/dashboard/interact-charts.mdx
Co-authored-by: Hugo Valente <82235632+hugovalente-pm@users.noreply.github.com>
Co-authored-by: Hugo Valente <82235632+hugovalente-pm@users.noreply.github.com>
This PR
- Explains the new tiering mechanism.
- Housekeeping docs about Agent's database options.
- Updates all the configuration options for the `dbengine`.
- Provide a new way for the users to calculate the space they need for their
metric storage needs (via a spreadsheet)
Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
Co-authored-by: DShreve2 <david@netdata.cloud>
* first commit for the guide
* minor changes
* lint and remove the image metadata
* fix some newlines and add backlinks
* fix some typos
* Changes to the structure and steps
* Fix title and custom_edit_url
* minor styling fixes
* Update troubleshooting-agent-with-cloud-connection.md
* some wording changes and additions
* fixes plus added Tasos's suggestions
* Update troubleshooting-agent-with-cloud-connection.md
Co-authored-by: Tasos Katsoulas <tasos@netdata.cloud>
Co-authored-by: DShreve2 <david@netdata.cloud>
* Add link to docker config section
Point to the docker installation page
* Use relative link
Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
* Update docs/configure/nodes.md
Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
* Tier part 1
* Tier part 2
* Tier part 3
* Tier part 4
* Tier part 5
* Fix some ML compilation errors
* fix more conflicts
* pass proper tier
* move metric_uuid from state to RRDDIM
* move aclk_live_status from state to RRDDIM
* move ml_dimension from state to RRDDIM
* abstracted the data collection interface
* support flushing for mem db too
* abstracted the query api
* abstracted latest/oldest time per metric
* cleanup
* store_metric for tier1
* fix for store_metric
* allow multiple tiers, more than 2
* state to tier
* Change storage type in db. Query param to request min, max, sum or average
* Store tier data correctly
* Fix skipping tier page type
* Add tier grouping in the tier
* Fix to handle archived charts (part 1)
* Temp fix for query granularity when requesting tier1 data
* Fix parameters in the correct order and calculate the anomaly based on the anomaly count
* Proper tiering grouping
* Anomaly calculation based on anomaly count
* force type checking on storage handles
* update cmocka tests
* fully dynamic number of storage tiers
* fix static allocation
* configure grouping for all tiers; disable tiers for unittest; disable statsd configuration for private charts mode
* use default page dt using the tiering info
* automatic selection of tier
* fix for automatic selection of tier
* working prototype of dynamic tier selection
* automatic selection of tier done right (I hope)
* ask for the proper tier value, based on the grouping function
* fixes for unittests and load_metric_next()
* fixes for lgtm findings
* minor renames
* add dbengine to page cache size setting
* add dbengine to page cache with malloc
* query engine optimized to loop as little are required based on the view_update_every
* query engine grouping methods now do not assume a constant number of points per group and they allocate memory with OWA
* report db points per tier in jsonwrap
* query planer that switches database tiers on the fly to satisfy the query for the entire timeframe
* dbegnine statistics and documentation (in progress)
* calculate average point duration in db
* handle single point pages the best we can
* handle single point pages even better
* Keep page type in the rrdeng_page_descr
* updated doc
* handle future backwards compatibility - improved statistics
* support &tier=X in queries
* enfore increasing iterations on tiers
* tier 1 is always 1 iteration
* backfilling higher tiers on first data collection
* reversed anomaly bit
* set up to 5 tiers
* natural points should only be offered on tier 0, except a specific tier is selected
* do not allow more than 65535 points of tier0 to be aggregated on any tier
* Work only on actually activated tiers
* fix query interpolation
* fix query interpolation again
* fix lgtm finding
* Activate one tier for now
* backfilling of higher tiers using raw metrics from lower tiers
* fix for crash on start when storage tiers is increased from the default
* more statistics on exit
* fix bug that prevented higher tiers to get any values; added backfilling options
* fixed the statistics log line
* removed limit of 255 iterations per tier; moved the code of freezing rd->tiers[x]->db_metric_handle
* fixed division by zero on zero points_wanted
* removed dead code
* Decide on the descr->type for the type of metric
* dont store metrics on unknown page types
* free db_metric_handle on sql based context queries
* Disable STORAGE_POINT value check in the exporting engine unit tests
* fix for db modes other than dbengine
* fix for aclk archived chart queries destroying db_metric_handles of valid rrddims
* fix left-over freez() instead of OWA freez on median queries
Co-authored-by: Costa Tsaousis <costa@netdata.cloud>
Co-authored-by: Vladimir Kobal <vlad@prokk.net>
* netdata doubles
* fix cmocka test
* fix cmocka test again
* fix left-overs of long double to NETDATA_DOUBLE
* RRDDIM detached from disk representation; db settings in [db] section of netdata.conf
* update the memory before saving
* rrdset is now detached from file structures too
* on memory mode map, update the memory mapped structures on every iteration
* allow RRD_ID_LENGTH_MAX to be changed
* granularity secs, back to update every
* fix formatting
* more formatting
* Add concept template
* Add task template
* commit pending changes bc I need to switch branch
* Upload set of templates for discussion
* Amend templates based on feedback
* Refinements
* Rename _concept-template.md to _concept-page-template.md
* update anonymous-statistics readme for PH Cloud
As we migrate away from our self hosted PostHog offering to using the PostHog Enterprise Cloud product, we should update docs to make this clear.
* Update docs/anonymous-statistics.md
Co-authored-by: Tina Luedtke <kickoke@users.noreply.github.com>
