Debug School: Pradnya Kekan

Day 3: Monitoring

Pradnya Kekan — Thu, 14 Sep 2023 05:08:52 +0000

1 Top 10 metrics/indicators for APM

Error rate
Response time
Memory usage
CPU usage
Node availability
Version comparison
User experience monitoring
uptime of application

2 Top 10 metrics/indicators for Synthetic monitoring

Total Response time
DNS
connection
SSl
download time
connect time
error code
set alerts
monitors transactions
latency
Test from Multiple Locations

3 Top 10 metrics/indicators for RUM

-session tracking
-monitor browsers
-Session length
-Apdex score
-Page load time
-Click paths
-Browser versions
-Operating system
-User location
-Page views

Day 2: Datadog Integration

Pradnya Kekan — Tue, 12 Sep 2023 12:07:51 +0000

Write it down a step to collect apache metrices to datadog

1)Install the Datadog Agent
2)Install Apache HTTPD server
3)Enable mod_status in Apache- by default it is enabled in ubuntu
status.conf
status.load
4)Configure the Agent to collect Apache metrics in apache.d file
-GO to /etc/apache2/mods-enabled/status.conf
-Replace Require ip to Require all granted
5)enable apache integration
-go to /etc/datadog-agent/conf.d/apache.d/
-sudo cp conf.yaml.example conf.yaml
-sudo vi conf.yaml
-and put the apache_status_url
sudo service datadog-agent restart
6)Install apache integration
7)Create a fake traffic and verify on datadog metrics

Write it down a step to collect tomcat metrices to datadog

1)Install the Datadog Agent
2)Install tomcat apache
3)enable JMX Remote
-cd /etc/datadog-agent/conf.d/tomcat.d/
-cp conf.yaml.example conf.yaml
-datadog-agent configcheck
-systemctl restart datadog-agent
-systemctl status datadog-agent
-datadog-agent config
4)Install Apache tomcat inegration
5)Verify it on datadog metrics

Write it down a step to collect docker metrices to datadog

1)install datadog agent
2)Install docker
3)do the integration:
-cd /etc/datadog-agent/conf.d/docker.d/
-cp conf.yaml.default conf.yaml
-vi conf.yaml
-add - url: "unix://var/run/docker.sock"
-systemctl restart datadog-agent
-systemctl status datadog-agent
4)create few containers and verify it in datadog metrics

Write it down a step to collect mysql metrices to datadog

1)Install datadog agent
2) Install MySQL
3)create mysql user and grant required privilages

do the mysql integration on datadog page 4)Configure Datadog agent to start collection mysql metrix. -cd /etc/datadog-agent/conf.d/mysql.d/
- sudo cp conf.yaml.example conf.yaml -sudo vi conf.yaml -cd /etc/datadog-agent/conf.d/mysql.d/ -sudo cp conf.yaml.example conf.yaml
sudo vi conf.yaml password : options: replication: false galera_cluster: true extra_status_metrics: true extra_innodb_metrics: true extra_performance_metrics: true schema_size_metrics: false disable_innodb_metrics: false $ sudo service datadog-agent restart $ sudo service datadog-agent restart

and then install mysql integration on datadog and verify

Day 1:Datadog

Pradnya Kekan — Mon, 11 Sep 2023 07:41:39 +0000

What is Observability and its advantage?

Observability is ability to measure systems current state based on logs, events and metrics.
Observability helps us in understanding whay and what has happened to the system and what can be done to prevent that from happening again.

Difference between Observability Monitoring?

Observability can ask questions based in hypothesis.
Monitoring can ask questions based on dashboard.
Observability is a superset while monitoring is a subset of observability.
Monitoring tells us what is wrong while observability tells us why isit wrong.
Observability is useful is dynamic environment whereas Monitoring is useful is static environment.

What is Datadog?

Datadog is a service which provides monitoring for applications ,data, servers through SAAS .
It can be used to visualize data, explore metrics, manage logs etc.

What is Datadog Agent and How it works?

It collects metrics and events from systems and apps and sends them to Datadog, where you can analyze your monitoring and performance data.

Component of Datadog Agent and short intro for each

Collector : It gathers all metrics every 15 seconds,
Forwarder : It send metrics over HTTPS to Datadog
DogStatsD :It is a deamon which accepts metrics, events, and service checks over UDP and periodically aggregates and forwards them to Datadog.

1 Top 10 commands of Datadog Agent

systemctl stop datalog-agent
systemctl start datalog-agent
datalog-agent health
datalog-agent version
datalog-agent status
datalog-agent hostname
ystemctl restart datadog-agent
systemctl status datadog-agent
datalog-agent launch-gui
datalog-agent check
datalog-agent help

2 Locate how to enable Process monitoring in datadog.yaml?

in the yaml file :
process_agent_enabled: true

3 Top 5 Techniques for troubleshooting Datadog Agent

Check Api key 2.check site name 3.Check the service status of datadog agent, trace, process agent. 4.check the agent logs 5.check connectivity to the agent with datadog-agent info, and there check status field.