Debug School: viswanath reddy

How to enable the APM for the Apache Tomcat Application and Visualize the Metrics in Datadog dashboard

viswanath reddy — Wed, 19 Apr 2023 11:54:24 +0000

Create a AWS Ec2 Instance

Install the Datadog Agent

In the Datadog Dashboard --> Integrations --> Agent--> Select the Ubuntu and Use our easy one-step install.
DD_API_KEY= DD_SITE="datadoghq.com" bash -c "$(curl -L https://s3.amazonaws.com/dd-agent/scripts/install_script_agent7.sh)"

Install Java 11

$ sudo apt-get update
$ sudo apt-get install openjdk-11-jdk -y
$ apt install openjdk-11-jdk-headless -y

4 Install Apache Tomcat

$ sudo apt-get install wget unzip -y --> Unzip packge
$ sudo su -
$ cd /opt/
$ wget https://dlcdn.apache.org/tomcat/tomcat-9/v9.0.73/bin/apache-tomcat-9.0.73.zip
$ unzip apache-tomcat-9.0.73.zip
$ cd apache-tomcat-9.0.73/bin
$ chmod -R 755 .
$ ls -ltr

Install the APM Agent

Go to Datadog dash board click on APM --> Setup &Configuration --> Service Setup --> Select Host-based --> Choose Your Language--> Java

$ cd /opt
$ mkdir datadog --> create directory to install the APM agent
$ cd datadog
$ wget -O dd-java-agent.jar 'https://dtdg.co/latest-java-tracer'

Instrument your Application

Add the service name and environment in the details and enable required options for the application testing. Then Parameter's should be as below. After that code snippet as below.

java -javaagent:/opt/datadog/dd-java-agent.jar -Ddd.profiling.enabled=true -Ddd.logs.injection=true -Ddd.trace.sample.rate=1 -Ddd.appsec.enabled=true -Ddd.service=devops_school -Ddd.env=test -Ddd.version=1.0"

$ cd /opt/apache-tomcat-9.0.73/bin
$ vi catalina.sh
CATALINA_OPTS="$CATALINA_OPTS -javaagent:/opt/datadog/dd-java-agent.jar -Ddd.profiling.enabled=true -Ddd.logs.injection=true -Ddd.trace.sample.rate=1 -Ddd.appsec.enabled=true -Ddd.service=devops_school -Ddd.env=test -Ddd.version=1.0"

-Ddd.version=1.0 --> Ex: Added the Release version

$ systemctl restart datadog-agent
$ ./shutdown.sh
$ ./startup.sh
$ ps -eaf | grep tomcat | grep dd

Create a Traffic and Run the Traffic

For this we need to install the JMeter to run the traffic.
https://www.devopsschool.com/blog/how-to-install-and-configure-jemeter/

Visualize the Metrics in Datadog Dashboard

click on APM --> Services --> Click on service name and see the details i.e Error Tracking, Incidents, Latency, Traces

Under deployment --> Requests --> how many No. of requests are hitting in a period of time.
Under deployment --> p95Latency
Under deployment --> Errors

Install Datadog agent, Integration with Docker, Apache web server, tomcat, Mysql

viswanath reddy — Tue, 18 Apr 2023 15:38:16 +0000

Concept of Datadog Integration

Step - 1: First know the Tools
Step - 2: Validate if tool is exposing metrics or not. If not then enabled it.
Step - 3: Enable Integration at Datadog(Onetime) : From datadog UI -> go to integration -> search apache,mysql,tomcat,etc -> install integration
Step - 4: Enable datadog agent to collect Metrics from Integration
Step - 5: Restart agent
Step - 6: validate Metrics at Datadog UI

Docker Integration:
step-1 - Install Docker : we followed below steps

https://www.devopsschool.com/blog/how-to-install-docker-in-linux/

Step-2 - Install agent - From Datadog UI - Integration - agent - choose Ubuntu

Step 3 - Enable Datadog-agent to collect the Metrices from Integration :

cd /etc/datadog-agent/conf.d/docker.d/
$ cp conf.yaml.default conf.yaml
$ vi conf.yaml
$ systemctl restart datadog-agent
$ systemctl status datadog-agent

https://www.devopsschool.com/blog/how-to-enable-docker-container-monitoring-in-datadog-agent/

Step 4 - Create few containers
$ docker run -itd ubuntu
$ docker run -itd ubuntu
$ docker run -itd ubuntu

Step 5 - Restart a Datadog agent
systemctl restart datadog-agent
datadog-agent configcheck
datadog-agent check docker
datadog-agent status

Step 6 - Validate a Metrices From Datadog UI - Metrices Explorer - containers. metrices

Apache Webserver Configuration

Step -1: Install Apache : followed below steps from URL below
https://www.devopsschool.com/blog/how-to-install-configure-apache-httpd-server-in-linux/

Step -2: install agent - From Datadog UI - Integration - agent - choose Ubuntu

Step -3: Enable Apache with Mod status

https://www.devopsschool.com/blog/how-to-install-mod_status-on-your-apache-servers-and-enable-extendedstatus/

Step -4: Make config changes
$ cd /etc/datadog-agent/conf.d/apache.d/
$ cp conf.yaml.default conf.yaml
$ vi conf.yaml
$ systemctl restart datadog-agent
$ systemctl status datadog-agent

Step -5: Restart agent
systemctl restart datadog-agent
datadog-agent configcheck
datadog-agent check apache
datadog-agent status

Step -6: Validate a Metrices at Mertrices expl - From datadog UI - Metrices - exporer - apache. metrices

MySql Configuration

Step -1: Install MySQL serevr

https://www.devopsschool.com/blog/how-to-install-mysql-server-and-client-on-ubuntu/

Step -2: Install Agent - - From Datadog UI - Integration - agent - choose Ubuntu

Step -3: Create Username and Password for MySQL:

For mySQL 8.0+ create the datadog user with the native password hashing method:

mysql> CREATE USER 'datadog'@'localhost' IDENTIFIED WITH mysql_native_password by '';
Query OK, 0 rows affected (0.00 sec)

Note: @'localhost' is only for local connections - use the hostname/IP of your Agent for remote connections. For more information, see the MySQL documentation.

Verify the user was created successfully using the following commands - replace with the password you created above:

mysql -u datadog --password= -e "show status" | \
grep Uptime && echo -e "3[0;32mMySQL user - OK3[0m" || \
echo -e "3[0;31mCannot connect to MySQL3[0m"

mysql -u datadog --password= -e "show slave status" && \
echo -e "3[0;32mMySQL grant - OK3[0m" || \
echo -e "3[0;31mMissing REPLICATION CLIENT grant3[0m"

step -4: Assign User to Fetch Metrices MYSQL DB
For MySQL 8.0+ set max_user_connections with:

mysql> ALTER USER 'datadog'@'localhost' WITH MAX_USER_CONNECTIONS 5;
Query OK, 0 rows affected (0.00 sec)

If enabled, metrics can be collected from the performance_schema database by granting an additional privilege:

mysql> show databases like 'performance_schema';
+-------------------------------+
| Database (performance_schema) |
+-------------------------------+
| performance_schema |
+-------------------------------+
1 row in set (0.00 sec)

mysql> GRANT SELECT ON performance_schema.* TO 'datadog'@'localhost';
Query OK, 0 rows affected (0.00 sec)

Step -5: Config Integration

$ cd /etc/datadog-agent/conf.d/mysql.d/
$ sudo cp conf.yaml.example conf.yaml
$ sudo vi conf.yaml (CHECK IMAGE BELOW)
$ sudo service datadog-agent restart [UBUNTU]
$ sudo systemctl restart datadog-agent [Centos]

Step -6: Restart agent
systemctl restart datadog-agent
datadog-agent configcheck
datadog-agent check
datadog-agent status
Step -7: Validate a Metrices at Mertrices expl - From datadog UI - Metrices - exporer - mySQL. metrices

Apache Tomcat Configuration

Step 1 – How to Install Open JDK 11 for Ubuntu
$ sudo apt-get update
$ sudo apt-get install openjdk-11-jdk -y
$ apt install openjdk-11-jdk-headless -y

step 2 -Download Apache Tomcat 9 for Ubuntu
sudo apt-get install wget unzip -y
sudo su -
cd /opt/
wget https://dlcdn.apache.org/tomcat/tomcat-9/v9.0.73/bin/apache-tomcat-9.0.73.zip
unzip apache-tomcat-9.0.73.zip
cd apache-tomcat-9.0.73/bin
chmod -R 755 .
ls -ltr
./shutdown.sh
./startup.sh

Step-3 - Install the datadog agent in Ubuntu.Follow the below link. https://www.devopsschool.com/blog/how-to-install-datadog-agent-in-ubuntu/
Step-4 - How to enable JMX Remote in Tomcat 8 to Monitor & Administer? vi /opt/apache-tomcat-9.0.73/bin/catalina.sh CATALINA_OPTS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=9012 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false"
./shutdown.sh
./startup.sh
Check with the process is running or not for JMX
Ps- eaf | grep jmx
Step -5 - How to configure and enable Tomcat integration in Datadog agent?
$ cd /etc/datadog-agent/conf.d/tomcat.d/
$ cp conf.yaml.example conf.yaml
$ datadog-agent configcheck
$ systemctl restart datadog-agent
$ systemctl status datadog-agent
$ datadog-agent config

check the tomcat config

datadog-agent configcheck | grep tomcat -A 1 -B 1
Step-6 - Validate metrics in the Datadog dashboard for tomcat under Metrics --> Explorer

Write down list of Top Datadog Agent commands with their usage.

viswanath reddy — Mon, 17 Apr 2023 12:01:09 +0000

Write down list of Top Datadog Agent commands with their usage

D_AGENT_MAJOR_VERSION=7 DD_API_KEY=DD_SITE="datadoghq.com" bash -c "$(curl -L https://s3.amazonaws.com/dd-agent/scripts/install_script.sh)"- This will install the datadog-agent script, Installing API package, Installing datadog-agent package. The package will store under /usr/bin/systemctl
systemctl start datadog-agent - This command is used to start the datadog-agent.
systemctl stop datadog-agent - This command is used for stop the datadog-agent
systemctl restart datadog-agent - This command is used to restart the datadog-agent
systemctl status datadog-agent - This command is used to check the status of datadog-agent i.e active or in-active
cd /etc/datadog-agent/datadog.yaml - This path having the datadog-agent configuration yaml file i.e api key, datadog site etc.
cd /var/log/datadog/agent.log - This path we can check the logs for datadog-agent log files.
datadog-agent config - To check the datadog-agent configurations.
datadog-agent health - To check the status of the datadog-agent
datadog-agent version - To check the datadog-agent version
datadog-agent hostname - To check the daatdog-agent hostname by using this command.

What is observability? How to setup observability?

viswanath reddy — Mon, 17 Apr 2023 05:35:36 +0000

What is observability?

Observability enables the IT and security and collect the logs, traces and metrics from source to destination.

How to setup observability?

Observability provides the visibility and performance of each layer of your environment. it's should monitor underlaying the infrastructure supporting services and applications.