elasticsearch reference

Tools– head for Chrome (ElasticSearch Head – Chrome Web Store)– Postman (link)– Insomenia (link)– elasticdump – nodejs (link) Monitoring– ps_mem.py – monitor real memory utilization (github link)– ps -eo size,pid,user,command –sort -size | awk ‘{ hr=$1/1024 ; printf(“%13.2f Mb “,hr) } { for ( x=4 ; x< =NF ; x++ ) { printf(“%s “,$x) } […]

mysqldump script (per tables)

#!/bin/bash # This is PER TABLE backup. Each table will be backed up individually ## to enable passwordless mysqdump, put your password in /etc/mysql/[mysqld|percona|maria].conf.d/client.conf # [client] # user=”” # pass=”” THEDB=”mydbname” # THE DATABASE OUTPUT=”/home/backup/mysqldump” DATE=`date +%Y%m%d` OPTS=”–max_allowed_packet=512M ” tables=`mysql -e “use $THEDB; show tables;” | tr -d “| ” | grep -v -E “^Tables_in_” […]

Web server tuning (apache and nginx)

Key points enable http2 & change mpm prefork to event php-fpm   Enable http2 On apache + prefork to event – https://techwombat.com/enable-http2-apache-ubuntu-16-04/ sudo add-apt-repository ppa:ondrej/apache2 sudo apt update sudo apt upgrade sudo apt install php7.0-fpm sudo a2enmod proxy_fcgi setenvif sudo a2enconf php7.0-fpm sudo a2dismod php7.0 sudo a2dismod mpm_prefork sudo a2enmod mpm_event sudo service apache2 restart sudo […]

Elasticsearch notes

Useful links Elasticdump – http://blog.ruanbekker.com/blog/2017/11/22/using-elasticdump-to-backup-elasticsearch-indexes-to-json/ sudo npm install n -g sudo n stable   https://www.digitalocean.com/community/tutorials/how-to-interact-with-data-in-elasticsearch-using-crud-operations Delete by time https://hobo.house/2016/02/18/how-to-manually-clean-indexes-from-elasticsearch/  

LC_CTYPE: cannot change locale

This happens all the times to me. Keeping a note here..   for Centos https://www.noreplied.com/how-to-fixed-cannot-change-locale-utf-8-error-in-centos-7/ cat ‘LC_CTYPE=”en_US.UTF-8″‘ >> /etc/environment For Ubuntu export LANGUAGE=en_US.UTF-8 export LANG=en_US.UTF-8 export LC_ALL=en_US.UTF-8 locale-gen en_US.UTF-8 en_US  dpkg-reconfigure locales ->> choose 149 and 3

Slow HTTP Dos Verify and mitigate

What it is https://en.wikipedia.org/wiki/Slowloris_(computer_security) Tools to check Slowloris : https://github.com/gkbrk/slowloris SlowHttpTest : https://github.com/shekyan/slowhttptest Mitigatation mod_qos apt-get update && apt-get -y install libapache2-mod-qos && a2enmod qos && /etc/init.d/apache2 restart * configuration file in /etc/apache2/mods-enabled/ mod_reqtimeout a2enmod reqtimeout && /etc/init.d/apache2 restart * configuration file in /etc/apache2/mods-enabled/

Securing apache

Some notes on securing apache.. A few key points Disable access to . Disable banner disabled PHP functions Slow dos mitigation (link) Disable access to . https://stackoverflow.com/questions/4352737/apache-configuration-regex-to-disable-access-to-files-directories-beginning-wit <filesmatch “^\.ht”> Order allow,deny Deny from all <filesmatch “^\.”> Order allow,deny Deny from all <directorymatch “^\.|\/\.”> Order allow,deny Deny from all Disable banner http://www.ducea.com/2006/06/15/apache-tips-tricks-hide-apache-software-version/ Usually found in /etc/apache/conf-enabled/security.conf […]