Blog posts

2019

Spark Streaming useful links

less than 1 minute read

Published:

• Structured Streaming is to treat a live data stream as a table that is being continuously appended.

Spark Streaming useful links

less than 1 minute read

Published:

http://www.treselle.com/blog/apache-spark-performance-tuning-degree-of-parallelism/

Why React js?

less than 1 minute read

Published:

Spark Find difference between two dates.

Spark Streaming useful links

less than 1 minute read

Published:

netstat -tlpan grep 8080  
ps -ef grep processor_name awk ‘{print $2}’

Spark useful code snippets

less than 1 minute read

Published:

$ sudo yum -y install gcc gcc-c++ $ conda create -n airflow pip setuptools python=2.7.5 $ conda activate airflow $ pip install apache-airflow $ pip install apache-airflow[postgres,s3] $ pip install –upgrade Flask $ pip install werkzeug==0.15.1 $ airflow initdb # Will create ~/airflow folder and you can change the default configuration $ create database airflow; $ grant all privileges on airflow.* to airflow@’localhost’ identified by ‘airflow’; $ flush privileges; $ In Mysql Show global variables like ‘%timestamp%’; Set global explicit_defaults_for_timestamp=1

Pandas Never Use Append

less than 1 minute read

Published:

Never use pandas append https://stackoverflow.com/questions/10715965/add-one-row-to-pandas-dataframe

2018

Automate Nginx Installation Using Ansible Centos

1 minute read

Published:

#!/usr/bin/env ansible-playbook

title: ‘Automate Nginx Installation using Ansible’ date: 2018-12-19 permalink: /posts/2018/12/automate-nginx-installation-using-ansible-centos/ tags:

  • Configuration Management
  • Ansible
  • Nginx
  • Centos

    About Nginx