Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

Spark Streaming useful links

less than 1 minute read

Published:

• Structured Streaming is to treat a live data stream as a table that is being continuously appended.

Spark Streaming useful links

less than 1 minute read

Published:

http://www.treselle.com/blog/apache-spark-performance-tuning-degree-of-parallelism/

Why React js?

less than 1 minute read

Published:

Spark Find difference between two dates.

Spark Streaming useful links

less than 1 minute read

Published:

netstat -tlpan grep 8080  
ps -ef grep processor_name awk ‘{print $2}’

Spark useful code snippets

less than 1 minute read

Published:

$ sudo yum -y install gcc gcc-c++ $ conda create -n airflow pip setuptools python=2.7.5 $ conda activate airflow $ pip install apache-airflow $ pip install apache-airflow[postgres,s3] $ pip install –upgrade Flask $ pip install werkzeug==0.15.1 $ airflow initdb # Will create ~/airflow folder and you can change the default configuration $ create database airflow; $ grant all privileges on airflow.* to airflow@’localhost’ identified by ‘airflow’; $ flush privileges; $ In Mysql Show global variables like ‘%timestamp%’; Set global explicit_defaults_for_timestamp=1

Pandas Never Use Append

less than 1 minute read

Published:

Never use pandas append https://stackoverflow.com/questions/10715965/add-one-row-to-pandas-dataframe

Automate Nginx Installation Using Ansible Centos

1 minute read

Published:

#!/usr/bin/env ansible-playbook

title: ‘Automate Nginx Installation using Ansible’ date: 2018-12-19 permalink: /posts/2018/12/automate-nginx-installation-using-ansible-centos/ tags:

  • Configuration Management
  • Ansible
  • Nginx
  • Centos

    About Nginx

automation

data-engineering

frontend

Why React Js?

Published:

This post you will learn how to setup and configure HDP to work with Reactjs.

portfolio

publications

scala-tips

Blog Post number 2

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 4

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Future Blog Post

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

talks

teaching