Posts by Tags

Centos

Kafka

Spark Streaming useful links

less than 1 minute read

Published:

• Structured Streaming is to treat a live data stream as a table that is being continuously appended.

Spark Streaming useful links

less than 1 minute read

Published:

http://www.treselle.com/blog/apache-spark-performance-tuning-degree-of-parallelism/

Spark Streaming useful links

less than 1 minute read

Published:

netstat -tlpan grep 8080  
ps -ef grep processor_name awk ‘{print $2}’

Linux

Spark Streaming useful links

less than 1 minute read

Published:

netstat -tlpan grep 8080  
ps -ef grep processor_name awk ‘{print $2}’

Reactjs

Why React js?

less than 1 minute read

Published:

Spark Find difference between two dates.

Spark useful code snippets

less than 1 minute read

Published:

$ sudo yum -y install gcc gcc-c++ $ conda create -n airflow pip setuptools python=2.7.5 $ conda activate airflow $ pip install apache-airflow $ pip install apache-airflow[postgres,s3] $ pip install –upgrade Flask $ pip install werkzeug==0.15.1 $ airflow initdb # Will create ~/airflow folder and you can change the default configuration $ create database airflow; $ grant all privileges on airflow.* to airflow@’localhost’ identified by ‘airflow’; $ flush privileges; $ In Mysql Show global variables like ‘%timestamp%’; Set global explicit_defaults_for_timestamp=1

Spark

Spark Streaming useful links

less than 1 minute read

Published:

• Structured Streaming is to treat a live data stream as a table that is being continuously appended.

Spark Streaming useful links

less than 1 minute read

Published:

http://www.treselle.com/blog/apache-spark-performance-tuning-degree-of-parallelism/

Streaming

Spark Streaming useful links

less than 1 minute read

Published:

• Structured Streaming is to treat a live data stream as a table that is being continuously appended.

Spark Streaming useful links

less than 1 minute read

Published:

http://www.treselle.com/blog/apache-spark-performance-tuning-degree-of-parallelism/

USB

Useful

Spark Streaming useful links

less than 1 minute read

Published:

netstat -tlpan grep 8080  
ps -ef grep processor_name awk ‘{print $2}’

category2

Why React js?

less than 1 minute read

Published:

Spark Find difference between two dates.

Spark useful code snippets

less than 1 minute read

Published:

$ sudo yum -y install gcc gcc-c++ $ conda create -n airflow pip setuptools python=2.7.5 $ conda activate airflow $ pip install apache-airflow $ pip install apache-airflow[postgres,s3] $ pip install –upgrade Flask $ pip install werkzeug==0.15.1 $ airflow initdb # Will create ~/airflow folder and you can change the default configuration $ create database airflow; $ grant all privileges on airflow.* to airflow@’localhost’ identified by ‘airflow’; $ flush privileges; $ In Mysql Show global variables like ‘%timestamp%’; Set global explicit_defaults_for_timestamp=1

frontend

Why React js?

less than 1 minute read

Published:

Spark Find difference between two dates.

Spark useful code snippets

less than 1 minute read

Published:

$ sudo yum -y install gcc gcc-c++ $ conda create -n airflow pip setuptools python=2.7.5 $ conda activate airflow $ pip install apache-airflow $ pip install apache-airflow[postgres,s3] $ pip install –upgrade Flask $ pip install werkzeug==0.15.1 $ airflow initdb # Will create ~/airflow folder and you can change the default configuration $ create database airflow; $ grant all privileges on airflow.* to airflow@’localhost’ identified by ‘airflow’; $ flush privileges; $ In Mysql Show global variables like ‘%timestamp%’; Set global explicit_defaults_for_timestamp=1