DevOps

A collection of notes, resources, documentation and POCs mainly related to distributed systems for local development, learning purposes and quick prototyping.

• Linux
• Docker
• Ansible
• Cassandra
• ZooKeeper
• Kafka
• Hadoop
  • HDFS and MapReduce
  • Spark
  • Zeppelin
  • Oozie
• Cloud
• Kubernetes
• System Design
• Operating System
• Programming
• Other Resources
• Toolbox

Development

Ubuntu

# install pip3
sudo apt install -y python3-pip
# install virtualenv globally 
sudo pip3 install virtualenv
# create virtualenv
virtualenv -p $(which python3) venv
# how-to activate virtualenv
source venv/bin/activate
# verify virtualenv
which python
python --version
# how-to deactivate virtualenv
deactivate
# install new package
pip install mkdocs
# update requirements
pip freeze > requirements.txt
# run locally
# http://localhost:8000
mkdocs serve