Repository files navigation

Repo focused on advanced knowledge, tips & tricks, debugging & fixes.

I'm gradually migrating my huge private personal knowledge base into this public repo.

Hit the watch button on the top right for updates.

Some of these pages are still in progress pending porting and populated yet from my private knowledge base pages,some are stubs pending migration.

Much more advanced knowledge is captured in code and code comments. References to my majorGitHub Repos are providedthroughout where relevant.

References to official docs and some classic books are provided for those who want to thoroughly cover the basics.

• Travel Notes Touring the World as a Consultant and Tourist
• GitHub Repos
• Systems
  • Operating Systems
  • Core Services - DNS, DHCP, SSH, FTP
  • Editors
  • Terminal Multiplexers
• Architecture & Documentation
• Git
• Cloud
• Containerization
  • Docker
  • Kubernetes
    • Kubernetes Core
    • Cloud Hosted Kubernetes
    • On-premise Kubernetes
    • Local Kubernetes Dev
    • Kubernetes Applications & Lifecycle Management
  • Container Registries
  • Container Security
• Programming
  • Languages
  • Build Systems
  • Mobile Builds
  • Artifact Registries
  • Code Scanning
• Infrastructure-as-Code
• Configuration Management
• CI/CD
• Internet Services
• Databases / RDBMS
  • MPP Databases
  • Hosted MPP Databases
  • Database Management
• NoSQL
  • Caching
  • Search
• Coordination & Discovery Services
• Pub / Sub & Message Queues
• Data
  • Data Formats
  • Hadoop Ecosystem
  • Data Science & Machine Learning
  • Time Series Databases
  • Visualization
• Security
• Virtualization
• Hardware
• Networking
  • Load Balancing
• Monitoring
  • Performance Engineering
• AI & Automation
• Work
  • Remote Working & Digital Nomad
  • Training & Interview Materials
  • Banking Industry
  • Travel
• Miscellaneous
  • Dev / DevOps / Open Source / Agile
  • Vendors
  • Multimedia
  • Marketing
  • Crypto
  • Old Docs
• Star History
• Memes
  • This is the Lost Documentation
• More Core Repos
  • Knowledge
  • DevOps Code
  • Containerization
  • CI/CD
  • DBA - SQL
  • DevOps Reloaded
  • Templates
  • Misc
• Other Resources

• Travel - tips from travelling the world extensively for work consulting and as a tourist:
  • my favourite restaurants
  • flights & accommodation
  • mobile internet access & e-sim providers
  • visas
  • driving around Europe on road trips each summer
  • various other travel tips per country and city

Full of open source tools and scripts used throughout the rest of these docs to make it easier to install and operate these technologies:

• DevOps-Bash-tools - 1000+ Bash scripts, advanced shell environment customizations, quick installation scripts and dot configs
• DevOps-Python-tools - 80+ Python programs for DevOps & Data
• DevOps-Perl-tools - 25+ Perl programs for DevOps
• DevOps-Golang-tools - a handful of Golang programs
• Kubernetes-configs -many Kubernetes applications and advanced templates with Tips & Tricks from production environments
• SQL-scripts - 100+ database scripts
• Templates - templates for many common file formats for programming languages, build systems and DevOps configs
• Diagrams-as-Code - Cloud & Open Source architecture diagrams

This one is used widely throughout these pages:

• Linux
  • Debian
  • Ubuntu
  • Redhat
  • Alpine
  • Gentoo
• Windows
• Mac
  • Homebrew
• Shell
  • Bash
  • direnv /.envrc
  • Shell One Liners
  • Advanced & Third Party Commands
• Disk Management
• Logging
  • Syslog-ng
  • RSyslog

• SSH
  • SSH Tunnelling
• FTP
• DNS
• DHCP

• Editors & IDEs
  • Vim
  • IntelliJ
  • VS Code
• Coder

• Screen
• Tmux

• Architecture TODO
• Best Practices
• Product Selection TODO
• Diagrams-as-Code
  • D2 lang
  • MermaidJS
• Documentation
  • Markdown
  • MkDocs
• Microservices TODO
• Medium.com (blog)
• System Design

• Git
  • Git Workflow Branching Strategies
• Git Repo Hosting Providers:
  • GitHub (TODO: partially ported)
  • GitLab
  • Azure DevOps
  • Bitbucket (TODO: partially ported)
• Pre-Commit

• Cloud
• Cloud Platforms:
  • AWS
    • AMI Scanning
  • GCP
    • Firebase
  • Azure
  • Digital Ocean
• Third Party Tools:
  • MinIO
  • HashiCorp Vault
  • Keeper
• PaaS

• Docker
  • Dockerfile TODO
  • Docker Compose
  • Docker Swarm
• Podman
• Dockerfiles for many technologies:

• Kubernetes
• Kubernetes Upgrades
• Kubernetes Configs
• Kubernetes Production Ready Checklist
• Traefik
• Kong API Gateway
• Istio TODO
  • Kiali
• Kubeflow TODO

• AWS EKS TODO partial
  • EKS Upgrades
• GKE TODO
• AKS TODO
• Karpenter

• K3s
• Rancher
• RKE2
• Portworx

• Docker Desktop embedded Kubernetes (easiest to use)
• MiniKube
• MiniShift - for OpenShift upstreamokd
• K3d
• Kind

• Helm
• Kustomize
  • Helm vs Kustomize
• ArgoCD
• Cert Manager
• Kubernetes Configs:

• DockerHub
• AWSECR
• GCPGAR
  • GCPGCR (deprecated / shut down)
• AzureACR
• GitHubGHCR
• RedhatQuay.io (there is an on-prem installable too)
• JFrogContainer Registry
• Nexus
• Harbor
• Chart Museum

• Container Scanning
• Trivy
• Grype
• Clair

• Programming
• Binaries Debugging

• Perl
• Python
  • Anaconda
• Golang TODO
• Rust
• Ruby
• R TODO
• TCL / Expect
• JVM:
  • Java TODO
  • JDBC
  • JVM Performance Tuning
  • Groovy
  • Scala TODO
  • Jython
  • JRuby
  • SDKman
  • log4j
• JavaScript / NodeJS
• APIs
• Regular Expressions
• Testing

• Build Systems
• Make
• Maven
• Gradle
• SBT
• Fastlane

• Mobile Builds
• iOS
  • iXGuard
• Android
• Fastlane

• Artifact Registries
• Artifactory
• Nexus TODO

• Code Scanning
  • Trivy
  • Grype
• Code Quality
  • SonarQube
  • SonarCloud
  • CodeClimate

• Terraform
  • tfenv
  • Terragrunt
    • tgswitch
  • Atlantis
• Pulumi
• Packer

• Ansible
• Puppet TODO
• YAML

• CI/CD
• Mobile CI/CD
  • Mobile Builds
  • Fastlane
  • Firebase
• Self-Hosted CI/CD:
  • Jenkins
    • Jenkins-on-Kubernetes
    • HariSekhon/Jenkins - masterJenkinsfile template and Groovy Shared Library functions
  • TeamCity TODO
    • HariSekhon/TeamCity-CI
  • Concourse
  • GoCD TODO
• Git Repo Providers hosted CI/CD:
  • GitHub Actions
  • GitLab CI TODO
  • Azure DevOps TODO
  • Bitbucket Pipelines TODO
• 3rd Party hosted CI/CD:
  • CircleCI
  • TravisCI
  • Codefresh
  • Drone.io

• Web
• CDNs
  • Cloudflare
• HTTP Proxying
• APIs

• SQL TODO
• SQL scripts
• Databases
• Data Warehousing TODO
• MySQL TODO
• PostgreSQL TODO
• Oracle
• CloudBeaver

Massively Parallel Processing databases - horizontally scaling databases:

• Vertica
• Greenplum
• Impala TODO
• Presto
• Apache Drill

• Distributed SQL
• Snowflake
• Google BigQuery TODO
• AWS Redshift TODO

See also theHadoop Ecosystem section further down for more distributed SQL databases.

• LiquiBase TODO
• AtlasGo
• ByteBase TODO

• Cassandra TODO
• Couchbase
• HBase TODO
• MongoDB TODO
• Neo4j

• Redis TODO
• Memcached
• Couchbase
• Oracle Coherence

• Search
• Elasticsearch
  • Kibana
• Solr
• Logstash TODO

• Consul
• Etcd
• ZooKeeper

• Pub / Sub & Message Queues
• Kafka
• RabbitMQ
• Celery
• AWS Kinesis

• Data
• Big Data
• Data Warehousing TODO
• Spark TODO
• Airflow TODO
• Apache Camel
• JSON
• DVC
• Informatica

• Data Formats
• Avro
• Parquet
• JSON

• Spark TODO
• Kafka
• Hadoop TODO
  • Kerberos Hadoop TODO
  • YARN TODO
  • HDFS TODO
• Pig TODO
• Hive TODO
  • Sqoop
• Impala TODO
• Presto
• Apache Drill
• Kudu
• Kylin
• Storm TODO
• Mahout
• ZooKeeper

• Data Science TODO
• Machine Learning TODO
• Python
  • Anaconda
• DVC
• R TODO
• Octave TODO

• OpenTSDB
  • TCollector
• T.I.C.K. platform:
  • Telegraf TODO
  • InfluxDB
  • Chronograf TODO
  • Kapacitor

• Visualization
• Tableau

• Security TODO
• Encryption:
  • SSL TODO
  • VeraCrypt
  • Mac Native Encryption
• Kerberos TODO
• FreeIPA TODO
• Keycloak
• Penetration Testing TODO
• Secret Managers
  • HashiCorp Vault
  • Keeper
• SOC - Security Operations Center
• Code Scanning
• Code Quality
• Container Scanning
• AMI Scanning

• Virtualization
• VirtualBox
• Vagrant
• Packer
• OpenStack TODO
• KVM

• Hardware
• Storage

• Networking TODO
• Firewalls
• VPNs
• Cisco TODO
• Juniper TODO
• Foundry TODO
• Keepalived

• Load Balancing TODO
• HAProxy
• F5

• Monitoring
• Nagios
• Prometheus
• Thanos TODO
• Grafana TODO (partial)
• Notifications
  • OpsGenie
  • PagerDuty TODO
• Fluentd

• Performance Engineering
• Stress Testing

• AI
• Automation

• Remote Working & Digital Nomad
  • Travel

• Training
• Interview Materials

• Banking Industry

• Travel

• DevOps Misc
• Dev Misc
• Open Source
• Internet Miscellaneous
• TamperMonkey
• Jira
• Agile
• Spreadsheets
• IRC
• Communications - Chat & Video Conferencing

• Hashicorp
• Confluent
• Atlassian
  • Jira

• Multimedia
  • PDF
  • Image
  • Video
  • Audio
• Download Tools
• File Upload & Code Pastebin Sites
• Memes
• Social Media

• Marketing

This section is probably the most financially important thing you'll ever learn.

• Bitcoin
  • more financially beneficial than your Tech knowledge
  • the most important knowledge along with avoidingfeminist divorce law
• Crypto - TODO
  • every day you're not in crypto you're losing money due to constant inflationary money printing by central banks andgovernments to fund budgetary deficits caused by universal suffrage spending liabilities
  • even many investments, which are also taxed and often confiscated by governments or ex-wives, are losing ground toinflation in real terms

• Hazelcast
• Mesos
• DataHash

Here the TODOs are all getting filled in gradually... because we've all been here:

From myLinkedIn:

I tried to make these docs as short as possible... but as you can see above, I didn't quite make it.

I've been both the bottom and top of this meme:

The rest of my original source repos arehere.

Pre-built Docker images are available on myDockerHub.

papers-we-love/papers-we-love