Random useful notes
📦docker-compose.qnap.yml – For QNAP NAS Sampledocker-compose file intended for use withinQNAP Container Station to deploy multiple containers simultaneously.
Can be deployed viaPortainer , if available. Alternatively, use"Create Application" under theCreate tab in Container Station. It is recommended to create named volumes viaPortainer for better control and reusability. 📦docker-compose.jupyter.yml – Jupyter + Spark + Hadoop Sets up a lightweight big data lab using Docker containers for:
Hadoop HDFS : NameNode + DataNodeApache Spark : Master-only (standalone mode)Jupyter Notebook : PySpark-enabled kernelMounts a local folder from your Windows machine into the notebook container so that your.ipynb files are stored and accessible locally:
volumes : -" /c/Users/yourusername/somefolder:/home/jovyan/somefolder/" Replaceyourusername andsomefolder with your actual Windows path.
Component URL Purpose HDFS UI http://localhost:9870View file system status and health Spark UI http://localhost:8080Monitor Spark master and workers Jupyter Lab http://localhost:8888Access Jupyter notebooks