サクサク読めて、
アプリ限定の機能も多数！
アプリで開く
SparkとYARNについて書きます。テーマ的にインフラストラクチャについての話が多くなると思います。 SparkとHadoopの関係性 SparkはHadoopクラスタへの依存はしていない。(ただし、ややこしいのだがHDFSやYARNのクライアントライブラリへの依存はある)なのでHadoopなしでも動かすことができる。しかしそれでもHadoopと一緒に動作させることが多いのは以下の理由による。 クラスタマネージャとしてのYARN Sparkはアプリケーション（厳密にはSparkアプリケーション）ごとに下記のようなクラスタが構築される。Driver Programと呼ばれる、SparkContextオブジェクトを持ち、アプリケーションコードの主要部分を実行するアプリケーションのマスタコンポーネントと、RDDに対するオペレーションを実行するExecutor群。そして、Driver Progr
KubeCon + CloudNativeCon 2025Join us for four days of incredible opportunities to collaborate, learn and share with the cloud native community. Buy your ticket now! 10 - 13 November | Atlanta, Georgia PKIcertificates and requirementsKubernetes requires PKIcertificates for authentication over TLS. If you installKubernetes with kubeadm, thecertificates that your cluster requires are automaticall
Amazon EKS - FAQsWhat isAmazon ElasticKubernetes Service (Amazon EKS)?Amazon EKS is a managed service that makesit easy for you to runKubernetes onAWS without installing and operating your ownKubernetes control plane or worker nodes.Kubernetes is an open-source container orchestration system allowing you to deploy and manage containerized applications at scale.Kubernetes arranges containers intological g
minikube is localKubernetes, focusing on makingit easy to learn and develop forKubernetes. All you need isDocker (orsimilarly compatible) container or a VirtualMachine environment, andKubernetes is a single command away: minikube start What you’ll need 2CPUs or more 2GB of free memory 20GB of free disk space Internet connection Container or virtualmachine manager, such as:Docker, QEMU, H
KubeCon + CloudNativeCon 2025Join us for four days of incredible opportunities to collaborate, learn and share with the cloud native community. Buy your ticket now! 10 - 13 November | Atlanta, Georgia Share Process Namespace between Containers in a PodThis page shows how to configure process namespace sharing for a pod. When process namespace sharing is enabled, processes in a container are visibl
KubeCon + CloudNativeCon 2025Join us for four days of incredible opportunities to collaborate, learn and share with the cloud native community. Buy your ticket now! 10 - 13 November | Atlanta, Georgia Set up an ExtensionAPI ServerSetting up an extensionAPI server to work with the aggregation layer allows theKubernetesapiserver to be extended with additionalAPIs, which are not part of the core
KubeCon + CloudNativeCon 2025Join us for four days of incredible opportunities to collaborate, learn and share with the cloud native community. Buy your ticket now! 10 - 13 November | Atlanta, Georgia NamespacesInKubernetes, namespaces provide a mechanism for isolating groups of resources within a single cluster. Names of resources need to be unique within a namespace, but not across namespaces.
This glossary is intended to be a comprehensive, standardized list ofKubernetes terminology.It includestechnical terms that are specific toKubernetes, as well as more general terms that provide useful context.
KubeCon + CloudNativeCon 2025Join us for four days of incredible opportunities to collaborate, learn and share with the cloud native community. Buy your ticket now! 10 - 13 November | Atlanta, Georgia Dynamic Admission ControlIn addition to compiled-in admission plugins, admission plugins can be developed as extensions and run as webhooks configured at runtime. This page describes how tobuild, co
料金 - Amazon EKS | AWSAmazon EKS Auto Mode この料金は、EKS Auto Mode が有効になっているAmazon EKS クラスターに適用されます。Amazon EKS Auto Mode の料金は、EKS Auto Mode によって起動および管理されるAmazon EC2 インスタンスの期間とタイプに基づいてお支払いいただきます。以下のAmazon EKS Auto Mode の料金は、EC2 インスタンス自体を対象とするAmazon EC2 インスタンス料金に加えて請求されます。EC2 インスタンス料金と同様に、EKS Auto Mode の料金は 1 秒単位で課金され、1 分間分の最低料金がかかります。オンデマンド、1 年および 3 年のリザーブドインスタンス、Compute Savings Plans、スポットインスタンスなど、EKS Auto Mode では Amazo
この記事は RECRUIT MARKETING PARTNERS Advent Calendar 2017 の投稿記事です。 こんにちは、開発支援Gでインフラ運用をしている大島です。アドベントカレンダー 2017 の記念すべき1日目はAWS re:Invent in ラスベガス からお届けします。AWS re:InventはAmazon Web Service, Inc.が毎年開催している技術とマーケティングののカンファレンスで、今回は6回目の開催となります。新しいサービスや機能のアップデートが基調講演で発表されたり、1000以上のセッションが行われたりするなどお楽しみが盛り沢山な5日間のイベントです。 開発支援Gが管轄しているサービスのインフラは主にAWS上に構築されており、DockernizeしたアプリケーションをAmazon Elastic Container Service（以
KubeCon + CloudNativeCon North America 2021 Los Angeles, California + Virtual. 5 days of incredible opportunites to collaborate, learn + share with the entire community! October 11 - 15, 2021. Overview A kubelet's HTTPS endpoint exposesAPIs which give access to data of varying sensitivity, and allow you to perform operations with varying levels of power on the node and within containers. This doc
Note:Dockershim has been removed from theKubernetes project as of release 1.24. Read theDockershim Removal FAQ for further details. You need to install a container runtime into each node in the cluster so that Pods can run there. This page outlines what is involved and describes related tasks for setting up nodes.Kubernetes 1.34 requires that you use a runtime that conforms with the Container
KubeCon + CloudNativeCon 2025Join us for four days of incredible opportunities to collaborate, learn and share with the cloud native community. Buy your ticket now! 10 - 13 November | Atlanta, Georgia kubectlUsage ConventionsRecommendedusage conventions for kubectl. Using kubectl in Reusable ScriptsFor a stable output in a script: Request one of themachine-oriented output forms, such as -o name
KubeCon + CloudNativeCon 2025Join us for four days of incredible opportunities to collaborate, learn and share with the cloud native community. Buy your ticket now! 10 - 13 November | Atlanta, Georgia Reserve Compute Resources for System DaemonsKubernetes nodes can be scheduled to Capacity. Pods can consume all the available capacity on a node by default. This is an issue because nodes typically r
This page describes the RuntimeClass resource and runtime selection mechanism. RuntimeClass is a feature for selecting the container runtime configuration. The container runtime configuration is used to run a Pod's containers. MotivationYou can set a different RuntimeClass between different Pods to provide a balance of performance versussecurity. For example, if part of your workload deserves a h
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Manage Amazon EMR clusters - Amazon EMR
Plan, configure and launch Amazon EMR clusters - Amazon EMR
