Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Terraform module that provision an S3 bucket to store the `terraform.tfstate` file and a DynamoDB table to lock the state file to prevent concurrent modifications and state corruption.

License

NotificationsYou must be signed in to change notification settings

cloudposse/terraform-aws-tfstate-backend

Project Banner

Latest ReleaseLast UpdatedSlack CommunityGet Support

Terraform module to provision an S3 bucket to storeterraform.tfstate file and a DynamoDB table to lock the state fileto prevent concurrent modifications and state corruption.

The module supports the following:

  1. Forced server-side encryption at rest for the S3 bucket
  2. S3 bucket versioning to allow for Terraform state recovery in the case of accidental deletions and human errors
  3. State locking and consistency checking via DynamoDB table to prevent concurrent operations
  4. DynamoDB server-side encryption

https://www.terraform.io/docs/backends/types/s3.html

NOTE: The operators of the module (IAM Users) must have permissions to create S3 buckets and DynamoDB tables when performingterraform plan andterraform apply

NOTE: This module cannot be used to apply changes to themfa_delete feature of the bucket. Changes regarding mfa_delete can only be made manually using the root credentials with MFA of the AWS Account where the bucket resides. Please see:hashicorp/terraform-provider-aws#629

Tip

👽 Use Atmos with Terraform

Cloud Posse usesatmos to easily orchestrate multiple environments using Terraform.
Works withGithub Actions,Atlantis, orSpacelift.

Watch demo of using Atmos with Terraform
Example of runningatmos to manage infrastructure from ourQuick Start tutorial.

Usage

Create

Follow this procedure just once to create your deployment.

  1. Add theterraform_state_backend module to yourmain.tf file. Thecomment will help you remember to follow this procedure in the future:

    # You cannot create a new backend by simply defining this and then# immediately proceeding to "terraform apply". The S3 backend must# be bootstrapped according to the simple yet essential procedure in# https://github.com/cloudposse/terraform-aws-tfstate-backend#usagemodule"terraform_state_backend" {source="cloudposse/tfstate-backend/aws"# Cloud Posse recommends pinning every module to a specific version# version     = "x.x.x"namespace="eg"stage="test"name="terraform"attributes=["state"]terraform_backend_config_file_path="."terraform_backend_config_file_name="backend.tf"force_destroy=false}# Your Terraform configurationmodule"another_module" {source="....."}

    Module inputsterraform_backend_config_file_path andterraform_backend_config_file_name control the name of the backenddefinition file. Note that whenterraform_backend_config_file_path isempty (the default), no file is created.

  2. terraform init. This downloads Terraform modules and providers.

  3. terraform apply -auto-approve. This creates the state bucket and DynamoDB lockingtable, along with anything else you have defined in your*.tf file(s). Atthis point, the Terraform state is still stored locally.

    Moduleterraform_state_backend also creates a newbackend.tf filethat defines the S3 state backend. For example:

    backend"s3" {region="us-east-1"bucket="< the name of the S3 state bucket >"key="terraform.tfstate"dynamodb_table="< the name of the DynamoDB locking table >"profile=""role_arn=""encrypt=true}

    Henceforth, Terraform will also read this newly-created backend definitionfile.

  4. terraform init -force-copy. Terraform detects that you want to move yourTerraform state to the S3 backend, and it does so per-auto-approve. Now thestate is stored in the S3 bucket, and the DynamoDB table will be used to lockthe state to prevent concurrent modification.

This concludes the one-time preparation. Now you can extend and modify yourTerraform configuration as usual.

Destroy

Follow this procedure to delete your deployment.

  1. Inmain.tf, change theterraform_state_backend module arguments asfollows:
    module"terraform_state_backend" {# ...terraform_backend_config_file_path=""force_destroy=true }
  2. terraform apply -target module.terraform_state_backend -auto-approve.This implements the above modifications by deleting thebackend.tf fileand enabling deletion of the S3 state bucket.
  3. terraform init -force-copy. Terraform detects that you want to move yourTerraform state from the S3 backend to local files, and it does so per-auto-approve. Now the state is once again stored locally and the S3state bucket can be safely deleted.
  4. terraform destroy. This deletes all resources in your deployment.
  5. Examine local state fileterraform.tfstate to verify that it containsno resources.

s3-bucket-with-terraform-state

Bucket Replication (Disaster Recovery)

To enable S3 bucket replication in this module, sets3_replication_enabled totrue and populates3_replica_bucket_arn with the ARN of an existing bucket.

module"terraform_state_backend" {source="cloudposse/tfstate-backend/aws"# Cloud Posse recommends pinning every module to a specific version# version     = "x.x.x"namespace="eg"stage="test"name="terraform"attributes=["state"]terraform_backend_config_file_path="."terraform_backend_config_file_name="backend.tf"force_destroy=falses3_replication_enabled=trues3_replica_bucket_arn="arn:aws:s3:::eg-test-terraform-tfstate-replica"}

Important

In Cloud Posse's examples, we avoid pinning modules to specific versions to prevent discrepancies between the documentationand the latest released versions. However, for your own projects, we strongly advise pinning each module to the exact versionyou're using. This practice ensures the stability of your infrastructure. Additionally, we recommend implementing a systematicapproach for updating versions to avoid unexpected changes.

Requirements

NameVersion
terraform>= 1.1.0
aws>= 4.9.0
local>= 2.0
time>= 0.7.1

Providers

NameVersion
aws>= 4.9.0
local>= 2.0
time>= 0.7.1

Modules

NameSourceVersion
bucket_labelcloudposse/label/null0.25.0
dynamodb_table_labelcloudposse/label/null0.25.0
replication_labelcloudposse/label/null0.25.0
thiscloudposse/label/null0.25.0

Resources

NameType
aws_dynamodb_table.with_server_side_encryptionresource
aws_iam_policy.replicationresource
aws_iam_role.replicationresource
aws_iam_role_policy_attachment.replicationresource
aws_s3_bucket.defaultresource
aws_s3_bucket_acl.defaultresource
aws_s3_bucket_logging.defaultresource
aws_s3_bucket_ownership_controls.defaultresource
aws_s3_bucket_policy.defaultresource
aws_s3_bucket_public_access_block.defaultresource
aws_s3_bucket_replication_configuration.replicationresource
aws_s3_bucket_server_side_encryption_configuration.defaultresource
aws_s3_bucket_versioning.defaultresource
local_file.terraform_backend_configresource
time_sleep.wait_for_aws_s3_bucket_settingsresource
aws_iam_policy_document.aggregated_policydata source
aws_iam_policy_document.bucket_policydata source
aws_iam_policy_document.replicationdata source
aws_iam_policy_document.replication_stsdata source
aws_region.currentdata source

Inputs

NameDescriptionTypeDefaultRequired
aclThe canned ACL to apply to the S3 bucketstring"private"no
additional_tag_mapAdditional key-value pairs to add to each map intags_as_list_of_maps. Not added totags orid.
This is for some rare cases where resources want additional configuration of tags
and therefore take a list of maps with tag key, value, and additional configuration.
map(string){}no
arn_formatARN format to be used. May be changed to support deployment in GovCloud/China regions.string"arn:aws"no
attributesID element. Additional attributes (e.g.workers orcluster) to add toid,
in the order they appear in the list. New attributes are appended to the
end of the list. The elements of the list are joined by thedelimiter
and treated as a single ID element.
list(string)[]no
billing_modeDynamoDB billing modestring"PAY_PER_REQUEST"no
block_public_aclsWhether Amazon S3 should block public ACLs for this bucketbooltrueno
block_public_policyWhether Amazon S3 should block public bucket policies for this bucketbooltrueno
bucket_enabledWhether to create the S3 bucket.booltrueno
bucket_ownership_enforced_enabledSet bucket object ownership to "BucketOwnerEnforced". Disables ACLs.booltrueno
contextSingle object for setting entire context at once.
See description of individual variables for details.
Leave string and numeric variables asnull to use default value.
Individual variable settings (non-null) override settings in context object,
except for attributes, tags, and additional_tag_map, which are merged.
any
{
"additional_tag_map": {},
"attributes": [],
"delimiter": null,
"descriptor_formats": {},
"enabled": true,
"environment": null,
"id_length_limit": null,
"label_key_case": null,
"label_order": [],
"label_value_case": null,
"labels_as_tags": [
"unset"
],
"name": null,
"namespace": null,
"regex_replace_chars": null,
"stage": null,
"tags": {},
"tenant": null
}
no
deletion_protection_enabledA boolean that enables deletion protection for DynamoDB tableboolfalseno
delimiterDelimiter to be used between ID elements.
Defaults to- (hyphen). Set to"" to use no delimiter at all.
stringnullno
descriptor_formatsDescribe additional descriptors to be output in thedescriptors output map.
Map of maps. Keys are names of descriptors. Values are maps of the form
{<br/> format = string<br/> labels = list(string)<br/>}
(Type isany so the map values can later be enhanced to provide additional options.)
format is a Terraform format string to be passed to theformat() function.
labels is a list of labels, in order, to pass toformat() function.
Label values will be normalized before being passed toformat() so they will be
identical to how they appear inid.
Default is{} (descriptors output will be empty).
any{}no
dynamodb_enabledWhether to create the DynamoDB table.booltrueno
dynamodb_table_nameOverride the name of the DynamoDB table which defaults to usingmodule.dynamodb_table_label.idstringnullno
enable_point_in_time_recoveryEnable DynamoDB point-in-time recoverybooltrueno
enable_public_access_blockEnable Bucket Public Access Blockbooltrueno
enabledSet to false to prevent the module from creating any resourcesboolnullno
environmentID element. Usually used for region e.g. 'uw2', 'us-west-2', OR role 'prod', 'staging', 'dev', 'UAT'stringnullno
force_destroyA boolean that indicates the S3 bucket can be destroyed even if it contains objects. These objects are not recoverableboolfalseno
id_length_limitLimitid to this many characters (minimum 6).
Set to0 for unlimited length.
Set tonull for keep the existing setting, which defaults to0.
Does not affectid_full.
numbernullno
ignore_public_aclsWhether Amazon S3 should ignore public ACLs for this bucketbooltrueno
kms_master_key_idAWS KMS master key ID used for the SSE-KMS encryption.
This can only be used when you set the value of sse_algorithm as aws:kms.
stringnullno
label_key_caseControls the letter case of thetags keys (label names) for tags generated by this module.
Does not affect keys of tags passed in via thetags input.
Possible values:lower,title,upper.
Default value:title.
stringnullno
label_orderThe order in which the labels (ID elements) appear in theid.
Defaults to ["namespace", "environment", "stage", "name", "attributes"].
You can omit any of the 6 labels ("tenant" is the 6th), but at least one must be present.
list(string)nullno
label_value_caseControls the letter case of ID elements (labels) as included inid,
set as tag values, and output by this module individually.
Does not affect values of tags passed in via thetags input.
Possible values:lower,title,upper andnone (no transformation).
Set this totitle and setdelimiter to"" to yield Pascal Case IDs.
Default value:lower.
stringnullno
labels_as_tagsSet of labels (ID elements) to include as tags in thetags output.
Default is to include all labels.
Tags with empty values will not be included in thetags output.
Set to[] to suppress all generated tags.
Notes:
The value of thename tag, if included, will be theid, not thename.
Unlike othernull-label inputs, the initial setting oflabels_as_tags cannot be
changed in later chained modules. Attempts to change it will be silently ignored.
set(string)
[
"default"
]
no
loggingDestination (S3 bucket name and prefix) for S3 Server Access Logs for the S3 bucket.
list(object({
target_bucket = string
target_prefix = string
}))
[]no
mfa_deleteA boolean that indicates that versions of S3 objects can only be deleted with MFA. ( Terraform cannot apply changes of this value;hashicorp/terraform-provider-aws#629 )boolfalseno
nameID element. Usually the component or solution name, e.g. 'app' or 'jenkins'.
This is the only ID element not also included as atag.
The "name" tag is set to the fullid string. There is no tag with the value of thename input.
stringnullno
namespaceID element. Usually an abbreviation of your organization name, e.g. 'eg' or 'cp', to help ensure generated IDs are globally uniquestringnullno
permissions_boundaryARN of the policy that is used to set the permissions boundary for the IAM replication rolestring""no
prevent_unencrypted_uploadsPrevent uploads of unencrypted objects to S3booltrueno
profileAWS profile name as set in the shared credentials filestring""no
read_capacityDynamoDB read capacity units when using provisioned modenumber5no
regex_replace_charsTerraform regular expression (regex) string.
Characters matching the regex will be removed from the ID elements.
If not set,"/[^a-zA-Z0-9-]/" is used to remove all characters other than hyphens, letters and digits.
stringnullno
restrict_public_bucketsWhether Amazon S3 should restrict public bucket policies for this bucketbooltrueno
role_arnThe role to be assumedstring""no
s3_bucket_nameS3 bucket name. If not provided, the name will be generated from the context by the label module.string""no
s3_replica_bucket_arnThe ARN of the S3 replica bucket (destination)string""no
s3_replication_enabledSet this to true and specifys3_replica_bucket_arn to enable replicationboolfalseno
source_policy_documentsList of IAM policy documents (in JSON format) that are merged together into the generated S3 bucket policy.
Statements must have unique SIDs.
Statement having SIDs that match policy SIDs generated by this module will override them.
list(string)[]no
sse_encryptionThe server-side encryption algorithm to use.
Valid values areAES256,aws:kms, andaws:kms:dsse.
string"AES256"no
stageID element. Usually used to indicate role, e.g. 'prod', 'staging', 'source', 'build', 'test', 'deploy', 'release'stringnullno
tagsAdditional tags (e.g.{'BusinessUnit': 'XYZ'}).
Neither the tag keys nor the tag values will be modified by this module.
map(string){}no
tenantID element _(Rarely used, not included by default)_. A customer identifier, indicating who this instance of a resource is forstringnullno
terraform_backend_config_file_name(Deprecated) Name of terraform backend config file to generatestring"terraform.tf"no
terraform_backend_config_file_path(Deprecated) Directory for the terraform backend config file, usually.. The default is to create no file.string""no
terraform_backend_config_template_file(Deprecated) The path to the template used to generate the config filestring""no
terraform_state_fileThe path to the state file inside the bucketstring"terraform.tfstate"no
terraform_versionThe minimum required terraform versionstring"1.0.0"no
write_capacityDynamoDB write capacity units when using provisioned modenumber5no

Outputs

NameDescription
dynamodb_table_arnDynamoDB table ARN
dynamodb_table_idDynamoDB table ID
dynamodb_table_nameDynamoDB table name
s3_bucket_arnS3 bucket ARN
s3_bucket_domain_nameS3 bucket domain name
s3_bucket_idS3 bucket ID
s3_replication_role_arnThe ARN of the IAM Role created for replication, if enabled.
terraform_backend_configRendered Terraform backend config file

Related Projects

Check out these related projects.

Tip

Use Terraform Reference Architectures for AWS

Use Cloud Posse's ready-to-goterraform architecture blueprints for AWS to get up and running quickly.

✅ We build it together with your team.
✅ Your team owns everything.
✅ 100% Open Source and backed by fanatical support.

Request Quote

📚Learn More

Cloud Posse is the leadingDevOps Accelerator for funded startups and enterprises.

Your team can operate like a pro today.

Ensure that your team succeeds by using Cloud Posse's proven process and turnkey blueprints. Plus, we stick around until you succeed.

Day-0: Your Foundation for Success

  • Reference Architecture. You'll get everything you need from the ground up built using 100% infrastructure as code.
  • Deployment Strategy. Adopt a proven deployment strategy with GitHub Actions, enabling automated, repeatable, and reliable software releases.
  • Site Reliability Engineering. Gain total visibility into your applications and services with Datadog, ensuring high availability and performance.
  • Security Baseline. Establish a secure environment from the start, with built-in governance, accountability, and comprehensive audit logs, safeguarding your operations.
  • GitOps. Empower your team to manage infrastructure changes confidently and efficiently through Pull Requests, leveraging the full power of GitHub Actions.

Request Quote

Day-2: Your Operational Mastery

  • Training. Equip your team with the knowledge and skills to confidently manage the infrastructure, ensuring long-term success and self-sufficiency.
  • Support. Benefit from a seamless communication over Slack with our experts, ensuring you have the support you need, whenever you need it.
  • Troubleshooting. Access expert assistance to quickly resolve any operational challenges, minimizing downtime and maintaining business continuity.
  • Code Reviews. Enhance your team’s code quality with our expert feedback, fostering continuous improvement and collaboration.
  • Bug Fixes. Rely on our team to troubleshoot and resolve any issues, ensuring your systems run smoothly.
  • Migration Assistance. Accelerate your migration process with our dedicated support, minimizing disruption and speeding up time-to-value.
  • Customer Workshops. Engage with our team in weekly workshops, gaining insights and strategies to continuously improve and innovate.

Request Quote

✨ Contributing

This project is under active development, and we encourage contributions from our community.

Many thanks to our outstanding contributors:

For 🐛 bug reports & feature requests, please use theissue tracker.

In general, PRs are welcome. We follow the typical "fork-and-pull" Git workflow.

  1. Review ourCode of Conduct andContributor Guidelines.
  2. Fork the repo on GitHub
  3. Clone the project to your own machine
  4. Commit changes to your own branch
  5. Push your work back up to your fork
  6. Submit aPull Request so that we can review your changes

NOTE: Be sure to merge the latest changes from "upstream" before making a pull request!

Running Terraform Tests

We useAtmos to streamline how Terraform tests are run. It centralizes configuration and wraps common test workflows with easy-to-use commands.

All tests are located in thetest/ folder.

Under the hood, tests are powered by Terratest together with our internalTest Helpers library, providing robust infrastructure validation.

Setup dependencies:

To run tests:

  • Run all tests:
    atmostest run
  • Clean up test artifacts:
    atmostest clean
  • Explore additional test options:
    atmostest --help

The configuration for test commands is centrally managed. To review what's being imported, see theatmos.yaml file.

Learn more about ourautomated testing in our documentation or implementingcustom commands with atmos.

🌎 Slack Community

Join ourOpen Source Community on Slack. It'sFREE for everyone! Our "SweetOps" community is where you get to talk with others who share a similar vision for how to rollout and manage infrastructure. This is the best place to talk shop, ask questions, solicit feedback, and work together as a community to build totallysweet infrastructure.

📰 Newsletter

Sign up forour newsletter and join 3,000+ DevOps engineers, CTOs, and founders who get insider access to the latest DevOps trends, so you can always stay in the know.Dropped straight into your Inbox every week — and usually a 5-minute read.

📆 Office Hours

Join us every Wednesday via Zoom for your weekly dose of insider DevOps trends, AWS news and Terraform insights, all sourced from our SweetOps community, plus alive Q&A that you can’t find anywhere else.It'sFREE for everyone!

License

License

Preamble to the Apache License, Version 2.0

Complete license is available in theLICENSE file.

Licensed to the Apache Software Foundation (ASF) under oneor more contributor license agreements.  See the NOTICE filedistributed with this work for additional informationregarding copyright ownership.  The ASF licenses this fileto you under the Apache License, Version 2.0 (the"License"); you may not use this file except in compliancewith the License.  You may obtain a copy of the License at  https://www.apache.org/licenses/LICENSE-2.0Unless required by applicable law or agreed to in writing,software distributed under the License is distributed on an"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANYKIND, either express or implied.  See the License for thespecific language governing permissions and limitationsunder the License.

Trademarks

All other trademarks referenced herein are the property of their respective owners.


Copyright © 2017-2025Cloud Posse, LLC

README footer

Beacon

About

Terraform module that provision an S3 bucket to store the `terraform.tfstate` file and a DynamoDB table to lock the state file to prevent concurrent modifications and state corruption.

Topics

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Sponsor this project

 

Packages

No packages published

[8]ページ先頭

©2009-2025 Movatter.jp