Repository files navigation

Read short introduction here:Create free HTTPS/SOCKS5 proxy servers using AWS Free Tier EC2 instances automatically on demand within Terraform and simple HTTP API.

Tools:

• Terraform to automatically create/install software/destroy EC2 instances
• Proxy server -Goproxy
• RubySinatra gem for HTTP API to manage proxy instances (optional)
• Ubuntu 16.04 server
• Systemd to convert goproxy process to the system daemon service

• Clone the repo:$ git clone https://github.com/vifreefly/ec2_proxies.git
• InstallCLI Terraform:

# example for 0.12.5 version. Check latest here https://www.terraform.io/downloads.htmlcd /tmp&& wget https://releases.hashicorp.com/terraform/0.12.5/terraform_0.12.5_linux_amd64.zipsudo unzip terraform_0.12.5_linux_amd64.zip -d /usr/local/binrm terraform_0.12.5_linux_amd64.zip

• Run$ terraform init inside of project directory.
• For HTTP API (optionally):install ruby (if you don't have it yet. Minimal supported version is 2.3), install bundler gem$ gem install bundler and then run$ bundle install inside of project directory.

1) Provide yourAWS_ACCESS_KEY_ID andAWS_SECRET_ACCESS_KEY credentials to manage EC2 instances. It is good practice to have separate user roles with restricted permissions for different projects.

Check here how to create a new AWS user role and copy credentials. You'll need a user role withAmazonEC2FullAccess permission. Then create fileterraform.tfvars (inside of project directory) and put thereAWS_ACCESS_KEY_ID andAWS_SECRET_ACCESS_KEY, example:

AWS_ACCESS_KEY_ID="78J347ZVBPY5R4EPXYGQ"AWS_SECRET_ACCESS_KEY="WvrNVw38ZJT8pbMV6Vy75RQuLoBdgW6ijtRLMgdt"

2) Generate SSH key pair for EC2 instances and save it to the .ssh subfolder:$ ssh-keygen -f .ssh/ec2_key -N ''

All default settings located in theconfig.tf file. If you want to change the value of variable, don't editconfig.tf file, instead put your configuration to theterreform.tfvars file (create this file if it doesn't exists). Use formatVARIABLE_NAME="value" inside ofterreform.tfvars file.

You'll probably want to tweak following settings:

• AWS_INSTANCES_COUNT - the number of proxy servers to create. Default is 5. You can set itup to 20.
• AWS_DEFAULT_REGION - region of instances (proxy servers) where they will be created. Default isus-east-1. Checkavailable regions here. Keep in mind thatAWS_INSTANCE_AMI should match AWS_DEFAULT_REGION. You can find required AWS_INSTANCE_AMI for a specific region here:https://us-east-2.console.aws.amazon.com/ec2/v2/home#LaunchInstanceWizard:
• PROXY_TYPE - type of proxy server. Default issocks (socks5). If you need HTTP/HTTPS anonymous proxy instead, set variable tohttp.
• PROXY_PORT - port of proxy server. Default is46642.
• PROXY_USER andPROXY_PASSWORD - set these variables if you want proxy server use authorization. Defaut is empty (proxy without authorization).

Command$ terraform apply will create EC2 instances and make instances setup (install and run goproxy server). From output you'll get IP addresses of created instances. Example:

$ terraform apply...Apply complete! Resources: 7 added, 0 changed, 0 destroyed.Outputs:instances = [    54.225.911.634,    31.207.37.49,    53.235.228.205,    52.31.233.217,    35.213.244.142]

Use these IP addresses to connect to proxy servers (proxy type, port and user/password settings were applied from config.tf, see Settings above).

Command$ terraform output will print IP addresses of created instances. Example:

$ terraform outputinstances = [    54.225.911.634,    31.207.37.49,    53.235.228.205,    52.31.233.217,    35.213.244.142]

Command$ terraform destroy will destroy all created instances. Example:

$ terraform destroy...aws_instance.ProxyNode[4]: Destruction complete after 57saws_instance.ProxyNode[0]: Destruction complete after 57saws_instance.ProxyNode[3]: Destruction complete after 57saws_instance.ProxyNode[2]: Destruction complete after 57saws_instance.ProxyNode[1]: Destruction complete after 57saws_security_group.ec2_proxies_sg: Destroying... (ID: sg-2543a86e)aws_key_pair.ec2_key: Destroying... (ID: ec2_key)aws_key_pair.ec2_key: Destruction complete after 2saws_security_group.ec2_proxies_sg: Destruction complete after 2sDestroy complete! Resources: 7 destroyed.

First, start the API server:$ RACK_ENV=production HOST=127.0.0.1 bundle exec ruby app.rb. API will be available onhttp://localhost:4567.

Make post request/api/v1/apply to create proxy servers. Configuration inconfig.tf will be used to create instances.

You can pass additional parameters in request body to apply custom settings:aws_instances_count,proxy_type,proxy_port,proxy_user andproxy_password.

Example:

$ curl -X POST http://localhost:4567/api/v1/apply -d 'proxy_type=http&proxy_port=5555&aws_instances_count=3&proxy_user=admin&proxy_password=123456'{  "status": "Ok",  "message": "Successfully performed apply action",  "data": {    "instances": [      "57.94.21.138",      "28.206.169.144",      "44.240.61.89"    ]  }}

Make get request/api/v1/instances_list to get IP addresses of created proxy servers. Example:

$ curl -X GET http://localhost:4567/api/v1/instances_list{  "status": "Ok",  "message": "Running 3 instances",  "data": {    "instances": [      "57.94.21.138",      "28.206.169.144",      "44.240.61.89"    ]  }}

Make post request/api/v1/destroy to destroy all proxy servers. Example:

$ curl -X POST http://localhost:4567/api/v1/destroy{  "status": "Ok",  "message": "Successfully performed destroy action"}

MIT