"Too many connections"

[oremj]

One of the three stage instances I started on version 0.1.0 failed instantly with "too many connections".

Jul 30 16:30:14 ip-172-31-39-218.ec2.internal systemd[1]: Started Daemon for pushbox.
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Configured for development.
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => address: 0.0.0.0
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => port: 8000
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => log: normal
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => workers: 4
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => secret key: generated
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => limits: forms = 32KiB
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => tls: disabled
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => [extra] sqs_url: "..."
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => [extra] fxa_host: "oauth.stage.mozaws.net"
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => [extra] server_token: "..."
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: => [extra] database_url: "mysql://...:...@..."
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:15 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:16 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:18 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:21 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:28 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:41 ip-172-31-39-218.ec2.internal docker[2545]: Error: Too many connections
Jul 30 16:30:45 ip-172-31-39-218.ec2.internal docker[2545]: thread 'main' panicked at 'Could not get pool: Error(Some("Too many connections"))', libcore/result.rs:945:5
Jul 30 16:30:45 ip-172-31-39-218.ec2.internal docker[2545]: note: Run with `RUST_BACKTRACE=1` for a backtrace.

[oremj]

I didn't notice any other issues with the instance. I'll save one if this happens again.

[pjenvey]

AFAICT "Too many connections" messages are emitted by MySQL/Aurora but I can't say for sure

[oremj]

Ah, that might be the case. I wonder if pushbox is spamming MySQL with connections.

[pjenvey]

It defaults to a connection pool of 10 max connections and possibly an extra +1 at startup for the migrations