Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Init concurrency/parallelism issues #2542

Closed
bushong1 opened this issue Apr 20, 2023 · 7 comments · Fixed by #2568
Closed

Init concurrency/parallelism issues #2542

bushong1 opened this issue Apr 20, 2023 · 7 comments · Fixed by #2568
Labels
awaiting response Waiting for a response or more data from issue reporter question

Comments

@bushong1
Copy link

I'm trying to track down some issues we've been having lately with what i believe is parallelism. We updated our environment to use a shared tf plugin cache path to cut down on directory size with all the provider binaries:

TF_PLUGIN_CACHE_DIR="${HOME}/.terraform-plugin-cache"

Since then, our directory size is much smaller, but we're running into a lot of issues with sporrattic init issues:

$ terragrunt run-all init
<...>

#### module 1: (error installing)
│ Error: Required plugins are not installed
│ 
│ The installed provider plugins are not consistent with the packages
│ selected in the dependency lock file:
│   - registry.terraform.io/hashicorp/aws: the cached package for registry.terraform.io/hashicorp/aws 4.61.0 (in .terraform/providers) does not match any of the checksums recorded in the dependency lock file
│ 
│ Terraform uses external plugins to integrate with a variety of different
│ infrastructure services. To download the plugins required for this
│ configuration, run:
│   terraform init
╵

#### module 2: (using previously installed)
 Initializing the backend...
 Initializing modules...

 Initializing provider plugins...
 - Reusing previous version of hashicorp/aws from the dependency lock file
 - Using previously-installed hashicorp/aws v4.61.0

 Terraform has been successfully initialized!

 You may now begin working with Terraform. Try running "terraform plan" to see
 any changes that are required for your infrastructure. All Terraform commands
 should now work.

 If you ever set or change modules or backend configuration for Terraform,
 rerun this command to reinitialize your working directory. If you forget, other
 commands will detect it and remind you to do so if necessary.


#### module 3: (installing seemingly from scratch)
 Initializing the backend...

 Initializing provider plugins...
 - Reusing previous version of hashicorp/aws from the dependency lock file
 - Installing hashicorp/aws v4.61.0...
 - Installed hashicorp/aws v4.61.0 (signed by HashiCorp)

 Terraform has made some changes to the provider dependency selections recorded
 in the .terraform.lock.hcl file. Review those changes and commit them to your
 version control system if they represent changes you intended to make.

 Terraform has been successfully initialized!

 You may now begin working with Terraform. Try running "terraform plan" to see
 any changes that are required for your infrastructure. All Terraform commands
 should now work.

 If you ever set or change modules or backend configuration for Terraform,
 rerun this command to reinitialize your working directory. If you forget, other
 commands will detect it and remind you to do so if necessary.

Setting paralleism to 4 seems to stop this from happening. Is this a known limitation with parallelism and shared plugin cache? I just can't figure out why my aws provider keeps on having checksum failures.
@denis256
Copy link
Member

Hi,
as mentioned in the documentation

Note: The plugin cache directory is not guaranteed to be concurrency safe. The provider installer's behavior in environments with multiple terraform init calls is undefined.

I would suggest running terragrunt run-all init with --terragrunt-parallelism=1

@denis256 denis256 added question awaiting response Waiting for a response or more data from issue reporter labels Apr 21, 2023
@geekofalltrades
Copy link
Contributor

If you're using Terraform >=1.4.0, you may specifically be running into problems related to changes made in the caching mechanism.

hashicorp/terraform#32205

@levkohimins
Copy link
Contributor

levkohimins commented May 6, 2023 •
edited
Loading

@bushong1, How can I reproduce the issue locally? Could you please provide a configuration that produces this result?

@geekofalltrades
Copy link
Contributor

geekofalltrades commented May 15, 2023 •
edited
Loading

I'm running into this since upgrading from Terraform 1.2.9 to 1.4.5. I think the problem might be that Terragrunt isn't copying the provider lock file to the module cache directory it creates from a dependency when it fetches outputs from that dependency. Here are some debug logs from a run:

time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=[Partial] Included config /path/to/terragrunt/terragrunt.hcl has strategy shallow merge: merging config in (shallow). prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Getting output of dependency /path/to/terragrunt/dependency/terragrunt.hcl for config /path/to/terragrunt/my-module/terragrunt.hcl
time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=[Partial] Included config /path/to/terragrunt/terragrunt.hcl has strategy shallow merge: merging config in (shallow). prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=[Partial] Included config /path/to/terragrunt/terragrunt.hcl has strategy shallow merge: merging config in (shallow). prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Did not find any locals block: skipping evaluation. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=[Partial] Included config /path/to/terragrunt/terragrunt.hcl has strategy shallow merge: merging config in (shallow). prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Detected remote state block with generate config. Resolving dependency by pulling remote state. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Setting dependency working directory to /path/to/terragrunt/dependency/.terragrunt-cache/2913281995 prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Generated file /path/to/terragrunt/dependency/.terragrunt-cache/2913281995/backend.tf. prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Generated remote state configuration in working dir /path/to/terragrunt/dependency/.terragrunt-cache/2913281995 prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:49Z level=debug msg=Running command: terraform init -get=false prefix=[/path/to/terragrunt/dependency]
time=2023-05-15T18:58:53Z level=debug msg=Running command: terraform output -json prefix=[/path/to/terragrunt/dependency]
╷
│ Error: Required plugins are not installed
│
│ The installed provider plugins are not consistent with the packages
│ selected in the dependency lock file:
│   - registry.terraform.io/hashicorp/aws: the cached package for registry.terraform.io/hashicorp/aws 4.67.0 (in .terraform/providers) does not match any of the checksums recorded in the dependency lock file
│
│ Terraform uses external plugins to integrate with a variety of different
│ infrastructure services. To download the plugins required for this
│ configuration, run:
│   terraform init
╵

/path/to/terragrunt/dependency contains .terraform.lock.hcl file, and that file specifies version 4.64.0 of the AWS Terraform provider. Notice that nowhere in these logs does it look like Terragrunt is copying the lockfile into its cache dir: it only generates backend.tf.

Interestingly, I have a mixture of successes and failures from dependencies using the same provider and version. I think this is due to the cache's weird parellelism issues. (We warm our provider cache out of band before running any Terragrunt to avoid this issue.)

getTerragruntOutputJsonFromRemoteState looks to be the culprit. It maybe needs to be enhanced to copy in .terraform.lock.hcl?

I ran an inotifywait monitor on the cache directory of the dependency, and something in there is definitely concerning itself with the lockfile:

Collapsed 
.terragrunt-cache/ CREATE,ISDIR 2827587568
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CREATE backend.tf
.terragrunt-cache/2827587568/ OPEN backend.tf
.terragrunt-cache/2827587568/ MODIFY backend.tf
.terragrunt-cache/2827587568/ CLOSE_WRITE,CLOSE backend.tf
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ OPEN backend.tf
.terragrunt-cache/2827587568/ ACCESS backend.tf
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE backend.tf
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ CREATE,ISDIR .terraform
.terragrunt-cache/2827587568/ OPEN,ISDIR .terraform
.terragrunt-cache/2827587568/ ACCESS,ISDIR .terraform
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ CREATE .terraform.tfstate.lock.info
.terragrunt-cache/2827587568/.terraform/ OPEN .terraform.tfstate.lock.info
.terragrunt-cache/2827587568/.terraform/ MODIFY .terraform.tfstate.lock.info
.terragrunt-cache/2827587568/.terraform/ CLOSE_WRITE,CLOSE .terraform.tfstate.lock.info
.terragrunt-cache/2827587568/.terraform/ MODIFY terraform.tfstate
.terragrunt-cache/2827587568/.terraform/ DELETE .terraform.tfstate.lock.info
.terragrunt-cache/2827587568/.terraform/ CLOSE_WRITE,CLOSE terraform.tfstate
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ OPEN backend.tf
.terragrunt-cache/2827587568/ ACCESS backend.tf
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE backend.tf
.terragrunt-cache/2827587568/.terraform/ CREATE,ISDIR providers
.terragrunt-cache/2827587568/.terraform/ OPEN,ISDIR providers
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ CREATE,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CREATE,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CREATE,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CREATE,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ CREATE linux_amd64
.terragrunt-cache/2827587568/.terraform/ OPEN,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ CREATE .terraform.lock.hcl1714937562
.terragrunt-cache/2827587568/ OPEN .terraform.lock.hcl1714937562
.terragrunt-cache/2827587568/ ATTRIB .terraform.lock.hcl1714937562
.terragrunt-cache/2827587568/ MODIFY .terraform.lock.hcl1714937562
.terragrunt-cache/2827587568/ CLOSE_WRITE,CLOSE .terraform.lock.hcl1714937562
.terragrunt-cache/2827587568/ MOVED_FROM .terraform.lock.hcl1714937562
.terragrunt-cache/2827587568/ MOVED_TO .terraform.lock.hcl
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ OPEN backend.tf
.terragrunt-cache/2827587568/ ACCESS backend.tf
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE backend.tf
.terragrunt-cache/2827587568/.terraform/ OPEN terraform.tfstate
.terragrunt-cache/2827587568/.terraform/ ACCESS terraform.tfstate
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE terraform.tfstate
.terragrunt-cache/2827587568/ OPEN .terraform.lock.hcl
.terragrunt-cache/2827587568/ ACCESS .terraform.lock.hcl
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE .terraform.lock.hcl
.terragrunt-cache/2827587568/.terraform/ OPEN,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ OPEN,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ OPEN,ISDIR 
.terragrunt-cache/2827587568/ ACCESS,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/ ACCESS,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/ OPEN,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ OPEN backend.tf
.terragrunt-cache/2827587568/ ACCESS backend.tf
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE backend.tf
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ OPEN .terraform.lock.hcl
.terragrunt-cache/2827587568/ ACCESS .terraform.lock.hcl
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE .terraform.lock.hcl
.terragrunt-cache/2827587568/ OPEN .terraform.lock.hcl
.terragrunt-cache/2827587568/ ACCESS .terraform.lock.hcl
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE .terraform.lock.hcl
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/ OPEN,ISDIR 
.terragrunt-cache/ OPEN,ISDIR 2827587568
.terragrunt-cache/2827587568/ OPEN,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/ ACCESS,ISDIR 2827587568
.terragrunt-cache/2827587568/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/ DELETE backend.tf
.terragrunt-cache/2827587568/ DELETE .terraform.lock.hcl
.terragrunt-cache/2827587568/ OPEN,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ OPEN,ISDIR 
.terragrunt-cache/2827587568/ ACCESS,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/ ACCESS,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ DELETE terraform.tfstate
.terragrunt-cache/2827587568/.terraform/ OPEN,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/ ACCESS,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ OPEN,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ ACCESS,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ OPEN,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ ACCESS,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ OPEN,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ ACCESS,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ OPEN,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ OPEN,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ ACCESS,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ ACCESS,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ DELETE linux_amd64
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/4.67.0/ DELETE_SELF 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ DELETE,ISDIR 4.67.0
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/aws/ DELETE_SELF 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ DELETE,ISDIR aws
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/hashicorp/ DELETE_SELF 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ DELETE,ISDIR hashicorp
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/registry.terraform.io/ DELETE_SELF 
.terragrunt-cache/2827587568/.terraform/providers/ DELETE,ISDIR registry.terraform.io
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE,ISDIR providers
.terragrunt-cache/2827587568/.terraform/providers/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/providers/ DELETE_SELF 
.terragrunt-cache/2827587568/.terraform/ DELETE,ISDIR providers
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR .terraform
.terragrunt-cache/2827587568/.terraform/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/.terraform/ DELETE_SELF 
.terragrunt-cache/2827587568/ DELETE,ISDIR .terraform
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR 2827587568
.terragrunt-cache/2827587568/ CLOSE_NOWRITE,CLOSE,ISDIR 
.terragrunt-cache/2827587568/ DELETE_SELF 
.terragrunt-cache/ DELETE,ISDIR 2827587568
.terragrunt-cache/ CLOSE_NOWRITE,CLOSE,ISDIR

@geekofalltrades geekofalltrades mentioned this issue May 15, 2023
Merged
3 tasks
@geekofalltrades
Copy link
Contributor

I think I fixed it in #2568.

@levkohimins
Copy link
Contributor

levkohimins commented May 17, 2023 •
edited
Loading

Issue resolved in v0.45.12 release.

@geekofalltrades geekofalltrades mentioned this issue Jun 1, 2023
Closed
@joaocc
Copy link

joaocc commented Aug 24, 2023 •
edited
Loading

Hi,
I'm still have very serious issues in v0.49.1, having to resort to the "dummy-module" approach described here #1212 (comment)
Thanks

@joaocc joaocc mentioned this issue Aug 24, 2023
Closed
@levkohimins levkohimins mentioned this issue Sep 1, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
awaiting response Waiting for a response or more data from issue reporter question
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Handle provider lock file when fetching dependency outputs geekofalltrades/terragrunt
5 participants
@bushong1 @joaocc @geekofalltrades @denis256 @levkohimins