Skip to content

Write cache atomically using a tempfile in the same directory - #1111

Merged
martindurant merged 4 commits into
fsspec:masterfrom
jwodder:gh-1107
Nov 22, 2022
Merged

martindurant merged 4 commits into
fsspec:masterfrom
jwodder:gh-1107

Conversation

@jwodder

@jwodder jwodder commented Nov 11, 2022

Copy link
Copy Markdown
Contributor

Closes #1107.

Comment thread fsspec/implementations/cached.py
@yarikoptic

Copy link
Copy Markdown
Contributor

FWIW: Although doesn't really resolve #1107 I think this PR is the right thing to do. WDYT @martindurant ?

@jwodder
jwodder marked this pull request as ready for review November 21, 2022 14:42
@yarikoptic

Copy link
Copy Markdown
Contributor

not sure why downstream testing errored out

Updating 'test_env' env from conda env update...
  /usr/share/miniconda/condabin/conda env update --name test_env --file ci/environment-downstream.yml
  Collecting package metadata (repodata.json): ...working... done
  Solving environment: ...working... ::endgroup::
Error: The process '/usr/share/miniconda/condabin/conda' failed with exit code null

and have no super-powers to restart, but I think this PR is ready for being reviewed/merged (attn @martindurant )

@martindurant

martindurant commented Nov 21, 2022

Copy link
Copy Markdown
Member

Fixing CI in #1120 , probably needs a few iterations yet

done

@martindurant
martindurant merged commit 057f533 into fsspec:master Nov 22, 2022
@jwodder
jwodder deleted the gh-1107 branch October 27, 2023 20:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Cached filesystem not concurrency-safe?

3 participants