Repository navigation

Introduce more flexible storeChunk() syntax, use to add ADIOS2 memory selection - #1620

Open

franzpoeschel wants to merge 94 commits into

openPMD:devfrom

franzpoeschel:adios2-memory-selection

Open

Introduce more flexible storeChunk() syntax, use to add ADIOS2 memory selection#1620
franzpoeschel wants to merge 94 commits into
openPMD:devfrom
franzpoeschel:adios2-memory-selection

Commits on Oct 29, 2026
- Add memory selection task to backend
  franzpoeschel
  committed
  a69e466
- Add future helper
  franzpoeschel
  committed
  9e76f84
- Fixes for UniquePtr.hpp
  franzpoeschel
  committed
  7af995b
- Main implementation of LoadStoreChunk.hpp
  franzpoeschel
  committed
  56a9b71
- Adapt RecordComponent implementation based on new API
  franzpoeschel
  committed
  882b34f
- Testing
  franzpoeschel
  committed
  c737cac
- Enable support for const unique pointers?
  franzpoeschel
  committed
  fa790f3
- Use a better trick to cheat clang-tidy
  franzpoeschel
  committed
  c7af808
- clang-tidy fixes
  franzpoeschel
  committed
  4def377
- Fix linker error
  franzpoeschel
  committed
  26c01aa
- Reimplement unique_ptr-based span API
  franzpoeschel
  committed
  c79d407
- Fix parallel tests
  franzpoeschel
  committed
  3eddd1e
- Type signature fix
  franzpoeschel
  committed
  a4ce159
- Destructor for ~DeferredComputation
  franzpoeschel
  committed
  f8e7232
- CI fixes
  franzpoeschel
  committed
  f822646
- wip: runtime-erase pointer type
  franzpoeschel
  committed
  60133c1
- Continue
  franzpoeschel
  committed
  0a53706
- Mostly working again
  franzpoeschel
  committed
  9e84ad9
- bad fix, remove the bool from python bindings
  franzpoeschel
  committed
  7e77daa
- Remove bool dataset operations from python API
  franzpoeschel
  committed
  30e2973
- Fix Coretest
  franzpoeschel
  committed
  519296a
- instantiate some more methods
  franzpoeschel
  committed
  6d1715d
- wip: unify common code into compiled functions
  franzpoeschel
  committed
  a76f545
- clang-tidy fixes
  franzpoeschel
  committed
  7f9386a
- CI fixes
  franzpoeschel
  committed
  1c235a2
- Remove CRT pattern and core namespace
  franzpoeschel
  committed
  e14d8f2
- Move wrappers to header code
  franzpoeschel
  committed
  275366e
- Interface cleanup
  franzpoeschel
  committed
  64ea972
- Fix after rebase
  franzpoeschel
  committed
  905d161
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  
  pre-commit-ci[bot]
  authored and
  franzpoeschel
  committed
  e5c1a26
- Suffix ..Raw for internal legacy store/load operations
  franzpoeschel
  committed
  c9e9652
- Remove enqueue prefixes, these are now default
  franzpoeschel
  committed
  3e512d6
- Add future task with caching option
  franzpoeschel
  committed
  9a02c83
- Add unsafeNoAutomaticFlush
  franzpoeschel
  committed
  38ab670
- add missing constructor
  franzpoeschel
  committed
  3b310fd
- remove internal use of raw methods
  franzpoeschel
  committed
  c9078a3
- Remove raw methods
  franzpoeschel
  committed
  797fcc0
- Avoid if constexpr, msvc doesnt get it
  franzpoeschel
  committed
  d67a89e
- Add Doxygen documentation to new functions and types
  
  AI Agent
  authored and
  franzpoeschel
  committed
  f7eb3b4
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  
  pre-commit-ci[bot]
  authored and
  franzpoeschel
  committed
  5324d74
- CI fixes
  franzpoeschel
  committed
  8c912b2
- Documentation fixes
  franzpoeschel
  committed
  d872119
- AI code review
  franzpoeschel
  committed
  030663a
- Rename forget() -> invalidate()
  franzpoeschel
  committed
  c5429f1
- Fix MSVC compilation
  franzpoeschel
  committed
  9ca1989
- Fix move constructor / assignment operator
  franzpoeschel
  committed
  87ce5f2
- Add a small test for DeferredComputation
  franzpoeschel
  committed
  488823e
- Remove core namespace leftover
  franzpoeschel
  committed
  0c5edeb
- Fix operation counting
  franzpoeschel
  committed
  0970418
- nodiscard specifications
  franzpoeschel
  committed
  4cbf3c5
- Steal some API additions from later branches
  franzpoeschel
  committed
  3f07839
- Track flush counter per record component
  franzpoeschel
  committed
  aea3953
- Remember buffer sizes
  franzpoeschel
  committed
  9a09f88
- Document the bufferSize() and withContiguousContainer() APIs
  
  Blablador
  authored and
  franzpoeschel
  committed
  b8d694b
- Add regression test for per-record-component flush counter
  
  Blablador
  authored and
  franzpoeschel
  committed
  9a68ee5
- Preserve full-selection expansion in loadChunkRaw()
  
  Blablador
  authored and
  franzpoeschel
  committed
  d85cf97
- Add tests for container buffer-size validation
  
  Blablador
  authored and
  franzpoeschel
  committed
  1cabf48
- Check pointer equality in deleter, forbid swapping out pointers
  franzpoeschel
  committed
  1a24f6b
- rename test files
  franzpoeschel
  committed
  2e4f4b2
- clean up joined dim logic
  franzpoeschel
  committed
  2070177
- Mutual exclusion between memory selection and joined dimension
  
  franzpoeschel
  and
  ax3l
  committed
  64cccf9
- Avoid use-after-free, use unique_ptr for storing component handle
  franzpoeschel
  committed
  6b3dac3
- Fix joined-dimension load path in buffer-based loadChunk/storeChunk
  
  Blablador
  authored and
  franzpoeschel
  committed
  ab501fb
- Document collective semantics of deferred I/O automatic flush
  
  Blablador
  authored and
  franzpoeschel
  committed
  f2f23f8
- Move joined_dim_buffer_api test to its own file
  
  Blablador
  authored and
  franzpoeschel
  committed
  34ceee6
- Reject chunk loading of joined arrays in loadChunk_impl
  
  Blablador
  authored and
  franzpoeschel
  committed
  b1d69ee
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  
  pre-commit-ci[bot]
  authored and
  franzpoeschel
  committed
  5344209
- Bound-checking for memory selections
  
  franzpoeschel
  and
  ax3l
  committed
  841ff5a
- Reject unsupported memory selections before enqueueing the chunk
  
  Blablador
  authored and
  franzpoeschel
  committed
  0f0a286
- Ban memory selections on ADIOS2 versions without reset support
  
  Blablador
  authored and
  franzpoeschel
  committed
  b9bd62b
- Make ConfigureLoadStore copyable
  franzpoeschel
  committed
  d500916
- Fix non-ADIOS2 builds
  franzpoeschel
  committed
  e39b7ea
- Add missing const
  franzpoeschel
  committed
  e6142c7
- fix capture specification for MSVC's benefit
  franzpoeschel
  committed
  5656caa
- [rebase me] make buffer-type loadstorechunk config objects copyable
  franzpoeschel
  committed
  8502718
- msvc fixes...
  franzpoeschel
  committed
  7e669d7
- Reject reusing a buffer configuration after store()/load()
  
  AI Agent
  authored and
  franzpoeschel
  committed
  0e33cdc
- Run pending task when move-assigning a DeferredComputation
  
  AI Agent
  authored and
  franzpoeschel
  committed
  b5e4bc6
- Treat {0} offset / {-1u} extent as defaults in chaining API
  
  AI Agent
  authored and
  franzpoeschel
  committed
  894655c
- Consolidate newly added tests into fewer files
  
  AI Agent
  authored and
  franzpoeschel
  committed
  0b2e43a
- Cleanup
  franzpoeschel
  committed
  6809ef3
- Do not run Futures upon destruction
  franzpoeschel
  committed
  476347f
- Fix copying semantics
  franzpoeschel
  committed
  2d38f97
- Handle const contiguous buffers
  franzpoeschel
  committed
  fceffd0
- Fix deferred API contracts and joined-dimension loads
  
  AI Agent
  authored and
  franzpoeschel
  committed
  1723b0e
- Shorten deferred API documentation
  
  AI Agent
  authored and
  franzpoeschel
  committed
  ac97218
- further cleanup
  franzpoeschel
  committed
  7648f39
- Fix GCC 11 signature mismatch and Doxygen param warnings
  
  AI Agent
  authored and
  franzpoeschel
  committed
  ff6cab3
- Guard chunk size and memory selection computations against overflow
  
  AI Agent
  authored and
  franzpoeschel
  committed
  314a69c
- Restore read-mode sanity check in ADIOS2 touch
  
  AI Agent
  authored and
  franzpoeschel
  committed
  e811302
- Update buffer configuration reuse comment
  
  AI Agent
  authored and
  franzpoeschel
  committed
  12d085e
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  ba52921
- Add get_deferred
  franzpoeschel
  committed
  c8d9e45
Commits on Oct 30, 2026
- Enqueue flush counter after chunk tasks and clean up
  
  AI Agent
  authored and
  franzpoeschel
  committed
  ab43296

Commits

Commits on Oct 29, 2026

Commits on Oct 30, 2026