The HDF Group – ensuring long-term access and usability of HDF data and supporting users of HDF technologies
The HDF Group is a not-for-profit corporation with the mission of sustaining the HDF technologies and supporting HDF user communities worldwide with production-quality software and services.
- Website
- hdfgroup.org · all feeds from this site
- Feed URL
https://www.hdfgroup.org/feed/
Read it in your FeedListing reader
Or add to: Feedly Inoreader Raw feed
Latest posts
-
HDFView 3.5.0: A Clearer View of Complex Data
HDFView 3.5.0 is now available. The release addresses several long-standing issues. HDFView is now more reliable for variable-length and compound data, and easier to set up on all supported platforms. Download the latest release from the HDFView download page. Better Support for…
-
Streaming HDF5 Without Sending Every Frame: Watching a Fatigue Crack Grow.
by Scot Breitenfeld, Director of Engineering, The HDF Group For an experiment at the Advanced Photon Source, an aluminum specimen cracked from a corrosion pit to complete failure after 14,346 fatigue cycles. During the process, a micro-CT scanned the specimen, generating 16.8 GB…
-
HSDS 1.0.0 Release: A Milestone for Cloud-Native HDF5
The HDF Group is happy to announce the release of HSDS 1.0.0, h5pyd 1.0.0, and hdf5-json 2.0.0. The three projects now share a single implementation of the HDF5 object model instead of maintaining three copies of it. Additionally, this release brings major architectural…
-
Oldie but a goodie
Nearly 40 years on, HDF4 receives one final official release focused on security, stability, and long-term use. HDF4 has supported scientific computing for nearly four decades. It has powered remote sensing systems, Earth science applications, aerospace work, and long-lived…
-
HDF5 beyond the file: findings from our safety, security, and privacy audit
Excerpt: A new ecosystem-level audit identifies recurring failure classes, clarifies where authority and responsibility reside, and proposes a phased mitigation roadmap for HDF5 and its wider software and data ecosystem. HDF5 is foundational infrastructure for science and…
-
HDF5 was the mechanism, not the vulnerability
In our July 31 post, “When an HDF5 file points outside itself,” we described the use of HDF5 external raw storage in the Hugging Face incident. Some later accounts have labeled this as an “HDF5 vulnerability.” A recent Black Hat presentation, around 27:13, refers to it as “a…
-
Storing bfloat16 and FP8 tensors in HDF5 without a conversion tax
by Scot Breitenfeld, Director of Engineering, The HDF Group Training and deploying large models requires transferring significant volumes of low-precision tensors, including weights, gradients, activations, and KV caches. bfloat16 maintains float32’s exponent range, ensuring…