Cyber Risks · Trail of Bits Blog

Introducing DIFFER, a new tool for testing and validating transformed programs

Summary: Trail of Bits released DIFFER, an open-source differential testing tool that runs an original program against transformed variants with the same seed inputs and compares outputs to find bugs and soundness violations. In a study with GrammaTech, DIFFER evaluated 90 debloated variants produced by 10 debloating tools across 20 programs, finding that 39 (~43%) retained features the tools failed to remove and 25 (~28%) crashed or produced incorrect outputs in retained features.

What's compelling: Debloating is sold as attack-surface reduction, yet the tooling left unwanted code in 43% of variants and broke 28% of them - meaning a hardened binary can carry both the vulnerabilities you meant to cut and new ones the transformation introduced.

Read the original at Trail of Bits Blog ↗