nice to have: Clean up outdated binaries

[bpmct]

From #89

Though I think we need to implement some housekeeping, today those binaries will accumulate in the cache