Some abstractions are wrong. To get rid of them, inline them, rip the unneeded stuff, and forget about the abstraction. I want to rip an abstraction like that!
You can have a very time efficient set implementation with two uninitialized arrays. It's not space efficient though.