I have a 5-1/4 from probably 15 or more years ago stuck away in my Supply Cabinet of Antiquities.
One thing you need to be aware of with USB diskette drives. Most of them don't obey the write protect tab. That became a problem where I used to work when they went from either XP to 7 or 7 to 10 (don't remember which right away) because the newer OS would write some hidden system directory to label the external volume and this would modify production diskettes that had the Quality Control seal placed over the write slot. The next time a media validate was ran on the diskette it would be reported as Failed due to extra files.